Data Engineer

Location: Bengaluru

Experience: (3-5) years on Big data technologies

Requirements:

  • Mid to advanced level knowledge of Python and Pyspark
  • Knowledge of Azure, Hadooop 2.0 ecosystems, HDFS,  MapReduce, Hive, Pig, sqoop, Mahout, Spark
  • Experience with Web Scraping frameworks (Scrapy or Beautiful Soup or similar)
  • Extensive experience working with Data APIs (Working with RESTful endpoints and/or SOAP)
  • Significant programming experience (with the above technologies as well as Java, R, and Python on Linux)
  • Knowledge of any commercial distribution like HortonWorks, Cloudera, MapR
  • Excellent working knowledge of relational databases, MySQL, Oracle, etc.
  • Experience with Complex Data Parsing (Big Data Parser)
  • Natural Language Processing (NLP) skills
  • Knowledge of High-Speed Data Ingestion, Real-Time Data Collection, and Streaming

Job Application