Data Engineer/ Analyst - Apache/spark/hadoop

Job Description

• You will be exposed to : Apache Spark Hadoop Scala Python MySQL PostgreSQL Pig Hive HBase HDFS Map Reduce AWS Services (EC2 EMR Kinesis Redshift SNS Data- Pipeline Lambda Code-Pipeline) . Work with a mix of tried cutting-edge technologies in a distributed ecosystem- Strong CS fundamentals- Build data expertise and own data quality for the awesome pipelines you build. - Working on an analytics platform to collect transform store and analyze over a Billion events using Kinesis Firehose Kinesis Stream and Redshift Apache Spark Map Reduce HBase HDFS Map Reduce AWS Services. - Experience in building a recommendation engine for maximizing revenue. - Analyzing data on Redshift using SQL and built dashboards on Redash to track and visualize key metrics.

Job Summary