Lead Big Data Engineer - Java/ AWS/ ETL

Job Description

• Lead Big Data Engineer - Java/AWS/ETL (6-10 yrs) Lead Big Data Engineer - Java/AWS/ETL (6-10 yrs) We are looking for an experienced Lead Big Data Engineer to join our team and help build analytics platform which supports the e-commerce application where millions of traction happens every day and provides greater approach for management marketing and local teams. Position based out in Bangalore. You will play a significant role in our data engineering practice creating the infrastructure integrating with 3rd party libraries developing the analytics platform and also in data science implementation for automating manual processes and providing recommendations. Skills : - Youve 6+ years of years of experience in a professional environment performing analysis design and development tasks in distributed systems preferably in an eCommerce Domain - You have built large-scale data pipelines which process millions of events per day and has experience in Java and SQL. - Understanding of data flows data architecture ETL and processing of structured and unstructured data - In-depth knowledge of Big Data distributions preferably with experience in messaging systems such as Kafka / Kinesis and stream processing systems such as Storm Spark Flume and cloud-based Columnar Data stores such as Amazon Redshift. - You have good experience in AWS infrastructure - You have good exposure to microservices architecture preferably with Thrift services. - You possess strong computer science fundamentals: data structures algorithms programming languages distributed systems and information retrieval. Familiar with data mining concepts and machine learning algorithms. - Experience with Data Warehouse design Business Intelligence and reporting tools a plus - Experience with MongoDB Elasticsearch is desirable - You are a strong communicator. Explaining complex technical concepts to product managers support and other engineers is no problem for you. - You are someone that others enjoy working with due to your technical competence and positive attitude. What youll do : - Responsible for developing coding testing and debugging solution related to our Data solutions - Develop enhance and maintain the data pipeline ingestion transformation storage analysis and visualization using combination of open source and paid technology tools. - Automating data solutions for reporting KPI trends etc Note : We are looking for immediate joinee or max with the notice period of 30 days..

Job Summary