Data Engineer - Big Data/hadoop/hive

Job Description

• Opportunity for the Data Engineer position with a Mid sized product company which is based in Bengaluru Position: Data Engineer Location: Bengaluru Skill Set: - Experience in Hadoop Hive Spark/Storm - 2 to 5 years of experience in SQL Java XML languages - Bachelors degree in Computer Science or equivalent industry qualifications. - Demonstrable experience in management of multiple ETL solutions. - Demonstrable experience troubleshooting and solving complex technical problems. - Ability to translate what the business wants to accomplish with its data and design the best possible ETL process around those goals whilst implementing data quality considerations. - Ability to present and discuss technical details in a business language way and translate requirements in to a technical output - Perform tests and validate all data flows and prepare all ETL processes as per business requirements Responsibality: - Designing and creating the data extraction transformation and load of data functions - Excellent knowledge on big data platform such as Hadoop - Understanding of Hive and Spark and willingness to know - Data modelling of complex large data sets. - Manage New Demand Solution Scope & Design of ETL requests. - Ensure solutions are built to best practices to guarantee stability availability and resilience maintaining all relevant documentation. - Awareness of and compliance to data security privacy and legal policies. - Ensure zero data security compliance issues. - Responsible for accuracy and availability of data

Job Summary