Staff Software Engineer Data Platform

Job Description

• As a Senior Software Engineer you will work on the MAP PD data platform team reporting to the Director of Data Platform Engineering. You will be challenged to think out of the box and solve complex data related problems. you will be working with other teams/systems to collect data and build the ETL pipeline to store this data at a central location Run the aggregation processes to provide the KPI to external partners and merchants. You will collaborate with the team to design implement and create reports and dash boards for MAP PD BI and predictive analytics and lead the design tasks for the Data Platform team. We expect our engineers to do much more than just writing code: Write optimized and quality code Partner closely with teams to produce an application that flows seamlessly and works intuitively with our clients Work with architecture team on research & analyses of newer technologies for the next generation of ENT applications Be comfortable leading meetings and discussions with non-technical teams Find the best and most creative solution to many different types of problems and help our client to achieve their real goals Enthusiastic and principled about finding and applying the best practices related to dimension modelling and Big data analytics. Minimum 7 + years of experience in the following Minimum 7 years of experience in design and development of large-scale Information products and services with following technologies: Java Scala RDBMS Big Data Hadoop platform technologies Strong working experience with Object Oriented Design and Development using Java is necessary Solid understanding of principles and APIs of MapReduce RDD DataFrame and DataSets Strong working experiences of implementing Big Data processing using MapReduce algorithms and Hadoop/Spark APIExperience in playing a lead role with a data centric team Expertise on Hadoop platform including Hadoop Hive HBase Spark Sqoop and related tools to build analytical applications Expertise in building workflow to perform predictive analysis muilti-dimensional analysis data enrichments etc. Expertise of database fundamentals RDBMS data modeling NOSQL database and data modeling and programming Experience in Agile methodologies such as Scrum. Experience in supporting large enterprise applications Always have an aptitude to learn new technologies and take on challenges Bachelor or Master Degree in Computer Science or other related technology discipline Knowledge of Security Principles and Accessibility Best Practices.

Job Summary