Data Engineer(python)

Catalyst Design Develop Execute & Manage a Data Science Data Warehouse (DS-DWH) which will involve writing ETL jobs in Python to read data from MongoDB an.....

Catalyst Bengaluru ₹ NA 2-5Y Full Time
Job Description
  • Design Develop Execute & Manage a Data Science Data Warehouse (DS-DWH) which will involve writing ETL jobs in Python to read data from MongoDB and create a MongoDB + PostGreSQL DS-DWH This DS-DWH would be the primary DWH that other data scientists in the team will use to design develop and execute ML algorithms that runs Wizelys proprietary Gamification Engine. Creating Reporting Dashboards using open source platforms including but not limited to Google Data Studio Re-Dash Jasper with a Python ETL Layer from MongoDB. Design and development experience building a reusable REST API model/framework to consume data from and/or push data into MongoDB (or similar technology). 2-3 yrs of experience in SQL/NoSQL/Python Scripting and Working with MongoDB database to extract the desired results. Experience in creating Reporting Dashboards using open source platforms including but not limited to Google Data Studio Re-Dash Jasper with a Python ETL Layer from MongoDB. Design and development experience building a reusable REST API model/framework to consume data from and/or push data into MongoDB (or similar technology). In depth knowledge of modeling/architectural patterns governance methodologies and potential limitations within MongoDB Writing reusable testable and efficient code. Expertise in Python data warehouse. Familiarity with other functional or object orientated languages. Familiarity of working with databases and using SQL. Ability to reason about and work with distributed systems. Knowledge of risk and PNL reporting is desirable. Familiarity with Spark Impala Kafka and other Hadoop technologies is a plus.
Job Summary
Design Develop Execute & Manage a Data Science Data Warehouse (DS-DWH) which will involve writing ETL jobs in Python to read data from MongoDB an