Senior Big Data Engineer

Job Description

• Key Responsibilities Create and maintain the banks data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements Identify design and implement internal process improvements: automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition operational efficiency and other key business performance metrics. Work with stakeholders including the Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Keep our data separated and secure across national boundaries through multiple data-centers. Desired Experience/Skills Strong analytic skills related to working with unstructured datasets. Ability to quickly learn and implement newer technologies particularly on the Big Data side including Spark HBase Kafka and Nifi Exposure to data pipelines architectures and data sets Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Build processes supporting data transformation data structures metadata dependency and workload management. Working knowledge of message queuing stream processing and highly scalable big data data stores. Please refer to the Job description above

Job Summary