Big Data Spark/hadoop Software Engineer

Job Description

• As a member of our Everest Engineering Group you will be in the center of implementing the services underpinning Corporate Technologies Data Strategy.
• The team will deliver highly resilient fault tolerant horizontally scalable services like:
• Data Ingestion
• Data Registration
• Metadata
• Alerting
• Data Provisioning
• Data Transformation
• Resource Management
• These services are delivered in an agile way in partnership with the Tower AD teams. The code base is internal Open Source so that all developers can contribute to the code base. All software is delivered in a test driven manner.
• This role requires a wide variety of strengths and capabilities including:
• · Working proficiency in developmental toolsets like Eclipse IntelliJ
• · Ability to collaborate with high-performing teams and individuals throughout the firm to accomplish common goals
• · Proficiency in one or more general purpose programming languages like Java and Scala.
• · Minimum 5 + years of financial application development/consulting experience.
• · Solid experience in Core Java and Micro Services design and development
• · Some hands on Hadoop development specifically in one or more of the following areas:
• o Kafka Real time messaging
• o Hbase modeling and development
• o Spark processing and performance tuning
• o Sqoop data ingestions
• o Parquet file partitioning
• o Impala
• · Experience with Cloud native application development Cloud deployment and Cloud application refactoring
• · Exposure/competence with Agile Development approach
• · Solid experience utilizing Source code control software (e.g. GIT Subversion)
• · Multi-threaded Programming
• · RDBMS experience preferably with Oracle including stored procedures
• · Test Driven Development/Behavior Driven Development
• · Jenkins/Mavin
• · FindBugs Sonar JUNIT Performance Memory Management
• · Understanding of software skills such as business analysis development maintenance and software improvement
• ·
• · Continuous Integration/Development
• · UNIX shell scripting (1+ year)
• The Everest team relies on smart technology-driven people like you to develop and deliver highly reusable enterprise quality solutions to support all of the businesses in Corporate.. Please see job details section for all requirements

Job Summary