Big Data Engineer - Hadoop/elk Stack

The Silicon Partners Inc We are developing innovative new features including the next-generation cluster management system real-time processing for big data and intuitive wa.....

The Silicon Partners Inc Bengaluru ₹ NA 5-10Y Full Time
Job Description
  • We are developing innovative new features including the next-generation cluster management system real-time processing for big data and intuitive ways of interacting with data. This is a hands-on position where you will be doing everything from designing and building extremely stable components and cutting-edge features to formulating strategy to keep leading in Big Data. We are looking for top engineers to build them from the ground up for our team based out of Bangalore. Job responsibilities : - Design Develop test and maintain platforms (such as databases and large-scale processing systems) - Ensure architecture will support the requirements of the business - Discover opportunities for data acquisition - Develop data set processes for data modeling mining and production - Employ a variety of languages and tools (e.g. scripting Languages) to integrate multiple systems together - Recommend ways to improve data reliability efficiency and quality. Skills required :- Expertise in Big Data space (Hadoop Stack like M/R HDFS Pig Hive HBase Yarn)- Hands on experience on real-time streaming data architectures (Apache Kafka )- Hands on experience with ELK stack ( ElasticSearch LogStash Kibana )- Must also have considerable expertise in data warehousing and NoSql technologies ( Apache Cassandra Apache Ignite)- Programming Experience in Java/Scala/Python- Autoscaling large scale Applications ( Kubernetes/Ansible)Qualifications :- MS / M.Tech / B. Tech. degree in Computer Science Engineering.- Around 5-10 years of relevant experience.
Job Summary
We are developing innovative new features including the next-generation cluster management system real-time processing for big data and intuitive wa