Big Data Engineer - Hadoop/elk Stack

The Silicon Partners Inc We are developing innovative new features including the next-generation cluster management system, real-time processing for big data and intuitive w.....

The Silicon Partners Inc Bengaluru ₹ NA 5-10Y JobType object (1)
Job Description
  • We are developing innovative new features including the next-generation cluster management system, real-time processing for big data and intuitive ways of interacting with data. This is a hands-on position where you will be doing everything from designing and building extremely stable components and cutting-edge features to formulating strategy to keep leading in Big Data
  • , We are looking for top engineers to build them from the ground up for our team based out of Bangalore
  • , Job responsibilities :, , - Design, Develop, test and maintain platforms (such as databases and large-scale processing systems), , - Ensure architecture will support the requirements of the business, , - Discover opportunities for data acquisition, , - Develop data set processes for data modeling, mining and production, , - Employ a variety of languages and tools (e.g. scripting Languages) to integrate multiple systems together, , - Recommend ways to improve data reliability, efficiency and quality. , Skills required :,- Expertise in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Yarn),- Hands on experience on real-time streaming data architectures (Apache Kafka ),- Hands on experience with ELK stack ( ElasticSearch, LogStash, Kibana ),- Must also have considerable expertise in data warehousing and NoSql technologies ( Apache Cassandra, Apache Ignite),- Programming Experience in Java/Scala/Python,- Autoscaling large scale Applications ( Kubernetes/Ansible),Qualifications :,- MS / M.Tech / B. Tech. degree in Computer Science, Engineering
  • - Around 5-10 years of relevant experience.
Job Summary
We are developing innovative new features including the next-generation cluster management system, real-time processing for big data and intuitive w