Data Lead Engineer - Big Data/hadoop

Job Description

• : - Responsible for developing coding testing and debugging solution related to our Data solutions - Develop enhance and maintain the data pipeline - ingestion transformation storage analysis and visualization using combination of open source and paid technology tools. - Automating data solutions for reporting KPI trends etc So you think you can ask bold questions challenge conventional wisdom value data and can think outside the box? Then here is the place for you to live your passion for technology! :- Youve 7+ years of years of experience in a professional environment performing analysis design and development tasks in distributed systems preferably in an eCommerce Domain- Youve built large-scale data pipelines which process millions of events per day and has experience in Java and SQL.- Understanding of data flows data architecture ETL and processing of structured and unstructured data- In-depth knowledge of Big Data distributions preferably with experience in messaging systems such as Kafka / Kinesis and stream processing systems such as Storm Spark Flume and cloud-based Columnar Data stores such as Amazon Redshift.- You have good experience in AWS infrastructure- You have good exposure to microservices architecture preferably with Thrift services.- You possess strong computer science fundamentals: data structures algorithms programming languages distributed systems and information retrieval. Familiar with data mining concepts and machine learning algorithms.- Experience with Data Warehouse design Business Intelligence and reporting tools a plus- Experience with MongoDB Elasticsearch is desirable- You are a strong communicator. Explaining complex technical concepts to product managers support and other engineers is no problem for you.- You are someone that others enjoy working with due to your technical competence and positive attitude.

Job Summary