Job Description :
Lead Data Engineer for the team delivering BI solutions.

Responsibilities include:
Design and development of large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs.
Writes ETL (Extract / Transform / Load) processes, designs database systems and develops tools for real-time and offline analytic processing, by integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
Collaborates with different client teams, to develop and maintain long-term relationships with key stakeholders.
Deep engagement and consultation with all business teams to understand current and future needs.
Uses programming skills in Python and Java to build robust data pipelines and dynamic systems.
Works with offshore development team in establishing design patterns and development standards. Conducts code reviews and oversees unit testing.
Team up with on-shore and off-shore teams for code reviews, QA, and deployments.
Brain-storm with offshore development team on optimizing existing data-flow, quality and performance tuning, and building proof-of-concepts.

Qualifications:
Minimum qualifications:
Professional graduate/post-graduate degree in Computer Science discipline
Seven to ten years of work experience

Other skills:
Subject Matter Expert in Big Data.
Minimum of 5-7 years of experience in architectural and developing ETL processes, working in Business Intelligence horizons.
Expert level in Python, Java coding.
Expertise in Hadoop, Hive, MapReduce.
Expertise in UNIX, bash shell scripting.
Expertise in Spark and Kafka.
Production experience on Cloudera Hadoop Distribution.
Experience in AWS cloud platform.
Hands-On in DevOps tools – Github, Maven, Jenkins, Docker.
Knowledge on SOAP/REST webservices.
Nice to have Django web application development experience.