Job Description :
Interface with the Product team to gather, understand and translate requirements into the Agile delivery process.
Work closely with other Data Platform engineers to provide technical requirements.
Deploy, Run, and Debug the ETL engine running the config scripts built by the ETL Engineering team.
Support generic ingestion engine, data processing through AWS EMR.
Manage individual sprint priorities, deadlines, and deliverables.
Ensure that we are continuously raising our standard of data engineering excellence by implementing best practices for coding, testing and deploying.
In addition to being able to carry out the above responsibilities, we''re looking for someone comfortable working in a fast paced, ever changing environment who has a good deal of experience with SaaS applications, as indicated by the following attributes.

Skillset & Qualifications:
5+ years of Software development experience
Experience in database and data integration
Proficiency with scripting languages; Python and Shell Script
Experience with Amazon Web Services, particularly EMR
Hands on experience with Hadoop stack M/R, Hive, Pig, Hbase
Experience in real stream processing with Spark/Kafka/Kinesis
Self-driven and ability to lead complex projects
Ability to influence others and direction of projects
             

Similar Jobs you may be interested in ..