Job Description :
Job Title: Hadoop Developer
Location: New York City, NY
Type of hire: Contract

Job Description :

1. Hands-on experience with Hive, Spark, Impala and similar tools for SQL-like exploration of large-scale data sets
2. Experience in Cloudera distribution and basic knowledge of AWS cloud computing platform
3. Ability to do post-mortem if something bad happens to the production systems. Identify what went wrong and provide detailed RCA.
4. Perform advanced troubleshooting and monitoring of the systems to ensure SLAs are met
5. Strong Programming experience in Python ,SQL, Shell Script / bash
6. Hands-on experience with Linux/Unix
7. Flexible to work in shifts
8. Knowledge in Data Lake platform
9. Knowledge in any ETL/BI tool is plus
10. Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
11. Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
12. Knowledge of various ETL techniques and frameworks, such as Flume
13. Experience with various messaging systems, such as Kafka or RabbitMQ
14. Good understanding of Lambda Architecture, along with its advantages and drawbacks
15. Skill set requirement - Data lake, Cloudera, Hadoop Mapreduce, yarn, hdfs, Hive, Proficient in Spark, Debug yarn, flume, logs, Talend and Linux
16. Demonstrated ability and experience in the entire solution development cycle: from design, implementation, debugging and maintenance.
17. The ability to work independently and in small teams, partner effectively cross-group, and manage multiple priorities and deliverables concurrently.