Job Description :
Solid experience working in Big Data Environment (Hortonworks and Cloudera)
Big data background with experience designing and implementing large scale systems
Solid working experience with Hadoop, Hive-Tez, Enterprise Java development, NoSql data platforms (Cassandra), Pub/sub messaging (Kafka, ActiveMQ, JMS, etc), Stream processing (Storm, Hbase, Nifi, Spark Streaming, etc),
At least 2 years of experience with kafka spark based ingestion, NIFI integration
Thorough understanding of spark framework and tuning of spark applications
Extensive experience with horizontally scalable and highly available system design and implementation, with focus on performance and resiliency
Extensive experience profiling, debugging data on complex distributed systems
Willingness to commit extra effort to meet deadlines as required on a high profile and business critical project
Solid experience with Python and Java
Strong performance tuning experience of Hive/Spark/Kafka/Hbase
Extensive knowledge on Moving data between various platforms like Hadoop/Hive
Big Data Engineer Development/Operational experience in a multi-platform, multi-location, 7x24x365 global environment
Experience of working with cross-geographic, cross-functional, and cross-lob teams
Knowledge of best practice in change, problem, incident, configuration and system health management