Job Description :
1. Looking for a Bigdata, Kafka/Java Lead who can lead work at Architect Level and help the team make progress on the different technologies.
2. Very good understanding of Event-processing pipelines using Kafka, Java, Zookeeper, Hadoop, Spark, Scala, S3, Spark Streaming.
3. Hands experience in writing code for Producers, Consumers, Event processing with in Kafka, Spark streaming. Good hands on experience in building applications using event driven framework with Kafka.
4. Able to install new Kafka clusters and troubleshoot Kafka related issues in production environment with in given SLAs.
5. Worked in Big Data Environment and familiar with Big data tools like Hadoop, Spark, Hive, Hbase etc.
6. Familiar with Cloud deployments and other AWS tools like S3, Kinesis Streams, Kinesis Firehose, AWS connect etc.
7. Experience in building large scale enterprise integration implementation and web services and Microservices etc.
8. Using and developing event driven frameworks and REST services using databases, both RDBMS and NoSQL (e.g. Hadoop, MongoDB, etc Development experience with Java.
9. Hands-on experience in Java, Rest API, Kafka, Elasticsearch, SQL, AWS.
10. Hands customer facing experience supporting external developers in complex partner integration projects.
11. Work in a fast-paced agile development environment
12. Fine tune Hadoop applications for high performance and throughput
13. Troubleshoot and debug any Hadoop ecosystem run time issues
14. Understanding enterprise Hadoop environment
15. Ability to use JSON and/or XML formats for message. Able work with Avro, parquet formats.
16. Ability to work as part of a Scrum team, following SAFe agile practices
17. Strong communication and collaboration skills Should be comfortable working in a rapidly transforming organization
18. Knowledge of version control such as Git / Bitbucket and Jenkins for builds Understanding of how to integrate code into automated deployment pipelines with CICD.