Job Description :
Role: Java Developer with KAFKA and Spring Boot.
Duration of Project: Long-term
Experience: 10 + Years
Location: Roseland, NJ
Job Description Strong experience in Java, Python, SPARK and KAFKA experience.Strong experience in developing Spring Boot microservices on Pivotal platform (using Pivotal Cloud Foundry, Pivotal Application Services
Experience with medium-to-large data pipelines: implementing, testing and deploying.
Experience with stream processing using Kafka.Experience with automated unit and integration testing for Kafka and Py Spark.
Experience with Kafka Connect.Execute strategic engineering proof of concepts and product evaluations.
Develop monitoring strategies for infrastructure, platforms and applications aligning with enterprise strategy and overall industry trends.
HDFS, Spark, Hbase, Hive, Sqoop, Kafka, Storm, YARN, HiveQL, SparkSQL. Python experience is a plus.
Experience in developing Orchestration / Data Pipelines in Py Spark.
Strong Knowledge in developing Py Spark connectors (to RDBMS, Mainframe applications, Web service, MQ, Kafka
Worked in large data processing, real-time streaming and scalable architectures.
Experience in developing large Kafka clusters
Executing partitioning strategy
Implementing security & authorization (permission based) on Kafka clusterØ
Implementing ingestion services (to connect to RDBMS, Mainframe, Webservice, etc using Kafka producer API’s / Kafka Connect Spring Boot
Experience in developing Spring Boot Microservices
Working experience on Pivotal platform (PCF and PAS)