Job Description :
Fulltime / Permanent JOB.

Immigration Type: Green Card and Citizen.

Salary: $150K + Benefits + Relocation (upto $5K)

Required Skills:

· Should lead and guide a team of Spark developers Implantation of Spark Core, Sparks and Spark Streaming

· Experience on Apache Kafka Integration with Apache Spark Implementing security for Spark Applications

· Solid understanding of big data environments

· Working with Spark in combination Hadoop Ecosystem

· Proven experience processing and aggregating over billions of rows

· Good working knowledge on Hive

· Experience publishing RESTful API s to enable real-time data consumption

· Solid hands-on experience with Spark Core, Spark Streaming, SparkSQL for real-time data processing (at least one year proven experience)

· Developing Hive UDFs in Python or Java and integrating with Spark

· Integrating Spark with RDBMS (at least two mandatory)

· Working with Apache Kafka Should be able to fine tune performance of Spark applications

· Build and maintain performant, fault-tolerant, scalable distributed software systems

· Demonstrated success working with cross-functional teams Well-versed in the development challenges inherent with highly scalable, highly available, and highly resilient systems.