Job Description :
Fulltime / Permanent JOB.
Immigration Type: Green Card and Citizen.
Salary: $150K + Benefits + Relocation (upto $5K)
Required Skills:
· Should lead and guide a team of Spark developers Implantation of Spark Core, Sparks and Spark Streaming
· Experience on Apache Kafka Integration with Apache Spark Implementing security for Spark Applications
· Solid understanding of big data environments
· Working with Spark in combination Hadoop Ecosystem
· Proven experience processing and aggregating over billions of rows
· Good working knowledge on Hive
· Experience publishing RESTful API s to enable real-time data consumption
· Solid hands-on experience with Spark Core, Spark Streaming, SparkSQL for real-time data processing (at least one year proven experience)
· Developing Hive UDFs in Python or Java and integrating with Spark
· Integrating Spark with RDBMS (at least two mandatory)
· Working with Apache Kafka Should be able to fine tune performance of Spark applications
· Build and maintain performant, fault-tolerant, scalable distributed software systems
· Demonstrated success working with cross-functional teams Well-versed in the development challenges inherent with highly scalable, highly available, and highly resilient systems.