Job Description :
Hi
I have following urgent requirement with my client. Please send the updated resume with rate expectation at “”
Job title- Spark developer
Location- Edison, NJ or Dallas, TX
Summary The Data Engineer will be responsible for building, maintaining data pipelines and data products to ingest, process large volume of structured / unstructured data from various sources.
The Data engineer will work on analyzing the data needs, migrating the data into an Enterprise data lake, build data products and reports.
The role requires experience with building real time and batch based ETL pipelines with strong understanding of big data technologies and distributed processing frameworks with.
Skill Needso Expertise working with large scale distributed systems (Hadoop, Spark
o Strong understanding of the big data cluster, and its architecture
o Experience building and optimizing big data ETL pipelines.
o Advanced programming skills with Python, Java, Scala
o Good knowledge of spark internals and performance tuning of spark jobs.