Job Description :
Title: Spark Expert
Location: Santa Clara, CA
Duration: 3 to 6 months+
Start Date: ASAP
Rate: DOE
Locals Only, in person interview is a must
Required Skills:
- 8 to 10 years of experience with hands on design and coding on Hadoop, Spark/Scala and Python.
- Expertise in the Big Data processing and ETL Pipeline.
- Designing large scaling ETL pipelines - batch and real-time.
- Expertise in Spark Scala coding and Data Frame API (rather than the SQL based APIs
- Expertise in core Data Frame APIs.
- Expertise in doing unit testing Spark Data frame API based code.
- Strong in Scripting knowledge using Python and shell scripting.
- Experience and expertise in working on performance tuning of large scale data pipelines

Client : Confidential