Job Description :
BigData –Spark Developer –
Thousand Oaks, CA
12 months

Job Description:
At least 3 years of hands on experience in Spark (fundamentals, RDD and data frame APIs)
Good experience on handling large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, Effective & efficient Joins, Transformations and other during ingestion process itself
Experience in or have a good understanding of data lake concept
Deep knowledge of Python
Advanced SQL Skills (multiple table queries, subqueries, window functions)
Experience in Spark Tuning, Spark Jobs scheduling and SQL
Experience with AWS cloud APIs
Familiarity with deploying, monitoring and debugging Spark jobs in Databricks
Databricks cluster performance monitoring and tuning

Client : Direct Client