Job Description :
Senior Spark Data Engineer Location: Bedminster, NJ Type: 6+ Months Skills: AWS Data Bricks PySparkPython Data Lake Total Experience: 10 years Spark Data Engineer with over 3 years of hands on Spark Python and or Spark R experience Must possess good understanding of typical Data Lake Architecture involving Databricks or Spark clusters in general Must be able to build jobs on Databricks platform in Python or R independently Must possess good understanding and ability to implement Spark data engineering best practices Must have the ability to scale as Databricks Admin Nature of work will be 20 data engineering build and 80 Admin We need a well experienced strong spark Data Engineer Must possess knowledge as to how things work and are connected in a Databricks Spark environment but hands on experience is not necessary but will be nice to have Must be possess knowledge and perspective how to leverage Databricks unique features vs other Spark implementations