Position: Databricks Engineer (Onsite)
Location: Wilmington, DE || Need locals
Duration: 6-12 Months
Job Description
Looking for a skilled Databricks Engineer to build and optimize data pipelines on AWS using Databricks, EMR/EKS, and Terraform. The role involves developing scalable data solutions in Scala, Python, and Java, integrating with cloud infrastructure and ensuring performance, automation, and reliability.
Key Responsibilities -
Design and manage Databricks-based data pipelines on AWS.
-
Automate infrastructure with Terraform.
-
Deploy and optimize clusters using EMR/EKS.
-
Develop ETL workflows using Scala, Python, and Java.
-
Implement CI/CD with DBX and follow best practices in cloud data engineering.
Requirements -
5+ years of experience in data engineering or Databricks development.
-
Strong skills in AWS (EMR, EKS), Terraform, Databricks, and Spark.
-
Proficiency in Scala, Python, and Java.
-
Experience building automated, scalable data pipelines in cloud environments.