Job Description :

Job Title: Data Engineer  (Python, Spark, Databricks, Azure ) 

Duration: 6 months

Location: Dallas TX ( REMOTE )

Job Description:

What we are looking for:

  • 5+ years prior experience writing, debugging, packaging and deploying in Python
  • Prior experience required using Spark (any language), including Spark SQL, debugging pipelines and performance issues. Preferably working with Databricks
  • Experience managing a custom code base, building automated pipelines around code repositories for release management  and debugging deployment issues 
  • Heavy experience with DevOps tools.  Building CI pipelines and integrating with release management tools (preferably ADO) 
  • RESTful API development experience 
  • Analytical, problem-solving and communication skills

Nice to have: 

  • A degree in Computer Science or related area
  • Ansible knowledge 
  • Experience working with Artifactory for build management
  • Experience writing API wrappers for a Spark backend
  • Azure Certifications 
  • Experience working with distributed teams
             

Similar Jobs you may be interested in ..