Job Description :
Data engineer Lead
Bentonville AR
Long term
Required Skills :
Airflow/Dataproc is Must
looking for a highly energetic and collaborative data Technical lead with experience leading enterprise data projects around Business and IT operations. The ideal candidate should be an expert in leading projects in the Cloud platform, airflow/dataproc clusters. Candidate should have good experience in defining the overall technical architecture for enterprise and customer data platforms. A good understanding of enterprise data architecture and systems is expected. Excellent written and verbal communication skills. As a Technical lead at UST Global- below are the Job description • Maintaining, administering and scaling of airflow/dataproc clusters • Engineer will be responsible for optimizing and maintaining deployment pipeline, airflow DAGs and ensuring airflow jobs are continuously running. • Expertise in Python, SQL and Linux operating systems is required. • Proficiency with technologies in the data engineering ecosystem including DataBricks, Big Query, Spark, PySpark and Kafka. • Familiarity with cloud tooling and offerings within Microsoft Azure and Google Cloud Platforms is expected. For this role, we value: • The ability to adapt quickly to a fast-paced environment • Excellent written and oral communication skills • A critical thinker that challenges assumptions and seeks new ideas • Proactive sharing of accomplishments, knowledge, lessons, and updates across the organization • Experience designing, building, testing and releasing software solutions in a complex, large organization Overall Experience level: 8+ years in IT with