Job Description :
Role: Data Engineer Tech Lead
Location: Remote
Duration: 6-12+ Months
Re needs very senior 10+ yrs of experience Data Engineer Tech Lead with strong experience with Azure. Please see if any of your candidate would be suitable.


Required Experience:
* Over 10 years Data Engineering/Data Warehousing development/operations experience
* Azure cloud experience of at least 3 years with ADF V2, ADF Data flows, Azure Databricks, SQLDB/Hyperscale, SQLDW, ADLS Gen 2 and other Azure services
* Python & PySpark development
* SQL development including PL/SQL, preferably SQL Server but another RDBMS may be fine
* Managing an offshore team

Preferred Experience:
* Development using ETL tools like DataStage or Informatica
* ADF source code version control using Azure DevOps or Git
* Experience with Snowflake

Responsibilities:
* Develop new features and enhance existing data pipelines
* Contribute to solution design and technical design for new features
* Support data pipeline workload in the Production environment
* Monitor job execution, triage & troubleshoot job failures and other issues
* Make code changes to fix production failures and deploy code in production
* Report operations status to all stakeholders at regular cadence
* Identify opportunities to enhance, streamline, improve codebase and work with Dev leads to make that happen
* Monitor infrastructure proactively and identify opportunities to improve operational efficiency, job execution performance and overall cost