Job Description :
Role: Data Engineer
Location: Charlotte, NC (onsite post pandemic)
Duration: Longterm
No. of positions: Multiple
Industry: Healthcare
Mode of hire: CTH
Rate: Competitive
Interview process:
Candidates MUST do a technical screening on Databricks, Azure Data Factory,
Spark, Python (Pyspark) and ETL
Then 1 hour video interview with the team that will involve a live coding
session.
Key Skills: Databricks, Spark and ETL
Requirements:
* 70% Data Platform Engineer and 30% Data Optimization
* Senior level experience with Databricks
* Hands on experience with Azure data platform stack
* Experience with Spark designing and building end-to-end data
pipelines
* Experience working with Azure Delta Tables and Parquets
* Understand ETL data warehouse concepts and partitions
* Experience with Data Ingestion
* Ability to build pipelines to process structured and
semi-structured data.
* Understand principles of data optimization
* Understand the basic data engineering aspects and relational
modeling
Nice to have:
* Apache Airflow
* Azure Data Factory (ADF)