Job Description :
Please send me the resumes to and call me at Title- Senior Data Engineer (Cloud) Location- Remote work or 1600 McConnor Parkway, Schaumburg, IL What Project/Projects will the candidate be working on while on assignment?: Create and maintain data pipelines between on-premise data center, Azure Data Lake Storage, and Azure Synapse database using Databricks and Apache Spark/Scala. This role is for a senior data engineer that will join a team responsible for managing a growing cloud-based data ecosystem consisting of a metadata driven data lake and databases that support real time analytics, extracts, and reporting. The right candidate will have a solid background in data engineering and should have a few years of experience on a major cloud platform such as Azure. Is this person a sole contributor or part of a team?: Team If so, please describe the team? (Name of team, size of team, etc: Team Name: Alefgard, Size: Approximately 10+ What are the top 5-10 responsibilities for this position? (Please be detailed as to what the candidate is expected to do or complete on a daily basis): Building and maintaining a data processing framework on Azure using Databricks Writing code in Apache Spark/Scala Working with existing Databricks Delta Lake tables to optimize for CDC performance using techniques Working with existing Databricks Notebooks to optimize or address performance concerns Create new Databricks Notebooks or stand-alone Apache Spark/Scala code as needed Willingness to learn existing on-premise data management tools as required, such as Ab Initio What software tools/skills are needed to perform these daily responsibilities? Databricks Apache Spark Scala programming Azure What skills/attributes are a must have? Data engineering experience - 5 years Cloud platform experience - 2 years Version Control (Git or equivalent) - 2 years What skills/attributes are nice to have? Data Integration Tools (Spark/Databricks or equivalent) 2 years Version Control (Git or equivalent) 2 years Scripting (Linux/Unix Shell scripting or equivalent) 2 years Netezza experience Where is the work to be performed? (Please list preferred UHG facility, if other please specify i.e. remote work, rural, etc Remote work or 1600 McConnor Parkway, Schaumburg, IL What are the work hours? (ex. 9am-5pm, day/night shifts, rotating shifts, etc) This is a software engineering position, after hour deployments will be needed on a rotational basis. What does the interview process look like? How many rounds? Maximum 2, possibly 1 depending on interviewer availability Video vs. phone? One of the rounds should be video How technical will the interviews be? Since this is a Senior Data Engineer position, there will be more technical questions/conversations in round 1 but this is not the only deciding criteria. Required Skills : Basic Qualification : Additional Skills : Background Check :Yes Drug Screen :Yes Candidate must be your W2 Employee :No Interview Process : Additional Keywords : Degree Requirements : Certification Requirement : Minimum Experience (In Years) :0 Travel Requirements :