Data Engineer Level 3
Remote candidates will be considered
Job Description
Top 3 Skills: Data Manipulation(DBX, Spark, Sql)
Current team is small, project is large and there is lots of data acquisition, understand and modeling needed to help get data from source systems into the Supply Chain Data Estate(lake). Team is leveraging all Cloud based tools in Azure today. Overall objective is to continue to hydrate data for our business partners to leverage to help drive supply chain operations and planning.
We’re looking for individuals who can bring their core set of knowledge as well as learn new tools to provide new data and capabilities to support Client's ever growing Supply Chain.
Accountable for developing and delivering technological responses to targeted business outcomes.
Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for Supply Chain and the overall enterprise.
Key Responsibilities
Create and leverage Databricks notebooks to source, shape and store data using SQL, Python, PySpark
Utilize enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses.
Define high-level migration plans to address the gaps between the current and future state
Analyze technology environments to detect critical deficiencies and recommend solutions for improvement
Promote the reuse of data assets, including the management of the data catalog for reference