Job Description :
Position:Azure Data Engineer
Location:Boston MA
Duration:6+ Months
What you will do:
Work collaboratively and communicate effectively with a motivated team of data scientists, product managers, and IT partners.
Develop a deep understanding of vast data sources (structured and unstructured) and be able to actively recommend exactly how, when, and which data should be used to tackle a particular business problem.
Design efficient and standardized data structures, and database schemas
Develop code (Python, R, SQL, etc to take data from various data streams, data lakes, and supporting data sources and craft a unified dimensional or star schema data model for ML, analytics, and reporting
Maintain back-end services
Experiment with and recommend new technologies that simplify or improve the tech stack
Continuously evaluate our processes and reporting to identify opportunities to improve, enhance, and automate existing and new deliverables
Basic qualifications:
BS/MS in Computer Science or a related technical field
4 or more years of experience architecting, building and maintaining end-to-end, high-throughput data systems and their supporting services in Azure
3 or more years of experience designing data systems particularly in Python, as well as their support infrastructure (shell scripts, job schedulers, message queues, etc.
3 or more years designing data structures, database schemas and working with distributed systems architecture
2 or years incorporating data processing workflows into pipeline design
Technologies/Tools:
Azure Cloud Ecosystem (data bricks, synapse, function, data lake)
SQL Server
Excel, Tableau