Job Description :
Software Specialist - Level 3 Toronto, ON Contract Must-haves: Azure Data Factory Deliverables: The Services and Deliverables to be provided by the Vendor will include the following: Analyze requirements/specifications, architectural/system design documents Implement solution primarily using Azure Data Factory (ADF) pipeline and stored procedure to populate enterprise data warehouse Develop Azure CI/CD pipeline to automate ADF release Implement complex data conversion, e.g., binary to character, EBCDIC to UTF Implement complex data transformation(s) for derived and calculated values Integrate data sets from diverse source systems Implement ADF for initial data load and incremental load Promote ADF ETL/ELT through all Ministry environments including: Development, Integration Testing, QA, UAT, Production Debug ADF pipeline and stored procedure to investigate and fix defects Actively participate, support and provide feedback to project team during design/development/testing/implementation phase Produce supporting documentation Optimize performance of ADF pipeline, and Azure SQL and Synapse databases Monitor application functionality and performance on a daily basis Provide effective knowledge transfer to Ministry staff at all stages of this assignment Skill Set Requirements: Skills and Experience: Extensive experience with data warehouse design, fact/dimension tables, star/snowflake schema Extensive knowledge of Azure SQL DB and Synapse platforms, including: Performance tuning on large data volumes Extensive experience with Azure Data Factory, including: Self-Hosted Integration Runtime Data movement, ETL pipelines Performance tuning on large data volumes Complex data transformations ADF Debugger to validate data transformation Azure Roles Experience with CI/CD (DevOps) pipelines and concepts, including: Azure Resource Management GitHub Repo Source code version control Branching, pull requests, build, release, merging pipeline across multiple parallel development repositories