Position: Senior Data Quality Specialist (Collibra/Owl DQ)
Location: Manhattan, NY - 3 Days Onsite
Duration: Long Term
Mandatory skill: 1. Collibra/Owl DQ 2. Data engineering
Additional skills: 1. API development with Spring boot
Description: We are seeing a Senior Data Engineer contractor with expertise in data quality and database management. The ideal candidate will have a strong background in data engineering, particularly with Azure technologies and will be responsible for ensuring the integrity and quality of our data assets.
Design, develop, and maintain data pipelines using Azure Data Factory and Databricks to support data integration and transformation processes.
Administer and manage database and application servers, ensuring optimal performance and security.
Implement and monitor data quality frameworks to ensure accuracy, completeness, and reliability of data across the organization.
Collaborate with cross-functional teams to understand data requirements and provide data solutions that meet business needs.
Support the integration of Collibra for data governance and stewardship, ensuring compliance with data management policies
Qualifications
8+ years of experience in data engineering, specifically with Azure Data Factory and Databricks.
Database/Application Server Administration
Data Quality Experience (Collibra/Owl DQ)
Hadoop Administration
Data Engineering on Azure (Azure Data Factory and Databricks)
Understanding of Collibra
Knowledge of Postgres and REST APIs