Job Description :

Title: Data QA Engineer

Location: San Jose, CA

Type: Full TIme

Education: Bachelor's or Master's degree in Computer Science or related field such as Mathematics and Statistics, preferably with focus on data analytics.

Required Experience/Skills:

- 3+ years of experience in data integration / data engineering

- 3+ years of experience in data modeling and architecture

- 3+ years of experience in QA automation

- Experience in working with large scale Enterprise data warehouse, data integration, data migration and data quality verification

- Hands-on testing experience in working Hadoop, Spark and other Big data technologies is highly preferred

- Knowledge of data pipelines using SQL, Hive, Spark, Spark ML

- Excellent analytics, problem-solving and debugging skills

Role and Responsibilities:

- Design and implement Test Automation frameworks using Python, node.js, SQL, javascript and React JS.

- Develop test strategies, plans, test cases and engineering best practices related to software test engineering, both manual and automated testing with a specific focus on data quality

- Work closely with data engineers, data scientists and analysts to inform solution designs in terms of testability.

- Building and automating testing frameworks around data ingestion pipelines for master data management, deep-learning, and predictive analytics

- Build and maintain testing frameworks for big data environments that are highly secure, scalable, flexible, and performant using appropriate SQL technologies.

- Lead data governance and data profiling efforts to ensure data quality and proper meta data documentation for data lineage.

- Creating quality metrics to evaluate data pipelines, products and customer deliverables.

- Collaborate with diverse technical and non-technical teams located across multiple time-zones on client deliverables and technical support

- Participate-in and contribute to design and code reviews

             

Similar Jobs you may be interested in ..