Job Description :

Job Title: Senior Data Engineer (Pyspark / Google Cloud Platform)

Location: Chicago IL

Duration: 1 year

Certification(s) Required: Python, GCP

Summary:

  • Design low level implementation plan for all Python/Spark coding modules
  • Develop framework including data extraction, ingestion, audit control, error, archival
  • Develop code using GCP native or Python/Spark solutions and perform unit testing
  • Design test strategy for data validation, execute test cases to ensure no data leakage
  • Work closely with GCP Architect, leads and other developers to implement the best practices
  • Develop required documentations including technical specification, low level design document
  • Fix and resolve the defects during testing cycles
  • Understand data models, mapping documents for guiding the testing team follow best practices in coding, unit testing and documentation

Roles & Responsibilities:

  • Develop and test framework including data extraction, ingestion, audit control, error, archival
  • Develop code using GCP native or Python/Spark solutions
  • Execute unit test cases to ensure no defect leakage
             

Similar Jobs you may be interested in ..