Job Description :

Responsibilities:

  • Work with technology team to deliver data projects, including development of new systems and migration of legacy workflows.
  • Develop and deploy ETL job workflow with reliable error/exception handling and rollback.
  • Develop and engineer processes for ensuring the integrity of all data asset.
  • Own critical data pipelines running in production environment.
  • Provide technical assistance in identifying, evaluating, and developing systems and procedures.
  • Working in close partnership with cross-functional teams across the organization to define business rules and cleansing requirements for the data transformation process.
  • Build and maintain metadata dictionaries to assist in the governance of metrics and flow of data between systems.

Skills:

  • Proficient in Spark, SQL, Unix Shell.
  • 3+ years experience in the development and management of ETL processes and data integration pipelines.
             

Similar Jobs you may be interested in ..