Job Description :
Responsibilities/What they will be doing
Designing and loading of new data warehouses efficiently from new data lake platform.
Responsible for data validation, data cleansing, and data transformation, as well as writing and scheduling complex ETL jobs.
Analyzing and understanding the data transformation rules required to extract and transform and load the new Data Lake and the downstream Client Data Warehouses or BI solutions
Official Job Description
The Senior ETL Designer is responsible for the designing and loading of new data warehouses efficiently from our new data lake platform. You will be responsible for data validation, data cleansing, and data transformation, as well as writing and scheduling complex ETL jobs. Your role includes analyzing and understanding the data transformation rules required to extract and transform and load the new Data Lake and the downstream Client Data Warehouses or BI solutions. Experience with Pentaho Kettle is required. Experience with Amazon Glue is a major plus.
In this role you will:
Perform complex ETL coding using Pentaho Kettle or Amazon Glue, database programming using MySQL, DB2 or MariaDB and batch scheduling and scripting tools.
Perform build, test and deploy. Utilizes advanced technologies and methods to integrate data systems and other existing platforms such as AWS EMR, S3 and Elasticsearch.
Design and build system components which reconcile and audit the results of the extract/transform or conversion of data from source systems to the target application.
Define and manage the data load procedures; facilitate the change data capture.
In addition to developing new mappings / ETL jobs, you will also be responsible for automation, monitoring and supporting mappings, and re-designing if required to make them run faster and more reliable.
Provide analysis and issue resolution on business reported concerns.
Participate in design and delivery of cubes, dashboards and various self-service business intelligence solutions.
Using various resources, continually learns, studies, and applies new information in fast paced, dynamic technical environment.
EDUCATION AND/OR CERTIFICATION, SKILLS AND LICENSING
Associate or Bachelor’s Degree in Computer Science, MIS, or four-year related degree, and/or equivalent work related experience.
Ten or more years of progressively complex programming/analysis experience.
Successful record in design and implementation of complex, multi-programming projects.
Proven successful technical leadership, consultative application of technical and management principles to others, and design skills.
Strong analysis and design skill
Strong experience with Kimball Dimensional modeling
Strong experience with business intelligence and data warehousing design principles and industry best practices.
Proven successful technical leadership, consultative application of technical and management principles to others, and design skills.
Excellent written, verbal, and presentation skills.
Demonstrated ability to conduct and lead meetings to identify/present technical solutions to an audience of business partners, client personnel, technical team members, and executive management.
Successful performance of providing consulting assistance to business and technical communities.
Experience prioritizing and completing long/short term projects with little supervision.
Experience documenting procedures for solving business problems.
If travel is required, has access to transportation requiring a valid driver’s license, proof of safe driving record and active insurance.