Key Skills to evaluate – Ability to write complex SQL queries, DB query tuning questions, strategy/process to optimize large data volume processing time, ETL
Skill and Experience Required
· Experience in consuming large data volume
· Advance SQL skills
· Optimize strategy process for data handling for aggregation tables (Minimize processing time for large data volume)
· Experience in data loading with complex model for data and batch orchestration
· Throughput understanding, monitoring for efficient data loading
· Identifying bottlenecks and resource investigation
· Experience in periodic ETL Code maintenance and setting up SLA for cross functional team
· Implementing necessary techniques to improve ETL performance in Both DB and Application
· Improving query performance by turning ad re-evaluating data model
· Identifying dependency impact on both data and Application
Duties and responsibilities
· Performance Analysis and documenting factors (bottleneck, memory handling and inefficiency area which needs improvement)
· Identifying and documenting execution Benchmarks and Metrics
· Optimization on application and database
· Validation techniques for data and Orchestration
· Documentation for Optimization and Operations
· Implementation Alert mechanism in case of potential impact to downstream
· Collecting and documenting the Metrics for each ETL application