Job Summary
We are seeking a highly skilled Senior Data Engineer with strong expertise in AWS cloud services, Python, and PySpark to join our team in Columbus, OH. The ideal candidate will design, build, and optimize scalable data pipelines, ensuring high data quality, performance, and reliability. This role requires hands-on technical expertise, strong problem-solving skills, and the ability to collaborate across business and technology teams.
Key Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using AWS services (Glue, EMR, Redshift, S3, Athena, Lambda, Step Functions).
- Develop and optimize large-scale data processing workflows using Python and PySpark.
- Collaborate with business stakeholders to translate data requirements into scalable technical solutions.
- Work on data ingestion, cleansing, transformation, and integration from multiple sources into AWS-based data lakes and warehouses.
- Implement and enforce data governance, security, and compliance standards.
- Troubleshoot and optimize performance issues across pipelines and distributed data systems.
- Support analytics, BI, and data science teams with reliable, high-quality data.
- Lead peer reviews, provide technical guidance, and mentor junior engineers.
- Participate in Agile ceremonies, providing technical input for sprint planning and backlog grooming.
Required Qualifications
- 10+ years of professional experience as a Data Engineer.
- Strong hands-on expertise in AWS Data Services: Glue, EMR, Redshift, Athena, S3, Lambda, Step Functions, CloudWatch.
- Proficiency in Python and PySpark for ETL, transformation, and automation.
- Strong experience in SQL and data modeling (star schema, snowflake schema, dimensional models).
- Experience building scalable, high-performance data pipelines in cloud environments.
- Knowledge of data governance, data quality frameworks, and security best practices.
- Excellent communication and problem-solving skills.
Preferred Qualifications
- Experience in the automotive or manufacturing domain.
- AWS Certified Data Analytics – Specialty or Solutions Architect certification.
- Familiarity with DevOps/CI-CD practices for data pipelines (CodePipeline, Jenkins, GitHub Actions).
- Exposure to BI tools such as Tableau, Power BI, or QuickSight.
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.