Core skill set and technical priorities for the role:
- Strong foundation with developing ETL pipelines, Apache NIFI experience preferred (since it's the current ETL tool we leverage), Python scripting, Mongo & MSSQL querying skills must have.
- Candidate should have experience in end-to-end implementation of data pipelines, ingesting from various locations (kafka topics, SQL, Mongo databases, SFTP locations) , data transformation in pipeline, JOLT transformation of JSON payloads, and writing to SQL/Mongo databases.
- Candidate should have enough experience to be able to handle direct stake holder, and business communication and help business take informed decisions about changing data requirements/needs with an eye on the future.
- We want someone who can come in and hit the ground running, with little turn-around time in learning the tools. Expectation is to have them analyze current ETL flows setup and advise on improvements/enhancement to current setup; and how to migrate to maybe a Python-based ETL setup.
Role Overview:
We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable ETL pipelines and data integration solutions. The ideal candidate will bring strong technical expertise in data engineering tools, hands-on experience with Apache NiFi, Python, SQL, and MongoDB, and the ability to drive improvements in data pipeline performance and architecture. This role requires both technical depth and strong stakeholder communication skills to align business needs with evolving data requirements.
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.