Job Description :
Mandatory Skills :Python, some scala, Airflow, Spark, Hive, Parquet, running on EMR.

Job Description

· Develop and maintain custom, complex ETL pipelines written in Python, some scala, Airflow, Spark, Hive, Parquet, running on EMR.

· Migrate legacy data pipelines (SQL Server, SSIS, some RedShift) to newer technologies

Migrate data pipelines from a legacy clickstream technology