Job Description :
Mandatory Skills :Python, some scala, Airflow, Spark, Hive, Parquet, running on EMR.
Job Description
· Develop and maintain custom, complex ETL pipelines written in Python, some scala, Airflow, Spark, Hive, Parquet, running on EMR.
· Migrate legacy data pipelines (SQL Server, SSIS, some RedShift) to newer technologies
Migrate data pipelines from a legacy clickstream technology