Job Description :
Job Title : Data Engineer
Location : San Francisco, CA
Job Type:- Contract(W2) and(C2C) | Duration :-8 Month’s Of Project

Responsibilities and Duties:-
Data Engineer with advanced Python skills and NumPy. Someone who can use Python scripts to pull data from Hive tables and has the ability to do analysis
The consultant will Develop and maintain custom, complex ETL pipelines written in Python, some Airflow, Spark, Hive. Migrate legacy data pipelines (Oracle Server, some RedShift) to newer technologies Migrate data pipelines from a legacy systems

Requirements/Experience:-
Programming in Python
NumPy, Airflow
Big Data experience, such as Hadoop, Hive, Spark
Experience working with large pools of data, especially Finance Data
AWS

Client : Progressive Staffing