Job Description :
Job Title : Data Engineer
Location : San Francisco, CA
Job Type:- Contract(W2) and(C2C) | Duration :-8 Month’s Of Project
Responsibilities and Duties:-
Data Engineer with advanced Python skills and NumPy. Someone who can use Python scripts to pull data from Hive tables and has the ability to do analysis
The consultant will Develop and maintain custom, complex ETL pipelines written in Python, some Airflow, Spark, Hive. Migrate legacy data pipelines (Oracle Server, some RedShift) to newer technologies Migrate data pipelines from a legacy systems
Requirements/Experience:-
Programming in Python
NumPy, Airflow
Big Data experience, such as Hadoop, Hive, Spark
Experience working with large pools of data, especially Finance Data
AWS