Job Description :
Data Engineer W/Python
Irvine, CA
6+ Months
Strong Python skills (must have)
Data background (Sql, Pl/Sql, ETL background)
Ideally, some Big Data and Cloud experience (Azure/AWS/GCP)
Job Description:
Experienced Data Engineer with the ability to work hands-on writing python /Pyspark code.
Must have strong hands on experience in Hadoop and NoSQL.
Experience in building complex distributed modern data platforms
Project experience in designing or migrating existing systems using technologies such as: Hadoop, HDInsight, Spark, Hive, Pig, Sqoop, HDFS
Guide in development & support of innovative solutions for a Data Warehouse projects for all consumed applications internally.
Design, construct, and manage the data lake environment including: data ingestion, staging, data quality monitoring, and business modeling.
Drive the collection, cleansing, processing, and analysis of new and existing data sources, including the oversight for defining and reporting data quality and consistency metrics.
Experience with scripting, preferably Python
Experience with Azure IaaS and PaaS services a plus
Openness to travel and work at client offices
Bachelor’s degree in Computer Science or related field