Job Description :
Position: Lead Data Engineer
Location: Houston, TX
Duration: 6+ months
Minimum Qualifications:
6+ years experience working directly with subject matter experts in both business and technology domains
6+ years’ experience with a modern programming language (java or python preferred)
2+ years experience with Apache Beam excecuted on Apex, Flink, Spark, or Google Dataflow
2+ years experience as a team lead
Hands-on experience with a cloud based data ecosystem; either Google BigQuery & Dataflow or AWS Redshift & Data Pipeline
Nice-to-have:
Familiarity with Agile methodologies
Experience with Spark dataframes, SparkSQL, Kafka, KSQL, real-time streaming, and message bus technologies
Experience with data science technologies such as SAS, R, Matlab, or similar
Experience with data warehousing and dimensional modeling