Job Title: Sr Data Engineer
Term: 12+ months contract
Location: Must be located at one of the hubs: Sunnyvale, CA| Dallas, TX| Bentonville, AR |Atlanta, GA
• 5 -7 years of Big data development experience
• 2 -3 Years of Experience in GCP/Azure cloud platforms
• 2 -3 years of experience building streaming pipeline using spark streaming or similar.
• Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development
• Architect, Design, develop, implement and tune distributed data processing pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
• Exposure to Data Governance ( Data Quality, Metadata Management, Security, etc.)
• Experience with Java, Scala and/or Python to write data pipelines and data processing layers
• Demonstrates expertise in writing complex, highly-optimized queries across large data sets
• Proven working expertise with Big Data Technologies Spark Scala/PySpark, and SQL
• Knowledge and experience in Kafka, Storm, Druid and Presto