Job Description :
Role : Big Data Engineer
Location: Detroit, MI
Contract
Zoom and In-person ( Client expenses paid)
Strong Experience with Scala, Spark, Hive is must
Job Description:
Data Engineer will be part of the Data Supply Chain. Big Data Engineer will be responsible for designing & developing data ingestion and data transformation framework for modern data lake solutions. Will be working with structured/unstructured Data sets, building large scale Data processing platforms, implementing world class data governance and operational controls, solving complex performance challenges.
· Experience working with big data tools: Spark and some expertise with Hadoop
· Experience working with object-oriented/object function scripting languages: Scala, Python etc.
· Should have previous experience in developing complex SQL scripts for data analysis and extraction, developing and maintaining programs as required for the ETL process
· Experience in supporting ETL, production data operations (File processing, data distribution etc.,) including debugging, addressing production issues and performing Root Cause Analysis.