Job Description :
Position: AWS Data lake Engineer
Location: Wilmington, DE
Duration: Long term
End Client: CSC Global
Implementation Partner: Innova Solutions
Job Insight:
Hands-on Tech lead / Delivery Manager responsible for designing a large Datalake, managing data flows that integrate information from various sources into a common pool implementing data pipelines based on the ETL model. Strong Tech lead in Development, problem-solving skills, and algorithms.
Responsibilities:
Lead the Data Cloud development effort focusing on scalability, quality and performance
Manage a team of data engineers located both on and off shore
Serve as the organization s expert on SDC platform technologies and architecture
Design efficient, scalable processes to acquire, manipulate and project data
Participate actively in all facets of the Agile process
Contribute to the SDC codebase directly by taking on development tasks
Required Skills:
Experience implementing a data lake architecture, enterprise data solutions
Experience with AWS Kinesis, Kafka, Storm, Spark.
Extensive experience with AWS data services: Redshift, RDS, DynamoDB, Data Pipeline, EMR.
Extensive experience writing and tuning SQL queries
5+ years using ETL / data movement tools (Glue)
2+ years programming in one or more languages (Python, Java, Scala, C/C++)
2+ years experience with NoSQL data platforms
Experience with Agile process methodology, CI/CD automation, Test Driven Development.