Job Description :
Role: Cloud Data Engineer
Location: Chicago, IL
Duration: 6 Months+
Client: Capgemini
JD:
Minimum 10+ years of experience in Data Platform where 5+ years of experience in Cloud Data Engineering Experience including
Hands on experience in implementing Data Lake and AWS Cloud DATA and Enterprise Data Warehouse Solutions
Providing Solutions for Big Data Platform infrastructure for across AWS VPC
Understand GDPR laws
Architect and standardize the way data is ingested, processed and exported
Expertise working with AWS and Other Cloud infrastructure:
o Networking (e.g. VPC, PrivateLink)
o Compute (e.g. EC2, ECS, EKS, Lambda)
o Storage (e.g. S3, RDS)
Strong Database knowledge in Cloud based Database like RedShift, Snowflake etc
Monitoring (CloudWatch, and ideally commercial solutions like DataDog, Splunk, PagerDuty)
Identity Management & Security (e.g. IAM, GuardDuty, Macie)
Understanding on Real Time Data Streaming Technologies like Spark, DataStack
Significant experience with Linux / Unix systems
Significant understanding with:
o Big Data on AWS (e.g. Kinesis, Firehose, EMR, Glue
o Administration of Spark, Hive, Presto, Airflow in the Cloud
o Infrastructure-as-code (Terraform preferred)
Basic hands-on proficiency in SQL and a scripting language like bash or Python
Excellent communication, written, and documentation skills
Self-driven and learning individual