Job Description :
Hi,
This is Siva from USG. I hope you are doing great. We have an urgent requirement with one of our client for a Data Engineer. Please go through the requirement and get back to me ASAP.

Role: Data Engineer

Location: TCS - San Francisco, CA

Duration (Months): 12

Experience (Years): 6-8

RESPONSIBILITIES:

The Data Engineer will be responsible for building, maintaining data pipelines and data products to ingest, process large volume of structured / unstructured data from various sources.
The Data engineer will work on analyzing the data needs, migrating the data into an Enterprise data lake, build data products and reports.
The role requires experience with building real time and batch based ETL pipelines with strong understanding of big data technologies and distributed processing frameworks with.

Skill Needs

Python, Scala , IoT, MQTT, Kafka, Spark, Airflow, Presto, Parquet, S3, Kubernetes, AWS, CI/CD Airflow, Presto

SUPERVISOR