Job Description :
Title: : Data Engineer (Python/Pyspark)


Location: Carlsbad, CA


Education: BS degree in CS, CE or EE.


Required Experience/Skills:


- At least 4 years working experience in data integration and pipeline development


- 2+ years of Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda


- Working on S3, Redshift, RDS, MongoDB/DynamoDB ecosystems


- Strong real-life experience in python development especially in PySpark in AWS Cloud environment.


- Design, develop test, deploy, maintain and improve data integration pipeline.


- Experience in Python and common python libraries.


- Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.


- Databricks, Redshift Experience is a plus.


 - Experience with ETL, data pipeline creation to load data from multiple data sources.


 

Client : Persistent Systems