Job Description :

Role 2 : GCP Data Engineer

Location: Fort Worth, TX

Client: Ford

Duration: Long Term

Job Description
We're looking for a dynamic data engineer with Apache Spark and AWS experience to join the product development team at Client. You will have the opportunity to work as part of a cross-functional team to define, design and deploy frameworks for data collection, normalization, transformation, storage and reporting on AWS to support the analytic missions of Client and its clients.
Essential Job Functions
Design, develop and deploy data pipelines including ETL-processes for getting, processing and delivering data using Apache Spark Framework.
Monitor, manage, validate and test data extraction, movement, transformation, loading, normalization, cleansing and updating processes. Build complex databases that are useful, accessible, safe and secure.
Coordinates with users to understand data needs and delivery of data with a focus on data quality, data reuse, consistency, security, and regulatory compliance.
Collaborate with team-members on data models and schemas in our data warehouse.
Collaborate with team-members on documenting source-to-target mapping.
Conceptualize and visualize data frameworks
Communicate effectively with various internal and external stakeholders.
Basic Qualifications
Bachelor's degree or equivalent combination of education and experience
Bachelor's degree in computer sciences or related field preferred
5 or more years of relevant experience or equivalent education in ETL Processing/data architecture or equivalent.
2+ years of experience working with big data technologies on AWS such as S3/Glue/EMR/RedShift
2+ years of experience in the Apache Spark/DataBricks framework (Python/Scala)
Experience working with different between database structures (e.g., transaction based vs. data warehouse)
Other Qualifications
Strong communication skills
Ability to be a high-impact player on multiple simultaneous engagements
Work Environment
Client or office environment / may work remotely
Occasional evening and weekend work

             

Similar Jobs you may be interested in ..