DKMRBH Inc.
Wilmington, DE
Post Resume to
View Contact Details &
Apply for Job
Job Description :

Position: Senior Data Engineer
Location - Los Angeles, CA
Duration: Full-Time
Salary: $160K-$180K.
Prefer Local L.A or Southern California candidates

What You'll Do/Responsibilities

  • Develop and maintain scalable data pipelines, including:
  • ETL pipelines, both single and multi-node solutions
  • Build data quality assurance steps for new and existing pipelines
  • Create derived datasets with augmented properties
  • Work on analytics ready datasets to power internal and creator facing tools
  • Troubleshoot issues when they arise, working directly with internal data consumers
  • Automate pipeline runs with scheduling and orchestration tools
  • Work with large scale datasets
  • Work with/use various external APIs to enhance data
  • Setup database tables for analytics users to consume the data collected by the Data Engineering team
  • Work with big data technologies to improve data availability and data quality in the cloud (AWS)
  • Mentor more junior members of the team

Who You Are/Required Qualifications

  • Bachelor's degree, preferably in Computer
  • Science or Computer Information Systems
  • 5+ years of software engineering experience
  • 3+ years of data engineering experience with Apache Spark or Apache Flink
  • 3+ years of experience running software and services in the cloud
  • Proficiency in working with DataFrame APIs (Pandas and Spark) for parallel and single node processing
  • Proficiency using advanced languages and techniques with Python, Scala, etc. with modern data optimized file formats such as Parquet and Avro
  • Proficiency with SQL on RDBMS and data warehouse solutions like Redshift

Additional Valued Skills

  • Experience with YouTube APIs
  • Experience with data acquisition from external APIs at large scale / in parallel processing
  • Experience with Data-Lake technologies
  • Experience with AWS Glue metastore
  • Experience with Data-Mesh approaches
  • Experience with data cataloging, data lineage and data governance tools.
Piyush Ranjan
Manager, Business Development & Service Delivery
             

Similar Jobs you may be interested in ..