Job Description :
Job Role: Python/Spark Data Engineer
Location: Plano, TX & Richmond, VA
Duration Long Term contract/FTE
Required Skills,
At least 3 years of experience developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python
At least 2 years’ experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC etc
At least 3 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps
At least 3 years of experience with SQL and Shell Scripting experience
At least 2 years of experience with software design and must understand cross systems usage and impact
2+ years’ experience with Amazon Web Services (AWS), Microsoft Azure or another public cloud service