Position: Big Data Engineer
Location: Richmond, VA
Job Description:
Data Engineer - L3 (Manager) Manager: Spark / Python / Bigdata / Redshift / DevOps: - 5+ years of working experience in Spark and Python programming - 5+ years of working experience in Bigdata technology and tools - 3+ years of working experiecne in Snowflake - 5+ years of working experience in DevOps CICD - 5+ years of experience in Flink and RedShift - 5+ years of working experience in AWS services like EC2 / EMR / Lambda / Cloudwatch / CFT / ELB etc - Should have got working experiecne in Docker containers and experience in solutioning using docker - Should be able to understand client requirements - Must posesses very good knowledge in SQL and UNIX shell scripting - Requirement gathering and converting into Technical specification document - Expertise in Developing multi-tier enterprise applications using IOT - Creation of jobs for scheduling the batches - Develop high volume transaction processing solutions - Should be able to troubleshoot technical issues quickly and suggest fixes - Should have good analytical skills - Should be an individual contributor to the project - Should have effective communication skills - Should be able to provide technical guidance to team and ensure tasks are closed on-time - Should be able to run a medim sized ( 5 - 7 members) project team independently - Should have expert understanding on Agile methodology and flag risks / mitigations on time to the client