Data Engineer – Python Spark Engineer Location: Richmond – VASkill Description Big Data SparkSQL Python
Data Engineer –
• Spark / Python / Bigdata / Redshift / DevOps: - • 5+ years of working experience in Spark and Python programming • 5+ years of working experience in Bigdata technology and tools - 3+ years of working experiecne in Snowflake • 5+ years of working experience in DevOps CICD - 5+ years of experience in Flink and RedShift • 5+ years of working experience in AWS services like EC2 / EMR / Lambda / Cloudwatch / CFT / ELB etc.• Should have got working experiecne in Docker containers and experience in solutioning using docker • Should be able to understand client requirements - Must posesses very good knowledge in SQL and UNIX shell scripting • Requirement gathering and converting into Technical specification document • Expertise in Developing multi-tier enterprise applications using IOT • Creation of jobs for scheduling the batches - Develop high volume transaction processing solutions • Should be able to troubleshoot technical issues quickly and suggest fixes• Should have good analytical skills - Should be an individual contributor to the project • Should have effective communication skills• Should be able to provide technical guidance to team and ensure tasks are closed on-time • Should be able to run a medim sized ( 5 - 7 members) project team independently • Should have expert understanding on Agile methodology and flag risks / mitigations on time to the client