Job Description :
Title: Data Engineer Duration: 6 Months + Location: Richmond Virginia Job Description Sr. Data Engineer (Spark, Python, and AWS) The Finance Technology team at Capital One is searching for innovative and analytical Data Engineers to join our team. Our data engineers are multilinguists who can speak the languages of how we operate as a business, how that business impacts our financials, and the latest technologies that are reshaping our Finance Tech landscape. In this role, you will be responsible for building data pipelines & frameworks using open source tools on public Cloud platforms. The right candidate for this role is someone who is passionate about technology, interacts with product owners and technical stakeholders, thrives under pressure, and is hyper-focused on delivering exceptional results with good teamwork skills. You'll bring solid experience in emerging and cutting-edge technologies such as: Spark, Scala/Java/Python, Python, REST, JSON, NoSQL databases, relational databases, Jenkins/Maven, and AWS/Cloud Infrastructure to name a few. Responsibilities: Provide technical guidance concerning business implications of application development projects Leverage ETL programming skills in open source languages including Python, Scala, and SQL on various frameworks especially Apache Spark Deploy DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test-Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Nexus, GitHub, and Docker Experience with Cloud computing, preferably AWS and its services including S3, EMR/EC2 and Lambda functions Manage multiple responsibilities in an unstructured environment where you're empowered to make a difference. In that context, you will be expected to research and develop cutting edge technologies to accomplish your goals Must have a firm understanding of delivering large-scale data sets solutions and SDLC best practices Basic Qualifications: Bachelor's degree At least 3 years of experience delivering data solutions using open-source languages At least 3 years managing people & teams At least 3 years of experience utilizing scripting languages At least 4 years of experience developing ETL solutions At least 4 years of experience utilizing SQL in data solutions Preferred Qualifications: 3+ years of experience delivering data solutions using open-source languages 5+ years of experience utilizing SQL in complex data solutions 3+ years of experience utilizing scripting languages 5+ years of experience developing ETL solutions 5+ years of experience utilizing SQL in complex solutions 2+ years of experience developing, deploying, testing in AWS public cloud AWS certification