Job Description :
Role: Cloud Data Engineer -NOT DevOps Engineer
Location: Baltimore, MD
Duration: 6+ months , up to 2 yrs
Interview : Phone then F2F but Skype possible for right candidate
Client is looking for a Cloud Data Engineer/Developer in Downtown Baltimore. This is not a traditional DevOps role, they are not looking for a DevOps Engineer.
They’re looking for a true Data Engineer that can develop the Data Pipelines in an AWS environment.
A main component to this role is to build/develop the data pipeline, not just the infrastructure around it.
When you are screening candidates, please be sure to identify this specific experience of building/developing data pipelines
Core Attributes & Skills
Takes pride in engineering excellence and instills these values within the team.
Participates in the design of effective engineering processes.
Proponent of strong collaborative software engineering techniques and methods.
Demonstrated ability to employ fact-based decision making to resolve complex problems.
Possesses a passion for technology and staying sharp in the craft by keeping on top of new technologies, tools and trends.
Has excellent problem solving and critical thinking skills.
Practical Experience in the following areas:
o Working in an Agile (Scrum) environment.
o CI/CD technologies and practices.
o Test Driven Development.
o Engineering highly scalable distributed data pipelines using AWS Native or Open Source technologies
o Working with multiple data persistence technologies – Row Based, Column Based, NoSQL – e.g. MySQL, SQL Server, Redshift, Snowflake, DynamoDB
o Working with multiple programming languages – Python, Scala, Java
o Working with a variety of file formats – e.g. JSON, XML, Parquet, Avro, ORC
o Solutions with a focus on Serverless technology
o Containers & Orchestration – Docker, Kubernetes
o Various data integration patterns – scheduled batch, micro-batch, event-based, streaming o Cloud Based Data Integration & Orchestration Technologies – e.g. AWS Glue, AWS Step Functions, AWS Lambda, AWS SQS, AWS SNS, Kinesis, etc.
o Expert Level SQL
o Data Conversion and Migration.