Job Description :
Airflow Data Engineer
Wilmington, DE
We are looking for Data Engineers to join our team and help us with building platforms/features for our tech partners, data analysts and data scientists. The DE will be responsible for supporting the existing capabilities, enhancing and building new capabilities.
The candidate should be able to quickly learn and adapt to new technologies as the work demands.
We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have working experience using the following
Strong Python is a must. Should have at least mid-level experience with building/deploying applications to Kubernetes. Able to troubleshoot and debug using logs/events in Kubernetes.
Technology/Skills:
Programming/Scripting: Python, Shell scripting, Groovy(good to have) Golang(good to have)
Cloud: AWS (EC2, EMR, Lamda, IAM, EFS, EBS etc,
Data Streaming/Processing: Kinesis/Kafka/SQS, Spark
CICD: Jenkins, GitHub/Bitbucket,
Container Technologies: Docker, Kubernetes
Configuration Management/Orchestration: Ansible, Chef, AWS CloudFormation
Experience with Airflow, Restful API is required.