Position – Data Engineer
Required Education and Experience:
* Option 1: Bachelor’s degree + 5+ years experience
* Option 2: Master’s degree + 4+ years experience
* Option 3: Technical certifications + 8+ years experience
Required Technical Skills:
* 2-4 years of Python and SQL experience
* Development/delivery experience with AWS serverless services: S3, Cloudwatch, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM
* Background in data management, data engineering, or data operations
* Familiarity with ADO pipeline framework or CI/CD experience (Jenkins)
Key Responsibilities:
* Perform data-related tasks including data design, quality, triage, governance, and architecture using SQL, Snowflake, AWS
* Develop break/fix solutions and address root causes in data pipeline implementation/code (Python, AWS)
* Create scripts and automation tools to detect and correct data issues
* Build monitoring and alerting capabilities for proactive data issue detection
* Work on complex application/technical problem identification and resolution (including off-shift and weekend support)
* Collaborate with Operations teams (Tier 2/Tier 3 support) and internal technical teams
* Communicate with end users to guide development, debugging, and testing of application software
Disqualifiers/Red Flags:
* Inconsistent job history/frequent job hopping
* Candidates not local must be willing to relocate at their own expense and be onsite from day 1
* Proper hands-on experience is a hard requirement - candidates without this should not be submitted
Team & Environment
* Team Structure: New team working with Operations and internal technical teams
* Interaction Level: Liaise with designers, engineers, and support teams
* Work Environment: Hybrid office setting with potential for increased in-office days
Interview Process
* Rounds: 1 (virtual/phone panel interview)
* Potential 2nd round if needed
Candidate Value Proposition
* Opportunity to contribute to data operations efficiency and effectiveness
* Build meaningful solutions that impact Caterpillar’s global operations
* Collaborate with industry experts and grow through various development opportunities
* Work on ground-breaking products and best-in-class solutions