Job Description :
Job Title: Azure Data Engineer
Location: Lake Oswego, OR
Duration: 6 month contract (highly likely to extend)
Interview: Phone/Skype
Client: Greenbrier Management Services LLC
Manager Note: Python, Azure and Spark/Data Bricks experience are most important.
Job Description:
The Data Engineer will be a leading member of a small data team being assembled to modernize our data ingestion and railcar event processing. You will be responsible for the design, development, testing and maintenance of our data assets for the division. You should be very skilled in both SQL and NoSQL data stores. You should be passionate about data modeling and data quality to properly prepare data for both transactional and analytics systems.
Primary Responsibilities
Architect, lead, design, develop and deliver medium to large scale Azure data systems, data processing, and data transformation projectsprimarily in a Microsoft Azure Cloud environment.
Design and advocate solutions using cloud technologies, design principles, integration points, and automation methods.
Create reliable, fault-tolerant data pipelines.
Identify data quality issues and appropriate actions.
Mentor and share knowledge with customers as well as build prototypes when applicable.
Provide weekly written status reports to management.
Possible travel to remote offices or client sites may be required.
Other duties as assigned.
Professional Experience and Qualifications
BA or BS in Business, Information Systems, Mathematics or equivalent combination of skills, experience and education.
Experience with data modeling, table design, mapping business needs to data structures and ETL/ELT development.
Demonstrated experience designing, implementing, and supporting enterprise-greade technical solution in the cloud for meeting complex business data requirements.
2+ years experience with Python / JSON concepts
Experience with Microsoft Azure: Azure Data factory, Data bricks (or Spark), Logic Apps, and Event Hub / Grid.
Exhibits a high degree of professionalism, poise and tact.
Advanced experience with SQL.
A self-starter with the ability to mentor mid to senior level development professionals lacking significant cloud experience.
Experience, knowledge, or ability in these areas a plus
Data access layer APIs preferably using Azure Functions.
Azure API Management.
Experience with Azure Data Gateway, various Azure storage options, Event Hubs and / or event Grids, and Service Bus.
Azure DevOps experience.
Any knowledge of railcar fleet management or railcar transportation a plus.
Personal Attributes
Strong, innovative approach to problem solving and passionate about data.
Ability to work independently with minimal supervision as well as in a team environment.
Sound judgement and decision-making with the appropriate sense of urgency.