Job Description :
Hi,
LOCAL CANDIDATES ONLY
DETAILS: Data Engineer (BI team)
Location - Rosemont, IL 60018 (right by O''Hare)
Term: 6 months contract only. Opportunity to be extended.
job description:
Position Summary:
The Data Engineer is responsible for designing, developing, and supporting next generation data management solutions. The position will also assist with data modelling, analysis, constructing technical designs, developing data integration solutions, collaborating with team members and business stakeholders, and supporting existing ETL applications. This position will also lead and coordinate the work activities of offshore development and support resources.
People or Process Management Responsibility: Works on multiple, complex projects as technical lead and coordinates the work of other technical ETL resources.
Position Responsibilities may include, but not limited to:
Responsible for the design, development, and support of data management applications
Assist with data analysis
Provide off-hour/weekend ETL support (on a rotating basis)
Providing guidance and direction to offshore ETL support/development resources
Collaborate with cross functional teams such as Infra, Support, DBA and Business team
Assist with task identification and effort estimates for ETL development
Assist with risk and issue identification
Other duties as assigned
Minimum Requirements:
4 year degree in Computer Science, Information Systems, or in a related discipline
7+ years of relevant data engineering/movement work experience
At least 4 years of ETL application development experience
At least 2 years of ETL design experience
Experience with one of the ETL tools - Cognos Decision Stream/MS SSIS
At least 1 year of experience leveraging Cloud Services (IaaS, PaaS)
At least 1 years of Hands-on experience developing data management solutions using HDF (Hortonworks Data Flow – NIFI, Kafka, Storm) and HDP (Hortonworks Data Platform - Apache Spark, Java, Hadoop)
At least 1-3 years of designing/developing solutions using Avro and JSONformats
At least 1-3 years of developing solutions using Red Hat Linux and Windows Server OS
At least 1 year working experience with Restful web services, code development, deployment, versioning, and build tools (eg, Eclipse, git, svn, maven, Jenkins)
At least 1-2 years of designing/developing orchestration solutions using tools such as Apache Airflow or Orchestrator
Proficiency in scripting languages such as Shell/Python/Scala
Experience with development of metadata-driven and fully parameterized data processing tools
Skilled with data integration issues and integration patterns
Excellent SQL skills
Strong understanding of Dimensional Modeling techniques
Experience leading other developers
Strong written and verbal communication skills
Strong problem solving and analytical skills
Strong understanding of SDLC best practices with an emphasis on DW/BI practices
This position must pass a post-offer background and drug test
Preferred:
Microsoft Azure experience (Azure SQL Server DW)
HDP Certification
Data modelling (logical/physical , relational and document/object)
Experience leading offshore resources
Familiarity with Cognos Analytics Platform
ITIL certification
Experience in Agile methodologies
Distribution and Logistics Industry experience
Interview process:
Phone Interview (30-60 minutes)
Onsite Interview (2 hours)
Offer with pending drug test passing