Job Description :
Data Engineer
Bentonville, AR
Long Term


Client is looking for a highly energetic and collaborative Data Engineer with experience building enterprise data solutions around Business and IT operations. The ideal candidate should be an expert in the Big Data space, using traditional, new and emerging technologies. Candidate should have good experience in understanding the ETL jobs and creating migration ELT pipelines using Azure Data Factory services. Candidate also should be versatile in coding with Spark and Python.

Key Responsibilities
Requirements and design • Building Data Pipelines • Integration • Testing • Feature Definition
8+ years of experience in designing data pipelines using ETL tools and Data warehousing. • 3+ years of experience in working with Big data systems
2+ years of experience in coding using Spark and/or Python • 1+ years of experience in designing data pipelines using Azure Data Factory (ADF) services.
3+ years of experience working as a member of an Agile team For this role, we value: • Ability to do hands-on coding in efficient and optimized approach, using Spark/Python.
Expertise working in Azure Data Factory (ADF) services. • Your data warehousing experience and ability to bring optimizations in ETL/ELT processes
Your data engineering skills in cloud and big data systems.
The ability to adapt quickly to a fast-paced environment • Excellent written and oral communication skills
A critical thinker that challenges assumptions and seeks new ideas • Proactive sharing of accomplishments, knowledge, lessons, and updates across the organization
Experience designing, building, testing and releasing software solutions in a complex, large organization • Demonstrated technical leadership
Demonstrated analytical and problem-solving skills (ability to identify, formulate, and solve engineering problems)
Demonstrated understanding of Algorithms, Data Structures, Object Oriented Design, Databases (SQL / NoSQL)
Overall Experience level: 10+ years in IT with min 5+ years as a Data Engineer.

As a data engineer you must
Do hands-on data engineering work using Spark and Python to migrate data from traditional data sources into big data systems
Create optimized data pipelines using Azure Data Factory. • Exercise you strong data warehousing skills in terms of data analysis and identifying the right approach for cloud data migration
Create technical solution and low-level designs for data engineering work • Review functional and technical requirements, raising potential issues and participating actively in design discussions
Develop reusable artifacts/frameworks, re-usable assets, industry solutions, reference architecture, design, development and QA best practice
Collaborating with Customers and Product Marketing / Management teams to identify opportunities that can be exploited through great software features. Work closely with Product Owners, Scrum Masters, Senior Business Analysts, and other client stakeholders • Working as a member of a design, build and test agile team continuously releasing new features • Mentoring people in your team
             

Similar Jobs you may be interested in ..