Job Description :
Job Description
Job Id
JOB-3523
Job Created Date
08/06/2018
Job Description
Client: Komatsu Mining Corporation
Contract Length: Thru March 2019 - likely extension
Location: 4400 National Ave, Milwaukee, WI
Title: Big Data Engineer
This role will use with unique hands on experience to design and code enterprise cloud analytic & big data applications. This person must be able to work collaboratively in a team environment, yet independently able to research and propose technical solutions, deliver multiple assignments independently, and provide technical expertise to other team members. Experience working in an agile scrum environment is a must.
Position Responsibilities
Develop big data platforms (primarily Hadoop) and infrastructure
Develop ingest workflows using big data tools
Develop technical and functional test plans and scripts to validate the successful design, development and implementation of analytics system deliverables
Provide technical expertise in designing, documenting and coding new analytics systems initiatives
Monitor big data platforms and ensure successful high availability of data
Support Hadoop issues, configure and setup new clusters for both Hadoop & Kafka
Develop & configure transformation Streamsets code to ingest new data and data sources
Qualifications and Experience
Experience with Cloudera ecosystem tools, Cloudera Manager & Hue
Good understanding of PaaS, SaaS
Experience with Cloud providers (Azure, AWS, GCE), services and infrastructure management
Experience in configuring and Managing AD, LDAP, OAuth
Experience in writing complex SQL statements, JAVA, VBA and Powershell scripts, batch files
Strong Object-oriented programming knowledge along with good understanding of algorithms, data structures and design patterns
Experience developing solutions in public cloud environments
Proficient in Big Data Databases Hadoop
Proficient in data transformation (ETL)
Strong working knowledge of supporting & troubleshooting big data platforms
Experience in developing systems using Java, C#, .NET, Python or C++