Job Description :
Hadoop Configuration / Development Engineer
Location: Ann Arbor, MI
Duration: 6+ month contract to hire
Needed US Citizens and Green Cards only.
Job Duties and Description:
The Hadoop Configuration and Development Engineer will be responsible for the administration of distributed computing services (within Hadoop eco-system This individual will interface with the Data Science group, Business Intelligence and Financial Risk Management to identify components that are useful in advanced analytics work-flow. By working with Unix Administrators and internal technology teams, they will be responsible for integrating components of the eco-system. This position will offer an opportunity to explore new Big Data technologies and contribute to Advanced Analytics.
Responsibilities:
Responsible for implementation and ongoing administration of Hadoop infrastructure
Aligning with the systems engineering team to select, install, and upgrade software
Performance tuning of Hadoop clusters
Screen Hadoop cluster job performances and capacity planning
Manage and review Hadoop log files
Help Application and Operations team to troubleshoot the performance issues
Mentor other team members with performance tuning and tools
Assist in data modeling, design & implementation based on recognized Standards
Software installation and configuration
Query and execution engine performance monitoring and tuning
Automate manual tasks
Responsible for code (ETL/Ingestion, SQL/Data Engineering, and Data Science
Model) migrations to production using bitbucket, git, Jenkins, and artifactory
Provide operational instructions for deployments, for example, Java, Spark, Sqoop, Storm
Support any process that needs attention in production environment
Requirements:
One to three years’ experience with Linux in both administrator and user capacities
Familiarity with some of the following languages: python, bash, scala, java, and SQL
Some experience with networking and firewalls
Some experience with NoSQL
Ability to learn about the Hadoop ecosystem Two year degree in computer science required.
Military education or experience may be considered in lieu of civilian requirements listed