Job Description :
Resumes Needed By:
Client: AEP(IBM)
Location: Columbus, OH
Duration: 08 Jul 2019 - 27 Dec 2019
Pay Rate : Open + expenses
Travel Type: Weekly Commute (expenses paid)
Job Title: Senior Hadoop Admin
No. of Positions: 1
Job Requirements:
Responsibilities:
Responsible for implementation and ongoing administration of Hadoop infrastructure and upgrade to HDP3.
Cluster maintenance as well as creation and removal of nodes - Node management
Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
Access Management - Working with data delivery teams to setup new Hadoop roles / users and provisioning the same.
Screen Hadoop cluster job performances and capacity planning
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
File system / HDFS support and maintenance.
Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades as required.
Point of Contact for Vendor escalation.
Training and coaching other team members
Qualification:
The administrator should have in-depth knowledge and hands on experience of at least 5+ years in Hadoop administration, installation, configuration, upgrade, monitoring and troubleshooting of Hadoop services.
The administrator should have strong understanding of Hadoop eco system such as HDFS, Yarn, MapReduce and data ingestion concepts.
Need to have experience setting up and administration of hadoop clusters.
Deep understanding and experience with Horton Works or Cloudera Hadoop stack is required.
Need to have substantial expertise and experience with Hive, Hbase, Storm, Flume, Spark and kafka required.
Experience with Red Hat Enterprise Linux, spark, Java, R & Python Packages is desired (nice to have
Strong verbal and written communication skills are required. Ability to work in a team environment under limited supervision is needed.