Job Description :
Hadoop Admin
Houston TX
12 MONTH
Phone/skype
Duties/Skills/Responsibilities
Our client is seeking a senior-level, proactive, go-getter with extensive experience in Hadoop Development and Administration to join the “Big Data” team. They ideal candidate is proactive and knows how to show initiative, a true leader who will go above and beyond to get the job done.
Duties of this senior-level Hadoop Admin will include but not be limited to:
True Hadoop Administration & configuration.
Hive experience required.
Our client uses Hortonworks; so Hortonworks is REQUIRED (not Cloudera or another similar technology
Ideally, this person would have risen through the development ranks and possibly even the DBA ranks in Hadoop.
This person will be a leader and will be working in a team size of about 4-5 people, but will also be interfacing with end users. Effective communication is key.
Large volumes of data, well data, and production data are being loaded into Hadoop.
Additional duties include but not be limited to:
Responsible for implementation and ongoing administration of Hadoop infrastructure.
Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users.
Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and other tools.
Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
Screen Hadoop cluster job performances and capacity planning.
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
File system management and monitoring.
HDFS support and maintenance.
Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.