Job Description :
Cluster maintenance including creation and removal of nodes
Setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users
Performance tuning of Hadoop clusters and Hadoop MapReduce routines
Screening Hadoop cluster job performances and capacity planning
Monitoring Hadoop cluster connectivity and security
Managing and reviewing Hadoop log files
File system management and monitoring
HDFS support and maintenance
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required
Backup and Recovery Task
Security Management