Job Description :
JOB DESCRIPTION:
1. 3-5 years of experience in Hadoop Administration.
2. Capable of handling tasks like System monitoring (Hadoop Disk utilization, long running jobs), Application monitoring (track and publish system uptime stats, monitor data output/rate/size), troubleshooting (Connectivity problems, system problems, data problems
3. Experience in install/upgrade of Cloudera packages/components. Experience in Cloudera manager is a must.
4. Extensive experience in Hadoop ecosystem including Spark, MapReduce, HDFS, Hive, HBase is required.
5. Job requires to be part of 24x7 on-call rotation and production support
1. System monitoring
- Hadoop Disk Utilization
- Available map/reduce slots
- Long running jobs
- Create operational monitoring reports
- Capacity tracking and planning
2. Application monitoring.
- Track service deliver SLAs
- Establish processes to monitor each expected data output/rate/size
- Track and publish system available uptime statistics
3. Troubleshooting
- First-level troubleshooting
- Connectivity problems
- System problems
- Data problems
4. Administration
- Create new Hadoop users
- Create Kerberos tickets
- Configure Cloudera settings
- Restart services: Hue, Hive, MapReduce, HDFS, Oozie, Sqoop, Impala
5. Install/upgrade
- Monitor Cloudera for new releases/packages
- Install Cloudera packages/components.