Job Description :
Job Title: HADOOP Admin Consultant with Cloudera and Cluster experience.
Location: NYC
Duration: 2 Year plus Contract
Interview: In- Person Interview Preferred
Description:
Hadoop Operations is part of the Hadoop Support team. This team is responsible for managing the Hadoop plant across a major financial instition.
Responsibilities and activities of these team include, but not limited to
· Build, Upgrade and maintain Hadoop clusters with several nodes.
· Monitoring and troubleshooting of services running on Hadoop clusters.
· Performance tuning.
· Setup of backup and recovery.
· Troubleshooting User issues which include User on boarding, job failures.
· Installing and integrating of a new services onto the Hadoop cluster.
· Working with Vendor to discuss/apply issue bugs, patches and issues.
Qualification:
· Experience in Cloudera Hadoop distribution. 5.x and above is preferred.
· Experience with Cluster maintenance tasks like adding and removing nodes, enabling High availability, installing services, applying patches.
· Unix/Linux knowledge including the ability to understand hardware, Operating system and network settings.
· Experience with Hadoop Ecosystem components which include HDFS, YARN, Hive, Impala, Spark, Sqoop, Kafka, Flume and Solr.
· Unix Shell, perl or python scripting.
· Kerberos experience.
· TLS/SSL certificates knowledge good to have.