Job Description :
Hi,
Hope you are doing well,
Please find the job description given below and let me know your interest.
Position: Hadoop Administrator
Location: Jericho, NY
Mode of interview: Phone then face to face
Job Description:
Hands-on experience on major components in Hadoop Ecosystem including HDFS, Yarn, Hive, Flume, Zookeeper, Oozie and other ecosystem products, Optimized the configurations of Map Reduce, Pig and Hive jobs for better performance.
Commissioning and Decommissioning Hadoop cluster Nodes including balancing HDFS block data.
Configured various property files core-site.xml, hdfs-site.xml, mapred-site.xml and hadoop-env.xml based upon the job requirement.
Expert level skills in Managing and Scheduling Jobs on a Hadoop cluster.
Experience in installing configuring and optimizing Cloudera Hadoop version CDH3, CDH 4.X and CDH 5.X in a Multi Clustered environment.
Experience in Implementing High Availability of Name Node and Hadoop Cluster capacity planning to add and remove the nodes.
Exploring with Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark context, Spark-SQL, Data Frame, pair RDD''s, Spark YARN.
Added security to the cluster using Kerberos.
Monitoring and support through Ganglia and Nagios
Experience in rebalance on Hadoop cluster.
Experience in Chef, Puppet and related tools for configuration management.
Experience in resolving a NameNode check point failure.
Configuring Sqoop and Exporting/Importing data into HDFS.
Good working knowledge on importing and exporting data from different databases namely MySQL, PostgreSQL, Oracle into HDFS and Hive using Sqoop
Experience in deploying Hadoop cluster on Public and Private Cloud Environment like Amazon AWS.
Monitored workload, job performance and capacity planning using Cloudera Manager.
Worked with Hadoop developers, designers in troubleshooting MapReduce job failures and issues.
Expertise in Installing, Configuration and Managing Red hat Linux 5, 6.
.