Job Description :
Hi ,
Position: Sr. Hadoop Administrator – 12+ years
Duration: 6 Months Contract
Location: Virginia Beach, VA
Interview process: Telephonic + Skype
Tax Terms Accepted: W2 /Corp-Corp
Required Skills :
Standard Hadoop Administration Skills
Experience with Cloudera Distribution is highly preferred.
Experience with administering Hadoop (cloudera) cluster
Experience with Linux Administration
Experience with troubleshooting cluster and other related issues
Experience with on-site and cloud based implementations.
Job Description :
Hadoop Cloudera Administrator
Requirements
Bachelor’s Degree in computer science or related degree and 7+ years of IT experience
3 to 5 years of Hadoop administration experience, preferably using Cloudera
3+ years of experience on Linux, preferably RedHat/SUSE
1+ years of experience creating map reduce jobs and ETL jobs in Hadoop, preferably using Cloudera
Healthcare industry experience preferred
Job Duties
Stewardship the overall Cloudera architecture and infrastructure. Responsible for of sizing, scaling and supporting 40+ nodes in a new implementation.
Working with data application teams and customers to setup new Hadoop users, Linux users, Kerberos principals and LDAP integration and verification of HDFS, Hive, Pig and MapReduce access for the new users
Cluster maintenance as well as the creation and removal of nodes using tools like Ganglia, Nagios, or Cloudera Manager Enterprise.
Performance tuning and troubleshooting of Hadoop clusters and Hadoop MapReduce routines
Performance tuning and troubleshooting of Spark/SQL performance when using Impala, SAP Vora or similar SQL/Spark engine.
Mentoring and maintain Hadoop cluster job performances and capacity planning
Monitor and maintain Hadoop cluster connectivity, security and log files
Monitor and maintain File system and HDFS
Ability to work with the storage, network, database, and business intelligence teams to provide data quality and high availability
Coordinate with Unix team and vendors to install operating system updates, Hadoop updates, patches, version upgrades when required
General DBA responsibilities such as database backup and recovery, database connectivity and security, automation of tasks, and database provisioning.
Participate in call rotation for all products supported by the BI systems architecture team
Skills
Experience with Hadoop architecture, administration and database management
Experience maintaining Hadoop clusters.
Experience sizing and scaling clusters, adding and removing nodes, provisioning resources for jobs, job maintenance and scheduling
Strong understanding of JVM debugging, management and tuning
Operational experience with Hadoop technologies include Ambari, Ranger, Atlas, Knox, NiFi, Kafka, Storm, Hive, Pig, MapReduce, HDFS, HBase, Accumulo, Spark
Experience with relational databases (preferably Microsft SQL Server) and data warehouse concepts
Experience with IBM MDM Infosphere/Datastage in a Hadoop environment.
Familiarity with Java programming
Familiarity with Tableau, SAP HANA or SAP BusinessObjects