Job Description :
Job title Hadoop Admin
Location Minneapolis, MN (Locals preferred)
Duration 6 Months
Experience 10+ Years
Key Skills Hadoop, AWS EMR (Must have), HDFS, Hive, Spark, Java and UNIX
Job Description
We need a very experienced and hands-on Hadoop admin to help with the following:
Maintain the AWS EMR production cluster
Install software on Hadoop cluster to support data science and analytics users. This includes but not lmited to R, Python packages, Spark, H2O and other Big Data Open source components/services
Maintain user accounts/system security and cluster resource management to optimize user query execution time and data loading time
Help with data migration and issue resolution while migrating the existing Hadoop/Java applications from on-premise cluster to cloud distribution
Minimum Skills Required:
Minimum 3 years of experience as Hadoop admin in a large (multi-Petabyte) production environment
Experience supporting data science teams, super users and analytics teams on complex code deployment, debugging and performance optimization problems
Experience with Hadoop, HDFS, Hive, Spark, R, Python, Java and UNIX
System monitoring and controls
Experience managing CPU, memory, storage resources for a large Hadoop cluster with 100s of users