Job Description :
Hi,
My name is Basavaraj from Cygnus Professionals .
I am looking for a Hadoop (Hive) Developer & Hadoop Admin for one of my clients. Please find the information below. You can reach me on (Ext 9054) or
Job Title: Hadoop (Hive) Developer & Hadoop Admin
Location: Redwood City, CA
Duration: Long term
Hadoop Developer:
What the candidate will Do:
Build fault-tolerant, scalable batch and real-time distributed data processing systems using Hive, Map-Reduce, Tez, HBase, Java/Python, Kafka, Spark etc.
Maintain and support existing Apache Hive platform and evolve to newer tech stacks and architectures
Debugging, troubleshooting and optimizing Hive queries against big data sets.
Provides operational excellence through root cause analysis and continuous improvement.
What the candidate will Need:
10+ years of development experience
Solid experience of 3+ years in implementing Hive, Hadoop, MapReduce, Java
Fluency in at least one mainstream programming language (Java, Scala, Python preferred
Experience in designing and optimizing data queries against data in Hadoop environment using tools such as Hive explain
Strong team player and self starter
Bonus skills:
Experience in building a Hadoop 2.x/YARN based platform using Tez and Slider
Experience with columnar datastore (HBase), Vertica
Hadoop Admin:
10+ years of experience
Experience in managing multi clusters with hundreds of nodes
Responsible for implementation and support of the Enterprise Hadoop environment.
Involves designing, capacity arrangement, cluster set up, performance fine-tuning, monitoring, structure planning, scaling and administration.
The administrator consultant will work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels.
Need to implement concepts of Hadoop eco system such as YARN, MapReduce, HDFS, HBase, Zookeeper, Pig and Hive.
In charge of installing, administering, and supporting Windows and Linux operating systems in an enterprise environment.
Accountable for storage, performance tuning and volume management of Hadoop clusters and MapReduce routines.
In command of setup, configuration and security for Hadoop clusters using Kerberos.
Monitor Hadoop cluster connectivity and performance.
Manage and analyze Hadoop log files.
File system management and monitoring.
Develop and document best practices
HDFS support and maintenance.
Setting up new Hadoop users.
Responsible for the new and existing administration of Hadoop infrastructure.
Include DBA Responsibilities like data modeling, design and implementation, software installation and configuration, database backup and recovery, database connectivity and security.