Job Description :
Role: Hadoop Developer
Location: Pleasanton, CA
Job Description:
Responsibility:
1. Develop and support Java/Map Reduce and Spark applications in a distributed platform.
2. Work with application owners on implementing technical solutions on Hadoop platform
3. Performance tune Hive and Impala queries
4. Implement automation to cut down time on manual processes
5. Work with core production support personnel in IT and Engineering to automate deployment and operation of the cluster
6. Understands Hadoop environment builds cluster setup, performance tuning and monitoring.
7. Work with tools running in the Hadoop distribution
Requirements:
1. 2-3 years of development experience in Java and Spark on a distributed platform.
2. Hands on experience with Hue, Hive, Impala and SQL Databases
3. 3 years of professional experience working in Linux environments
4. 2-3 years of professional experience working with Hadoop stack, preferably with Cloudera CDH.
5. 5-7 years of experience with relational database design and development
6. Solid understanding of automation tools like Jenkins
7. Knowledge of best practices related to data security.
8. An understanding of Hadoop design principals, security and the factors that affect distributed system performance.
Desired Skills/Experience:
1. 1-2 years of scripting languages. Preferable Python, bash or Scala.
2. Experience with performance tuning queries
3. Working knowledge of SOLR, Flume, Kafka, Arcadia, Trifacta and Sentry & Kerberos for Security.
4. Certified Java developer a plus.