Job Description :
Job Title: Hadoop Developer - Fulltime
Location: Pleasanton, CA
Duration: Fulltime
Job Description
Responsibility:
1. Develop and support Java/Map Reduce and Spark applications in a distributed platform.
2. Work with application owners on implementing technical solutions on Hadoop platform
3. Performance tune Hive and Impala queries
4. Implement automation to cut down time on manual processes
5. Work with core production support personnel in IT and Engineering to automate deployment and operation of the cluster
6. Understands Hadoop environment builds cluster setup, performance tuning and monitoring.
7. Work with tools running in the Hadoop distribution
Requirements:
1. Bachelor''s degree in Computer Science or equivalent (with experience)
2. 2-3 years of development experience in Java and Spark on a distributed platform.
3. Hands on experience with Hue, Hive, Impala and SQL Databases
4. 3 years of professional experience working in Linux environments
5. 2-3 years of professional experience working with Hadoop stack, preferably with Cloudera CDH.
6. 5-7 years of experience with relational database design and development
7. Solid understanding of automation tools like Jenkins
8. Knowledge of best practices related to data security.
9. An understanding of Hadoop design principals, security and the factors that affect distributed system performance.
Desired Skills/Experience:
1. 1-2 years of scripting languages. Preferable python, bash or Scala.
2. Experience with performance tuning queries
3. Working knowledge of Solr, Flume, Kafka, Arcadia, Trifacta and Sentry & Kerberos for Security.
4. Certified Java developer a plus.
Soft Skills Required:
1. Good collaboration & communication skills, the ability to participate in an interdisciplinary team.
2. Strong written communications and documentation experience
3. Excellent time management and organizational management skills
4. Able to lead an initiative from end to end