Job Description :
?Any tax term
Any visa
Hadoop Developer

Location: San Jose CA

Duration: 3 – 6 CTH

Salary upon conversion: 170k


· Define recommended processes for data ingestion, management, transformation and egress

· Design and develop ingest, transformation and egress capabilities leveraging latest tools such as Kafka, Storm, Pig, Hive, Scoop, Flume, Spark etc.

· Assign schemas and create HIVE tables

· Facilitate the selection of appropriate Hadoop and Hadoop ecosystem tools

· Establish the reference architecture, processes, standards and technical framework

· Data cleanup and transformation as preparation for analysis

· Provide design and development expertise for large-scale, clustered data processing systems

· Troubleshoot and debug Hadoop ecosystem run-time issues

· Source huge volume of data from diversified data platforms into Hadoop platform


· 3+ years of experience in IT with 2+ years working with HDFS

· Familiarity with data loading tools like Flume, Sqoop, NiFi

· Ability to write MapReduce jobs (Java/Python etc

· Experience in scripting languages like Python and/or Spark

· Hands on experience in HiveQL

· Knowledge of workflow/schedulers like Oozie

· Working knowledge in SQL/NoSQL DB (Mongo, Hbase, Casandra, Hawq, Impala, Presto)