Job Description :
Position: Hadoop Big Data Developer

Location: San Jose, CA

Duration is 12+Months

Rate: Open

Job Description:

Requirement for Hadoop – C2C – Work Location : San Jose

Strong hands on Hadoop Big Data developer with experience on Spark

Hands on experience on Casandra, python ,Kafka plus

Experience in solving complex analytical problems and performing joins with Map-Reduce.

Strong knowledge of apache hive administration and development.
Experience in writing UDFS, UDAFS, and UDTFS in java for hive.
Solid experience in Pig administration and development.
Experience in writing pig udfs (Eval, Filter, Load and Store) and macros.
Familiar with embedding hive and pig in java.
Experience in using Hcatalog for Hive, Pig and Hbase.
Worked on developing ETL processes to load data from multiple data sources to HDFS using FLUME and SQOOP, perform structural modifications using Map-Reduce, HIVE and analyse data using visualization/reporting tools.
Familiar with writing Oozie workflows and Job Controllers for job automation.
Familiar with importing and exporting data using Sqoop.
Experience in using Flume to stream data into HDFS

Knowledge of Spark.

Good understanding of RDBMS which includes writing queries, stored

· Experience in writing Map Reduce jobs using JAVA, Hive

· Experience in technical design/development in web applications/data intensive systems

· Participates in architecture and design of solution, leads module level design and implementation
Strong data modeling and database skills
· Hands-on experience with Hadoop stacks. Design and implement MapReduce jobs, Hive/HBase table schemas and queries
Hands-on experience with Linux and scripting languages
Expertise in SQL databases (atleast 1)
Good SQL skills and understanding of OLAP/ETL tools
Experience working with large datasets in a distributed computing environment
Any combination of below technical skills:
Hadoop: HDFS, MapReduce, Hive, Hbase, Pig

· Languages: Java, Linux, Apache

· Soft Skills: Good communication, analytical and presentation skills, problem solving skills and learning attitude
             

Similar Jobs you may be interested in ..