Job Description :
Client: TXDOT/NTTDATA
Job Title: Hadoop Developer
Job ID: 2017-196093
Duration: 6+ Months(CTH)
Location: Austin, TX 78731
Job Responsibilities:
- Hadoop development and implementation (Environment - HDFS, Hbase, Spark, Kafka, Ozie, Scoop, Flume, Kerberos, Oracle ASO, MySQL, GeoSpatial data)
- Loading from disparate data sets using Hadoop stack of ingestion and workflow tools
- Pre-processing using Hive and Pig.
- Designing, building, installing, configuring and supporting Hadoop.
- Translate complex functional and technical requirements into detailed design.
- Perform analysis of vast data stores and uncover insights.
- Maintain security and data privacy.
- Managing and deploying HBase.
- Being a part of a POC effort to help build new Hadoop clusters.
- Test prototypes and oversee handover to operational teams.
- Propose best practices/standards.
- Configure and implementation of Data Marts in Hadoop platform
Required Qualifications:
- Need Expert Level Hadoop Developer with 5+ Years'' of experience in - BIG Data ( BDApache Hadoop (HDFS) - Base/Hive/Pig/Mahout/Flume/Scoop/MapReduce/Yarn
- Hands on experience with a NoSQL database like HBase
- Hands on experience in job scheduling tools like Oozie
- Hands on experience in Pig and Hive Queries as well as performance tuning
- Hands on experience in UNIX and Shell Scripting is plus
- Experience working with Spark for data manipulation, preparation, cleansing is plus