Job Description :
Position: Senior Hadoop Developer
Experience : 10.0 to 12.0
Location: NEW YORK City, NY
Must have Skill Hadoop Good To have Skill Hadoop
Description
As a developer of PTI Search team, the candidate is expected to
1. Build fusion index pipeline for the bulk and real time indexing of large scale data sets residing in database, Hadoop and NAS locations.
2. Build fusion query pipeline and running on the fly aggregation.
3. Write efficient search queries against indexes.
4. Design, create and manage shards and indexes.
5. Use Machine Learning to improve relevancy of search results.
6. Prototype and demonstrate new ideas of feasibility and leveraging Hadoop Eco system Capabilities.
7. Write Hive scripts to aggregate / transform core data and prepare indexing.
8. Contribute to all aspects of application development including design, development and support.
9. Take ownership of application components and ensure timely delivery of the same.
10. Identify, clarify, and resolve issues and risks, escalating them as needed.
11. Lead a team of developers.
12. Participate in design discussions and contribute to the architecture processes