Job Description :
Title: Lead Hadoop Developer
Location: Southborough, MA, United States
Length and Terms: Long term - W2 or C2C
Job description:
Title : Lead Hadoop Developer
Location: 132 Turnpike Road, Suite 210, Southborough, MA 01772 (moving to Brighton in October—candidates need to be comfortable with both locations); free parking, no public transportation
Duration: 6 months, may extend
Hortonworks experience - spark , scala, Sqoop , map reduce hands on experience.
AWS experience - strong AWS S3 and other skills on the usage
Interview Process : phone screen then two video interviews
Job Description:
At least 5 to 6 years’ experience developing the complete end-end to design of enterprise wide big data solution
Should be able differentiate and recommend different tools that can be used to solve business problems
Design and Develop big data solutions using Hadoop and Spark platform
Hortonworks distributions experience is must
Amazon Web services Experience is must
Big data development experience on Hadoop platform including Hive, Hive LLAP, Sqoop, Flume, Spark.
Application development experience in Core Java/ Python
Should be able to cover end-to-end BI and Data strategy inclusive of partnership with internal and external stakeholders.
Experience with data modeling, complex data structures, data processing, data quality and data lifecycle.
Should be able to lead critical aspects of the data management and application management.
Experience in UNIX shell scripting, batch scheduling and version control tools.
Experience with analytical programming and ability to work with EDW architecture to bridge the gap between a traditional DB architecture and a Hadoop centric architecture.
Highly organized and analytic, capable of solving business problems using technology.
Should be an individual with in-depth technical knowledge and hands-on experience in the areas of Data Management, BI Architecture, Product Development, RDBMS and non-RDBMS platforms.
Should have excellent analytical skills, able to recognize data patterns and troubleshoot the data.
Will be responsible for design and delivery of data solutions to empower data migration initiatives, BI initiatives, dashboards development etc.
Will design ETL processes, must be able to explore the POC/prototype options.
Experience building solutions for streaming applications is a plus
Have a thorough understanding of the implications of software design and implementation choices on performance and maintainability.
Experience in large scale server-side application development that includes the design and implementation of high-volume data processing jobs.
Functional programming experience is desired.
Willing to work in Big Data development initially and then move to support operations group.
Role - Associate