Job Description :
Lead Big Data Engineer
Cary, NC
13 Months Contract
6+ years of Experience
Skills Required:
5+ years of experience in Handling unstructured data / Big data / Data Warehousing on distributed system
Solid background in Java /Scala in Hadoop for data ingestion and data transformation.
Hands on experience with object oriented programming languages
Experience with Hadoop
Experience working in an Agile/Scrum environment
Data transport, Spark, Hive, HDFS
Familiarity with data access using HBase and Hive Familiarity with Shell scripting to port to Scala
Strong experience with ELT, specifically around data wrangling and transformation.
Any prior experience with Microsoft Azure and SSIS is a plus.
Roles and Responsibilities:
Hands on lead Big Data engineer responsible for architecting and coding complex systems using Hadoop framework.
Understand business context to decisions made within and across groups.
Maintain a current understanding of industry and technology trends.
Contribute to the design and architecture of the project.
Interface with other teams to incorporate their innovations and vice versa.
Work in highly varying levels of abstraction from product strategy to high level technical design to detailed technical design to implementation.
Collaborate effectively with the team to deliver end to end, high-performing, highly reliable, scalable and operable solutions.
Conduct design and code reviews.
Analyse and improve efficiency, scalability, and stability of various system resources.
Be passionate about solving customer problems and develop solutions that result in a passionate customer/community following
Experience designing and developing data ingestion and processing/transformation frameworks leveraging open source tools such as NiFi, Sqoop, Airflow, and Luigi
Experience working with investment applications.
Experience working with off shore teams.
Saurabh
Recruiter
FOCUS AMERICA INC
518 Zenith Dr, Glenview, IL 60025
Desk# :
E-mail: