Job Description :
Bigdata Spark Tech Lead at Oldsmar, FL or Chicago, IL
Client: Direct
Rate: Market
We have a position for Bigdata Spark Tech Lead at Oldsmar, FL or Chicago, IL. Please find the complete job description below and let me know your interest.
Role: Bigdata Spark Tech Lead
Location: Oldsmar, FL or Chicago, IL
Duration: Long Term
Mandatory Technical / Functional Skills:
· 7+ years of strong experience in software development using BigData, Spark, Java/J2EE technologies (HTML, AJAX, CSS, JavaScript), Scala, ExtJs / UI framework, Postgres
· Expertize with the tools in Hadoop Ecosystem including Hive, HDFS, MapReduce, Spark, Yarn and Oozie
· Excellent knowledge on Hadoop ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming
· Experience in designing & developing POCs in Spark using Scala to compare the performance of Spark with Hive
· Experience in data analysis using HBase and custom Map Reduce programs in Java
· Expertise in writing Map-Reduce Jobs in Java for processing large sets of structured, semi-structured and unstructured data sets and store them in HDFS.
· Good understanding of NoSQL databases and hands on work experience in writing applications on NoSQL databases like HBase
· Experienced in Spark log debugging
· Knowledge on Spark framework for batch and real-time data processing, Knowledge on Scala Programming Language
· Work with product owner, data analysts and software architects to analyze report requirements and design & develop, unit test data analytics solutions
· Object Oriented analysis and design using common design patterns
· Profound insight of Java and JEE internals (Classloading, Memory Management, Transaction management etc)
· Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)
· Experience in the Spring Framework
· Experience in developing web applications using at least one popular web framework (JSF, Wicket, GWT, Spring MVC)
· Experience with test-driven development
· Solid understanding of Javascript frameworks and best practices with hands on experience
· Solutioning and implementation skills in Hadoop ecosystem a plus
· Knowledge of working in a Agile / Scrum based enviroment will be a plus
· Technical team management experience including offshore team members
· Excellent personal communication, leadership, and organizational skills
· Extensive knowledge in Software design patterns and enterprise integration patterns, RESTful APIs and resource oriented architecture
· Must have extensive knowledge in SaaS architecture, web-based systems architecture, service-based architecture, enterprise application architecture
· Should have hands-on expertise In the following technologies
o Spark / Scala
o SaaS integration tools
o Java/J2EE
o Common frameworks such as struts, spring, hibernate, etc.
Roles and responsibility:
· Implementing complex solutions and work closely with Delivery Managers and Solution Architects
· Accountable for technical solution and quality of the delivery of the team
· Responsible to interface with program Architects and review design solution with them
· Work with the application development teams throughout the development life cycle
· Evaluate new features, products
· Lead Proof-of-Concept aligned to the program
· Stay current with emerging industry trends
· Ability to take ownership on key decision related to design and technical standards including performance review and optimization
· Create Preliminary and Detail design document based on the requirements
· Good written and oral communication
· Explain complex design items through documents and white-board sessions with Customer
Desirable Technical / Functional Skills:
· Hadoop, HDFS, Spark SQL, Scala, Java, J2EE