Position: Big Data Lead
Duration: 6 months
Location: Newark, NJ (Offsite until Covid is figured out)
Job Description:
The engineer partners with stakeholders across the enterprise – s/he partners with analytics, data consumers and enterprise architects. S/he understands healthcare data but does not need to be an analyst; similarly needs to understand architecture at an enterprise level but is not an architect. Needs to be able to translate customer needs and architectural standards into an actual implementation plan. This is a hands-on technical role as well. The engineer will know Python, Spark and /or Scala and be able to implement data solutions and deliver data transformation frameworks that are scalable and reusable.
Big Data Lead
Responsible for Source Data Analysis, Data Profiling, Data Ingestion and Consumption patterns design, Solution designs for building Data Integrations across various data platforms. The ideal candidate would be responsible for developing and delivering data lake solutions to meet demands in areas such as Analytics, Risk Analysis, Finance and Customer Service. This role will work with various stakeholders from business and IT to deliver Data centric solutions.
Responsibilities:
- Hands on experience leading large scale enterprise data warehousing and analytical projects with Hadoop , Spark and AWS services
- Track record of implementing MPP databases, NoSQL databases, Data Warehouse and enterprise Data Lake design
- Research and evaluate new technologies, design patterns and software products to determine feasibility and incorporate their capabilities in enterprise initiatives
- Provide architecture and solution design for Big Data projects with active involvement in POCs
- Support development teams by reviewing design and provide performance and security recommendations
- Work with enterprise architecture and Data architecture teams to understand projects scope and collaborate with them for architecture design
- Build highly scalable Big data platform which enable collection, storage and analysis of massive data sets (structured and unstructured data)
Qualifications
- Over 14+ years' experience in IT with at least 5+ years in the Tech Lead/Data Architect role
- Expertise in Data Warehouse and Data Lake architectures
- Experience in Big Data solutions like Hadoop (Hortonworks preferred) , AI/Client Machine Learning, Redshift, Amazon S3 etc
- Advanced knowledge in Spark, Payton and Java programming languages
- Effectively communicate complex technical concepts and solutions to non-technical business stakeholders
- Knowledge of infrastructure for Big Data platform and ability to work across various infrastructure teams
Education
• Bachelor's Degree Required