Job Description :
Sr. ELK Stack Lead Developer to lead development efforts and create a search system in an AWS based data and analytics platform.
Requirements:
Strong experience in setting up ELK stacks including the implementation of ELK architecture and design, deployment, configuration scripts, and supporting documentation.
Work with a cross-functional team of developers and business analysts to design ingestion pipelines, integration APIs and provide Elastic Search tuning/optimizing based on search needs.
Implement a search system that refines indexes and augment the data to generate visibility and use Natural Language Process (NLP) and machine-learning techniques to uncover opportunities in the data.
Enhance the ELK stack to predict business risks and opportunities leveraging AI and real-time data and eventually drive proactive business engagement to execute decisions.
Data Integration - Design and develop new systems integrations from a variety of formats including files, database extracts and APIs (including streaming data
Data Pipelines - Create/run/configure highly scalable data ingestion pipelines using ELK that incorporates complex transformations and efficient code.
Data Delivery - Design and develop solutions for delivering data that meets SLA.
Operations and tuning - Proactively monitor data flows with a focus on continued performance improvement.
Diligently team up with infrastructure, network, database, application and business intelligence to guarantee high data quality and availability in production.
Supervise the design, build and maintenance of ELK stack.
Extensive Knowledge in design and development of various web and enterprise applications using Python, Scala for Web Services (REST), JSON, Grok, .
Good experience with different IDE''s, build & automation tools like Eclipse, STS, and GitHub, JIRA.
Familiarity with BI tools and report generation - QlikView/QlikSense.
Big Data Experience (AWS) – Machine Learning, Statistical and Quantitative Analysis, Data visualization.
Qualifications:
10+ years’ experience overall IT experience
Experience in Software Development Life Cycle (SDLC) which includes effort estimation, Requirement gathering & Analysis, Design, Code construction, Unit Testing , Implementation, Software Release/Deployment and Hypercare Support.
A strong data-driven/fact-based decision maker
An Agile mindset with experience working in Agile environment
Able to exercises independent judgment with minimal directing from supervisor
A spirit of collaboration and transparent communication
Excellent communication and interpersonal skills
Evaluating open source and vendor products