Developer - L4

Role: Azure Databricks Developer

Location: Louisville, KY (Day 1 Onsite)

Job Description:

1. The Senior Data Engineer will be responsible for the build of Enterprise Data platform.
2. Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.
3. Build Azure Data Lake leveraging Databricks technology to consolidate all data across the company and serve the data to various products and services.
4. The scope of this role will include working with engineering, product management, program management and operations teams in delivering pipeline platform, foundational and application-specific pipelines and building the Data Lake in collaboration with business and other teams.

Responsibilities

1. Design, Develop, Operate and drive scalable and resilient data platform to address the business requirements
2. Drive technology and business transformation through the creation of the Azure Data Lake
3. Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
4. Partner with Product Management and Business leaders to drive Agile delivery of both existing and new offerings; assist with the Leadership and collaboration with engineering organizations within Change to manage and optimize the portfolio

Required Skills

1. 10+ years working experience in Data processing / ETL / Big data technologies like Informatica, Hadoop, Cloudera
2. 4+ years working experience in Databricks (essential) and Python
3. Experience with Cloud / Azure architectural components
4. Experience building data pipelines and infrastructure
5. Deep understanding of Data warehousing concepts, reporting and Analytical concepts
6. Experience with Big Data tech stack, including Hadoop, Java, Spark, Scala, and Hive, NoSQL data stores
7. Bachelors degree in Mathematics, Physical Sciences, Engineering or Computer Science

Nice to Have skills

1. Experience in leading design and development of large systems
2. Demonstrates strong drive to learn and advocate for development best practices
3. Proven track record of building and delivering enterprise-class products
4. Full Stack Experience (End to End Development)
5. Crisp and effective executive communication skills, including significant experience presenting cross-functionally and across all levels

Do

1. Instrumental in understanding the requirements and design of the product/ software

• Develop software solutions by studying information needs, studying systems flow, data usage and work processes
• Investigating problem areas followed by the software development life cycle
• Facilitate root cause analysis of the system issues and problem statement
• Identify ideas to improve system performance and impact availability
• Analyze client requirements and convert requirements to feasible design
• Collaborate with functional teams or systems analysts who carry out the detailed investigation into software requirements
• Conferring with project managers to obtain information on software capabilities

2. Perform coding and ensure optimal software/ module development

• Determine operational feasibility by evaluating analysis, problem definition, requirements, software development and proposed software
• Develop and automate processes for software validation by setting up and designing test cases/scenarios/usage cases, and executing these cases
• Modifying software to fix errors, adapt it to new hardware, improve its performance, or upgrade interfaces.
• Analyzing information to recommend and plan the installation of new systems or modifications of an existing system
• Ensuring that code is error free or has no bugs and test failure
• Preparing reports on programming project specifications, activities and status
• Ensure all the codes are raised as per the norm defined for project / program / account with clear description and replication patterns
• Compile timely, comprehensive and accurate documentation and reports as requested
• Coordinating with the team on daily project status and progress and documenting it
• Providing feedback on usability and serviceability, trace the result to quality risk and report it to concerned stakeholders

3. Status Reporting and Customer Focus on an ongoing basis with respect to project and its execution

• Capturing all the requirements and clarifications from the client for better quality work
• Taking feedback on the regular basis to ensure smooth and on time delivery
• Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members.
• Consulting with engineering staff to evaluate software-hardware interfaces and develop specifications and performance requirements
• Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code
• Documenting very necessary details and reports in a formal way for proper understanding of software from client proposal to implementation
• Ensure good quality of interaction with customer e-mail content, fault report tracking, voice calls, business etiquette etc
• Timely Response to customer requests and no instances of complaints either internally or externally

Deliver