Job Description :
Required Experience (in order of importance):
·Hadoop, Hive, Impala, and related technologies
·Spark
·MPP, shared nothing database systems, NoSQL systems
·Lambda architectures
·Linux
·Data Warehousing design and concepts
Minimum Education, Experience, & Specialized Knowledge Required:
·Computer Science Degree
·5+ years strong native SQL skills
·5+ years strong experience in database and data warehousing concepts and techniques. Must understand: relational and dimensional modeling, star/snowflake schema design, BI, Data Warehouse operating environments and related technologies, and ETL, MDM, and data governance practices.
·5+ years experience working in Linux
·3+ years experience with Hadoop, Hive, Impala, HBase, and related technologies
·2+ years strong experience with low latency (near real time) systems and working with Tb data sets, loading and processing billions of records per day
·1+ years experience with MapReduce/YARN
·1+ years experience with Spark
·1+ years experience with Lambda architectures
·1+ years experience with MPP, shared nothing database systems, and NoSQL systems
·Ability to work in a fast-paced, team oriented environment
·Ability to complete the full lifecycle of software development and deliver on time
·Ability to work with end-users to gather requirements and convert them to working documents
·Strong interpersonal skills, including a positive, solution-oriented attitude
·Must be passionate, flexible and innovative in utilizing the tools, their experience, and any other resources, to effectively deliver to very challenging and always changing business requirements with continuous success
·Must be able to interface with various solution/business areas to understand the requirements and prepare documentation to support development
·Healthcare experience is a plus
Responsibilities:
·Validate the reference architecture and provide details and shared ownership for the architecture of our next generation data warehousing system, leading and working hands-on towards implementation and delivery to production
·Help lead the charge on a data warehouse/operational data store strategy, ensuring rapid delivery while taking responsibility for applying standards, principles, theories, and concepts
·Responsible for design and delivery of data models, which power BI initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases for IMS solutions
·Work with data architects on the logical data models and physical database designs optimized for performance, availability and reliability
·Tuning and optimization of backend and frontend data operations
·Serve as a query tuning and optimization technical expert, providing feedback to team
·Design and develop ETL and master data management processes
·Scripting and automation to support development, QA and production database environments and deployments to production
·Define and help enforce data governance and security policy
·Mentors development team members
·Proactively helps to resolve difficult technical issues
·Provide technical knowledge to teams during project discovery and architecture phases
·Keep management informed of work activities and schedules
·Assess new initiatives to determine the work effort and estimate the necessary time-to-completion
·Document new development, procedures or test plans as needed
·Participate in data builds and deployment efforts
·Participate in projects through various phases
·Performs other related duties as assigned
·Partner with the business units to develop effective solutions that solve business challenges