Job Title: Cloud Architect (Data Lake/Data Bricks) SME
Location: Raleigh, NC / Hybrid (4 Days Onsite/1 Day Remote)
Duration: Long Term
Description:
Our Client is seeking a resource well skilled in Cloud architecture to support the following technologies:
Delta Lake storage Big Data and Machine Learning analytics (e.g., Apache Spark)
to help meet organization priorities.
As a technical expert, provides advice and assistance in state-of-the-art software/hardware solutions involving hardware of various capacities, multiple operating environments, database management systems, specialized software, data communications facilities and protocols including Value Added Networks, fourth generation technologies, and complex software tools or packages.
As a business expert, works with senior client officials to identify enterprise improvement goals, assess organizational and process effectiveness, and implement change strategies.
Roles and Responsibilities include but not limited to:
Minimum 15 year s IT Architecture/Systems experience
10 years experience designing technical and business solutions, mentoring and training client staff, and overseeing implementation
Highly diverse technical and industry experience related to systems needs, development, process analysis, design, and reengineering
Possesses skills and experience related to business management, systems engineering, operations research, and management engineering
Assist with deployment, configuration, and management of Azure Cloud environment
Assist with migration efforts of existing ETL jobs into Azure/Databricks cloud environment
Assist ETL staff with Cloud best practices, efficiency optimization, and knowledge sharing
Assist with Operationalizing deployments and Cloud services for ETL Operations, including automation, documentation, and knowledge articles
Provide written and oral presentation to high-level client s CIO management on status of efforts
Basic Qualifications:
Strong skills and experience in Cloud Operations support in Azure
Strong experience supporting large-scale/enterprise level Cloud environments
Strong experience supporting cloud services (compute, network, databases, etc.)
Experience using Databricks or other Spark-based platforms
Knowledge/experience with Sqoop, Oozie, Flume
Fluency in scripting languages: Python, Perl, Ruby (or equivalent)
Ability to troubleshoot cloud resource problems and perform complex system tests
Ability to automate solutions to repetitive problems/tasks
Experience with Git integration in continuous deployment
Experience with DevOps monitoring tools
Knowledge of best practices and IT operations in always-up/always-available environments
Documentation skills for internal procedures and services
Strong communication skills with team members
Significant experience with:
SAS
Python
C++
Hadoop
SQL (Database/Coding)
Apache Spark
Machine Learning
Natural Language Processing
Visualization tools (Tableau)
Demonstrated experience with unstructured data
Creative thinking and detail orientation
Desired Skills:
Strong understanding of cloud networking at scale
Ability to break down complex networking concepts and present concisely
Shell scripting experience
PowerShell
Data Transfer Requirements:
The selected resource will conduct knowledge-transfer sessions covering:
Monitoring (Infrastructure and Application-specific)
Troubleshooting
Incident Alerting and Avoidance
Dashboard Development
Settings and Configuration
Security
Testing of platform/applications
Preparing audit compliance reports
Reporting:
Monthly status reports must include:
Work progress
Identified risks/technical issues with recommendations and contingency plans
Schedule deviations with proposed recovery plans
Education:
Master s Degree from an accredited College/University in the applicable field of services
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.