Title : Databricks Administrator
Location: Alpharetta, GA and Jersey City, NJ
Duration: 12 Months + Extension
Job Description:
- Will be responsible for providing technical expertise in deploying applications on Azure Databricks platform.
- The Databricks Administrator must be self-motivated and apply knowledge of Azure to drive solutions, support the development team, and create documentation to support and describe technical solutions.
- An ideal candidate will have technical Azure platform expertise and demonstrate high standards of accountability, customer focus, and quality.
You will:
- Work with key stakeholders in the WM Strats, Algo and Modeling teams in the design, development and implementation of large Databricks environments
- Work closely with members of WM Strats, Alog and Modeling team to facilitate Machine learning models using Spark/PySpark/Pytorch etc.,
- Manage Databricks environments in line with security guidelines o Develop Infrastructure as Code(IaC) to automate databricks environment deployments.
- Develop a library of scripts to automate databricks MLOps environments.
- Perform Production deployment and model monitoring to ensure stable performance and adherence to standards
QUALIFICATIONS:
- Professional experience with 5-7 years of experience developing and implementing models in Cloud ecosystem, i.e., AWS/Azure/GCP, Databricks, SageMaker, or any other similar distributed computing technology
- Proficiency with any one of Databricks, SageMaker, DataIku or similar tools
- Partnered with Cloud solution architect and development team to fully understand product requirements and configure the a Machine learning platform which meet these requirements
- Good written and verbal communication skills
You might also have:
· Good to understand a multitude of Azure resources and services such as containers, virtual machines, storage, log analytics, alerting, metrics, Azure AD, Key Vaults, Azure Backup