Job Description :

Roles & responsibilities

  • Provide Guide on Azure data lake architecture decisions, components selection, sizing and performance considerations in the context of data modernization goals
  • Evaluate different architecture patterns, define complexity and underlying solutions
  • Translate business requirements to technical solution decisions
  • Design and architect solutions on Microsoft Azure and related technologies including ADF, ADLS,ASA, AAS,AML and Power BI
  • Design and Develop data Ingestion using ADF and processing layer using Databricks
  • Provide guidance to the development team on the detailed solution design
  • Provide inputs for the roadmap and executions based on technology dependencies
  • Work with the SMEs to implement data strategies and build data flows
  • Manage data related requests, analyze patterns and provide efficient resolution. Design all program specifications and collaborate with program delivery teams
  • Evaluate all functional requirements, map documents, and troubleshoot all development processes.
  • Conduct full technical discovery, identifying pain points, business and technical requirements, “as is” and “to be” scenarios.

Position Qualifications:

  • 15+ years of experience in consultative/complex deployment project, architecture, design, implementation and/or support of data and analytics solutions
  • Hands on development Design and Develop applications using Azure ADF Databricks
  • In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
  • Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.
  • Experience in public cloud service offerings (IaaS, PaaS, DBaaS services as well high-level product offerings such, as Microsoft Azure, AWS or Google Cloud Cloud)
  • Modern API cloud design
  • Modern data architectures
  • In depth understanding of Azure cloud and Data lake and Analytics solutions on Azure
  • Able to build ingestion to ADLS and enable BI layer for Analytics
  • Strong understanding of Data Modeling and defining conceptual logical and physical data models

Nice to have

  • Strong Experience in public cloud service offerings (IaaS, PaaS, DBaaS services as well high-level product offerings such, as Microsoft Azure)
  • Infrastructure as Software (Container Orchestration, Observability, CI/CD)
  • Modern security practices
  • Modern API cloud design
  • Modern data architectures (e.g. event driven architectures, data democratization, cloud approaches to support ML/AI at scale, stream processing, and integrating real time analytics into customer applications)


Client : Undisclosed

             

Similar Jobs you may be interested in ..