Job Description :

We are looking for a senior Pyspark/DataBricks Developer with the following qualifications:

  • The developer must have sound knowledge in Apache Spark and Python programming
  • Good knowledge on ADLS Azure Blob Storage Azure Data Factory Azure Functions Synapse DW Azure SQL DB Event Hub SQL Databricks etc
  • Build large scale batch and data pipelines with data processing frameworks in Azure or AWS cloud platform
  • Developing highly scalable highly performant instrumented and accurate data pipelines
  • Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations
  • Strong analytical problem solving and unit testing skills
  • Experience in deployment and operationalizing the code is added advantage

Experience:

  • Up to 4-7 years of working experience in Databricks Python Spark Scala
  • The developer must have sound knowledge in Apache Spark and Python programming
  • Deep experience in developing data processing tasks using pySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations

Experience in deployment and operationalizing the code is added advantage

,

 

Shashank Jaitly

Symphony Enterprises LLC | Global Business and IT Consulting Company
  I 

WMBE & NWBE Certified Company

National Association of Women Business Owners (NAWBO)

MBE/WBE/8(a) certified Company

             

Similar Jobs you may be interested in ..