Job Description :
Primary Skillset : Azure Data Bricks, Azure Data Lake, PySpark, SparkSQL, SQL. Secondary Skillset: Domain knowledge in CRM Detailed JD: Should be good at Querying spark tables using Python (Python API to using Spark) Concept of Big data using Apache Spark and DataBricks. Strong knowledge in Pyspark. Strong in DataBricks Writing effective, scalable code Developing back-end components to improve responsiveness and overall performance Integrating user-facing elements into applications should have experience using server-side logic and work well in a team. Integrate user-facing elements into applications Test and debug programs Improve functionality of existing systems Implement security and data protection solutions Assess and prioritize feature requests Coordinate with internal teams to understand user requirements and provide technical solutions Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks Delivering and presenting proofs of concept to of key technology components to project stakeholders.