Job Description :
Senior Software Engineer with 5+ years’ experience in Apache Spark with Scala. Candidate should be able to :
· Create data pipelines; handling big data across multiple data sources.
· Design, Develop, Test, Deploy and maintain big data systems for enterprise products
· Code, participating in code reviews, enhancement discussion, maintenance of existing pipelines & systems, testing and bug-fix activities carried out on an on-going basis
· Nice to have experience in Cloud environment, work experience on Azure is a plus. Knowledge in Azure Data Factory will be a plus
· Candidate will deliver sprint work as defined by product backlog and prioritized by engineering leadership
· Experience with Azure Data Services: Azure SQL, BLOB, ADF (Azure Data Factory) and Cosmos DB is desired but not necessary
Qualifications and other skills:
· BS degree in CS or related engineering field
· Excellent communication and collaboration skills
· Passion for quality with strong customer empathy and focus
· Strong intellectual curiosity and passion about learning new technologies
Preferred skills
· Apache Kafka or Apache Spark
· Data manipulation of large amounts of unstructured data