Job Description :
Client: Cygnus
Rate: Market
new position 09/26 - rk_asc_cy_nj
Apache Spark Consultant
Somerset, NJ
Long Term
Phone/Webcam
Locals are highly preferred
Job Description:
The Back-End Scala Architect designs and develops code alongside with Solutions Experts. The Architect will be analyzing the existing architecture, improve the performance of the jobs, optimize the code written in Scala, developing tools to support complex analytics, simulation modeling, deep learning, and artificial intelligence. Specific development tasks will range from core service development and improvements to near real-time and batch-oriented data processing for analytics and simulation modeling.
Responsibilities include:
- Deploy the Spark Jobs on HDInsight
- Optimize the Spark Jobs written in Scala
- Suggest and Apply Security mechanism to the jobs and the data
- Develop Scala applications and services using tools like Akka and Akka HTTP for RESTful services
- Develop Scala application to interact with Cassandra, Redis Cache and Blob Storage
- Develop state-of-the-art analytics tools to support diverse tasks ranging from ad hoc analysis to production-grade pipelines and workflows for customer applications
- Improve performance and reliability of advanced algorithms
- Ensure high performance and availability of distributed systems and applications
- Interact directly with client project team members and operational staff to support live customer deployments
Must Have:
- Strong Apache Spark Architecture Skills
- Experience in deploying jobs to HDInsight
- Strong Scala experience
- Experience with distributed systems, scalability, and fault tolerance
- Experience with end-to-end performance profiling and optimization