FULLTIME || Sr. Big Data Engineer /Architect -- Urgent || Boston ,MA
This will be replacement position and internal resource who was selected for this role has backed out. We need profiles asap for this. If the candidate is good, customer will fulfill the position quickly. Please send some acorss.
Key Responsibilities:
* Ability to design/develop based on business requirements by effectively coordinating activities between business analysts, developers and testing team.
* Architect data engineering pipelines and design various sourcing patterns using big data technologies * Uses advanced technical expertise in analyzing, designing, estimating, and developing software applications to project schedule.
* Independently undertakes critical development assignments across project areas.
* Participate in testing process - Perform in unit test case automation and execution in lower regions.
* Prepare Technical & functional design documents.
Required Qualifications:
* Must have minimum 8 number of years' experience in software development.
* Engineering degree in Computer Science or equivalent field from top schools.
* Extensive experience in Object Oriented Programming (Java, Scala, Python) * Hands on experience with Bigdata/ Hadoop - Spark, Scala, Hive, Impala, Oozie, etc is required.
* Experience in developing Spark jobs and Spark Streaming jobs is required.
* Experience in AWS - S3 is preferred
* Hands-on experience in CICD & Jenkins is required.
* Strong experience in Oracle, PLSQL & Unix is required.
* Excellent communication skills both verbal and written.
* Experience working in a geographically spread out team.
* Outstanding coding, debugging and analytical skills: Core problem solving skills, ability to analyze available data and potential solutions, eliminate possible solutions and select an optimal solution.
* Experience in installing, configuring, debugging and troubleshooting Hadoop clusters is desired skill.