Job Description :
Title : Data Engineer w/ Streamsets
Location: Montvale, NJ
Position Type : Contract
NEED 8+
A strong technically-oriented individual to work as a Data Engineer with St=
reamsets experience or deep interest a plus for a requirement with below ex=
pectations:
* Design, build, and deploy new data pipelines within Big Data =
Eco-Systems
* Documents new/existing pipelines, Data Sets and Data Sets
* Abides by department development standards and SOP''s.
* Attends all department meetings
* All other duties as assigned.
* Keeps updated on latest technologies relevant to position''s d=
uties.
* Has great knowledge of commonly used software concepts and de=
sign
* Great understanding of the development lifecycle
* Keeps management updated on projects and assigned work
Technology and Traits:
* Linux
* Hadoop (hdfs, hive, spark, sqoop)
* SQL and HiveQL
* noSQL (Mongodb, Cassandra, or Couchbase)
* Neo4j
* Git
* Python or Scala, Java
* ESSENTIALS -> STREAMSETS
* Bonus: Kafka, Kinetica
* Excellent written and verbal communication skills
* Excellent troubleshooting ability
* Strong work ethic and positive attitude.
* Professional demeanor
* Ability to work under stressful situations.
* Mentally strong and able to cope with many challenges.
* Performs and completes variety of tasks under a fast-paced en=
vironment.
* Excellent troubleshooting and verbal and written communicatio=
n skills.
* Commitment to the success of assigned projects, co-workers an=
d the company.
Experience:
* At least 4 years experience of designing, building, and deplo=
ying production-level data pipelines using tools from Hadoop stack (Hive, S=
park, Sqoop
* Preferred: Cloudera Certified Data Engineer, i.e. CCP Data En=
gineering Exam
* At least 4 years experience with various noSQL databases (Mon=
goDB, Couchbase, Cassandra, Neo4j)
* At least 2 years experience with SQL databases and Change Dat=
a Capture
* At least 5 years experience with production-level programming=
(python or scala or java)
* At least 4 years experience troubleshooting JVM-related issue=
s
* Experience and strategies to deal with mutable data in Hadoop=
is preferred
* Experience with Kafka, Kinetica, Streamsets preferred
* Understanding and experience of Agile and DevOps methodologie=
s preferred