Apply Now

Econosoft Inc
San Jose, CA
Post Resume to
View Contact Details &
Apply for Job
Job Description :
Position: Sr. Data Architect
Location: New York City, NY
Interview: Phone & Skype
Duration: 3-6+ Month(s)

Skills: IOT Data, ESRI, Redis, Hadoop, Kafka, Elastic, Cloudera, DB2, SQL

Responsibilities
o You will be building IOT data ingestion pipelines using streamsets and python along with Redis all being ingested and indexed on elasticsearch along with leveraging HDFS for both raw and cooked versions of the data.

o Candidate with leverage ESRI for address enrichment and geocoding
o Candidate will use Redis in various places with streamsets as reference data.
o Candidate will have engagement with Developers, and customer lifting up machine learning and AI opportunities and making them real in the new platform.

o Will be responsible for documenting a all entities in Collabra (Enterprise Data Catalog)
o Candidate will work to ingest and transform data as needed into elasticsearch as well as storing data in Raw and cooked for in HDFS

4. Provide Qualification and Skill Requirements
o Experiences with Hadoop, Spark, Kafka, Redis and lambda style architecture should be a core competency. Candidate should be comfortable patterns such as lambda, Kafka and advanced stream transformation and filter.

Experience Onboarding data sources into a data lake and rationalizing canonical data models and documenting them in an enterprise data catalog will be critical. Concepts as per data lake architecture and building data warehousing platforms is a must.

Candidate should be able to demonstrate experience with various machine learning platforms and stacks.

Experience with Cloudera, Hortonworks, StreamSets and Elastic Search is a plus.

5. Share some language on the organizational culture
o This is a very unique opportunity to be central to a massive strategy digital transformation migrating from DB2 / SQL Type data warehousing.

The is a tremendous energy and excitement in this Matrixed team that not only cross many orgs but also involves working with many different partners such as Redlabs, Cloudera, StreamSets and others.

Client : N/A