Job Description :

Contract Description
We are looking for a contract Senior Data Engineer for a client engagement. This Data Engineer will possess strong experience with GraphDB (Neo4j) along with Azure Data Lake, ETL, ELT, and DataFlow.

RESPONSIBILITIES

 

Work with architects, other data engineers and analysts to identify, engage, and integrate data sources for discovery and profiling and, where necessary and define data services that empower business processes.
Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions.
Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning, to better define and curate models, test hypothesis, and deliver key insights.
Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.
Partner with business analysts, application engineers, data scientists, leveraging the appropriate tools, solutions, and/or processes as part of their data mining, profiling, blending, and analytical activities.
Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.

Qualifications


QUALIFICATIONS

8+ years of progressive data application development, data modeling, data pipeline development, ETL experience.
Strong Experience with GraphDB (Neo4j) needed.
Expert as an Azure ETL Data Engineer, with the following skills - o Synapse Analytics, o Azure Data Factory, o Databricks, PySpark & Python o Azure Data Lake, o Delta Lake, o CI/CD experience for all these services
Experience working in large scale/distributed SQL, NoSQL, and/or Hadoop environments.
2+ years of experience modeling and implementing ETL / ELT on columnar MPP database technologies.
Experience with streaming architectures e.g. Kafka, Stream, PubSub.

 

             

Similar Jobs you may be interested in ..