Job Description :

Position: Cloud Data Engineer

Location: Remote

Duration: 6 Months

We are looking for a savvy Cloud Data Engineer to join our growing Hashmap team of data professionals. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Cloud Data Engineer will support our software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be quick learners, self-directed and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives.

Major Duties & Responsibilities

  • Develop, construct, test, and maintain ETL/ELT architectures
  • Work with Architects to ensure development work aligns with business requirements
  • Data acquisition and ingestion for data at rest or streaming data
  • Develop data set processes
  • Use programming language and tools
  • Identify ways to improve data reliability, efficiency, and quality
  • Conduct research for industry and business questions
  • Use large data sets to address business issues
  • Possibly deploy sophisticated analytics programs, machine learning, and statistical methods
  • Prepare data for predictive and prescriptive modeling
  • Find hidden patterns using data
  • Use data to discover tasks that can be automated
  • Deliver updates to stakeholders based on analytics

Must have the following skills

  • SQL
  • Python
  • Azure Databricks
    • Scaling
    • Tuning
    • Cluster sizing up/down

Knowledge of Google Big Query would be a plus.

This consultant would help us gain a deeper knowledge of how we can better setup our

             

Similar Jobs you may be interested in ..