Job Description :

Job Title: Data Engineer

Location: Remote

Duration: 12+ Months

Job Description:

Challenges you will work on:

  • Design and develop business-critical backend systems using stream processors and high-quality data pipelines.
  • Work in a cross-functional team of engineers and scientists to design and code large-scale batch and real-time data pipelines.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
  • using SQL and AWS ‘big data’ technologies.
  • Build a cloud-native, real-time stream processing & data lake platform that scales into the Petabytes and beyond.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency,
  • and other key business performance metrics.
  • Perform code reviews, and lead by example on code refactoring for readability, extensibility, and testability
  • Lead your products, with a focus on DevOps and robust automation
  • Build processes that support data transformation, workload management, data structures, dependency, and metadata

Who you are:

  • We are looking for a candidate with 5+ years of experience in a Data Engineering role, who has attained a Graduate degree in Computer
  • Science, Statistics, Informatics, Information Systems, or another quantitative field. They should also have experience using the following

software/tools:

  • Strong verbal and written communication skills
  • Experience with relational SQL(Hive/Presto) and NoSQL (Dynomodb/Redis)
  • Experience with data pipeline and workflow management tools: Airflow
  • Experience with AWS cloud services: EC2, S3
  • Experience with object-oriented/object function scripting languages: Scala, Python, etc.
             

Similar Jobs you may be interested in ..