Job Description :

Seeking an experienced Data Engineer with a proven record of developing advanced reporting data models on complex, disparate systems, preferably in a Big Data warehouse environment.

The candidate will be a member of a team developing and evolving an internal business intelligence infrastructure for large online media store. The data models developed by this team

will supply information to engineering, business operations, and external content providers regarding status of online media, including incoming and outgoing volume, workflow status, and

availability status.

RESPONSIBILITIES

  • The specific responsibilities of the Data Engineer position include, but are not limited to, the development and deployment of data models and reports that provide business intelligence to engineering and operations groups.
  • Investigation, profiling, and resolution of performance bottlenecks attendant to usage of the databases, either when loading or extracting.
  • This will likely involve interaction with key users to ensure that performance is suited to their particular needs.
  • Implementation of extracts and reports from the production databases, in support of repeated, periodic, automated requests, as well as ad-hoc requests as needed by key stakeholders.
  • Development of data models using Oracle that summarize complex data into usable, digestible datasets, dashboards, and reports.

REQUIRED SKILLS

Strong experience writing SQL on Oracle

Strong experience writing Oracle PLSQL

Experience with Spark SQL

Experience with Hadoop/HDFS

Familiar with job scheduling systems for orchestrating data pipelines

Experience writing shell scripts

Skilled in advanced SQL performance tuning, particularly involving complex PLSQL development, capable of re-writing SQL to reduce execution time.

Strong understanding of distributed transactions between Oracle databases.

Proficiency in OS X and Linux server environments.

Minimum of 4 years developing SQL reports.

DESIRABLE SKILLS (not required):

Familiar with Azkaban, Trino, Hive, Kubernetes

Familiar with Cassandra, MongoDB, and SOLR

Knowledge of online media (video, music, publications, etc)

Able to solve problems independently using available resources.

Pro-actively seeks to develop solutions to complex problems

             

Similar Jobs you may be interested in ..