Job Description :
Position Title: Data Engineer(2001438)
Location: New York, NY
Type : Contract
Position Description:
The Data Engineer of Turner Data Cloud will be responsible for partnering with Revenue Analytics to onboard and optimize datasets which will be used in the Looker digital analytics platform. To be successful in the role you’ll need to be intellectually curious, detail-oriented, open to new ideas, and possess a strong aptitude for quantitative methods. The role requires a strong statistical background, familiarity with modern data warehouses, experience with SQL-like tools, and knowledge of scripting languages (e.g., python Job Duties:
Create solutions to transform data from various sources and load it into platforms such as Hadoop to create a data lake
Create and maintain transformations to summarize/aggregate data and load these so users can consume this data using various BI/Analytics tools.
Develop and maintain standards for administration and operation including the scheduling, running, monitoring, logging, management of errors, recovery from failures, and validation of outputs.
Contribute to the project planning process by estimating tasks and deliverables.
Work closely with Revenue Analytics team members to understand user requirements.
Qualifications:
Required Skills: 4+ years solid experience as a database developer in OLAP environment. BS in computer science, math, physics or equivalent education/training/experience.
Expert knowledge in SQL; knowledge of HiveQL, SparkQL, Postgress SQL a plus
Self-starter, team oriented and very analytical
Experience with “big data” platform such as Hadoop, NoSQL DBs or cloud based tools such as Amazon Redshift.
Experience and comfortable with Unix/Linux operating systems
Expert in Python, Shell, Awk, Ruby, and/or Java programming
Specific application experience with media, Web analytics and consumer data systems will be a plus.
Experience working with statistical or machine learning packages (R, Python Scikit-learn)
Preference for prior technology or media company experience • Ability to partner with various teams (non-technical to technical)