Job Description :
Job Title: BI Data Engineer
Location: El Segundo, CA
Duration: 6+ Months
Responsibilities:
Collaborate with product teams and data analysts to design and build data-forward solutions
Build and deploy streaming and batch data pipelines capable of processing and storing petabytes of data quickly and reliably
Integrate with a variety of data metric providers ranging from advertising, web analytics, and consumer devices
Build and maintain dimensional data warehouses in support of business intelligence tools
Develop data catalogs and data validations to ensure clarity and correctness of key business metrics
Drive and maintain a culture of quality, innovation and experimentation
Deliver strong Python and SQL development and maintenance techniques surrounding data movement to include technologies
Investigate and understand different data sources and ability to connect to a wide variety of 3rd party APIs
Design, enhance and implement ETL/data ingestion platform on the cloud
Development of ETL source and target mapping design/specifications based on the business requirements. Create ETLs/ELTs to take data from various operational systems and create a unified/enterprise data model for analytics and reporting
Develop load and transformation processes in support of the requirements, validate that they meet business and technical specifications, manage ongoing maintenance of the system and data, and make recommendations for process improvements to optimize data movement from source to target
Provide production and operational support to existing ETL jobs. Monitor and manage production ETL jobs to verify execution and measure performance to assure ongoing data quality and optimization of the system to manage scalability and performance and identify improvement opportunities for key ETL processes.
Strong troubleshooting and problem-solving skills in large data environment
Capable of investigating, familiarizing and mastering new data sets quickly
Requirements:
The ability to sit for prolonged period of time and view computer screen.
Equipment/Software Used:
Microsoft Office Suite (Outlook, Word, Excel, PowerPoint)
SQL, MySQL or other relational databases
Linux, Python, AWS Stack (EC2, S3, Redshift)
Tableau or any other data visualization tool
SiteCatalyst (Omniture)/Google Analytics or any other web analytics tools experience (Nice to have)
Work Environment:
Work is performed in an office environment that is well lit and ventilated.