Job Description :
Need an Data Engineer (Python, SQL, ETL) @
Contract
We are developing an unprecedented data insight and personalization platform for sales and marketing. We are poised to fundamentally change how our business understands and improves their marketing and sales strategy and customer experience. Our technology enables business users to observe, explore, and extract insights from customer behavior across channels, programs, and time. We have built a remarkable product with advanced capabilities in user interaction, machine learning, and data management. Our team is creative, daring, and collaborative. You will have the chance to work on exciting new development projects with a talented team.
What You Will Be Doing
- Own the data you are getting and make it load into the system smoothly and efficiently
- Build your ingestion code in Python and support your quality with unit-tests and integration-tests
- Find the golden line for your ingestion code to be generic and able to easily accommodate new data structures in the future, yet execute in an efficient way that runs fast
- Work with data scientists about their data in cases where the data is missing or distorted. Be creative and seek for ways to curate the data and use it as best as possible even with distortion
What You Need for this Position
We''re looking for a Data Engineer, with experience with data ingestion using Python. We''re looking for someone who would not rest until the data is clean, accurate and validated. Someone who understands that data and the quality of the data impacts the entire product and is a key factor for the company''s success. We need someone with experience and knowledge of:
- Writing Python code for data ingestion or data processing at scale
- Pandas/numpy experience is an advantage
- Jupyter notebooks experience is an advantage
- Multithreading/multiprocessing in Python is an advantage
- Data formats: CSV, JSON, XML and how to validate and parse them
- Familiarity with different implementations of different data models (graph, relational, document) and have an opinion on when to use them
- Familiarity with ETL and data mapping concepts
- Experience with SQL databases
- AWS experience, such as S3 is an advantage
- Web scraping experience is an advantage
- Knowledge of common agile practices and GIT, JIRA, or similar is an advantage