Job Description :

The Role

We are looking for a Senior Data Engineer to join our highly visible Data Services team. Data is at the core of our business and the person in this role will design and develop next generation big data that is scaled and modeled for efficiency. We work in an agile environment interacting with multiple technologies and business areas. In this role, you will work closely with the Analytics and Product teams to understand our data, build and productionize models, fine tune them for better effectiveness and build for scalability and stability. You will continue to improve on our offline and real-time processing of data; developing trust, reliability and dependency on our data. Join us on a challenging, yet rewarding mission where you can help drive our business from its very core.

What You'll Do

  • Foresee and architect a robust, reliable and scalable data pipeline, bringing maintainable cloud centric performant solutions
  • Ensure accuracy of data and work to identify/mitigate recurring issues
  • Use agile, scalable and maintainable solutions such as Data Vaults for modeling data
  • Collaborate with product and data science teams to model data based on usage
  • Translate business concepts to technical solutions that align with stakeholders' needs
  • Help tune performance and scalability of big data applications while optimizing for cost
  • Research and evaluate new tools and technologies to solve complex business problems
  • Ensure applications and systems built/released are compliant with security and audit standards
  • Exhibit interest and tenacity in exploring key opportunities for next generation technologies and develop prototypes to demonstrate product ideas

What You Bring to Us

  • 5+ years of industry experience with a master's degree in CS or equivalent with focus on cloud technologies, object-oriented or functional programming
  • Strong engineering skills with a solid understanding of core computer science fundamentals, high performance data structures and algorithms, object-oriented concepts, Java and Python
  • Capable of building stable and scalable high-performance services
  • Experience designing and evaluating heuristics to deal with natural language, machine learning, and databases
  • Strong interest and tenacity for identifying problems and developing innovative solutions.
  • Experience with Agile methodologies (Scrum, Kanban)
  • Experience with CI/CD tools (GitLab, Jenkins)
  • Strong communication skills with the ability to articulate, diagram and document
  • Bonus points if you have experience with Kubernetes workflows, AWS, Spark, Airflow, Argo, data modeling and understand machine learning

Required Skills : Software Engineer Experience: Python (java is a plus) Cloud Database: (AWS/Snowflake) Agile Methodologies and CI/CD pipelines Machine learning and NLP (Natural Language Processing)
Basic Qualification :
Additional Skills : 100% Remote
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :100% Remote
Project Verification Info :
Candidate must be your W2 Employee :No
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :Big Data: Dev
Branch Code :East Bay

Similar Jobs you may be interested in ..