Job Description :
Data Architect 4
Data Engineer 8
Streaming,IoT, Lamda, nosql, hadoop, cassandra, kafka, Elastic, Mango db, Spark, AKA
Coding Test is must for all positions ( Preferred companies.UBER, Twitter, Netflix, c3IOT)

Local to bayarea preferred
Detailed description
Job Title: Staff Data Engineer

Location: San Jose, CA



Overview

Part of the Enterprise Architecture team, this position will be responsible to build & deliver Microservices based Data Platform to support Autonomous Connected Vehicles. This position will be hands-on technical position to build the data services and will help advance how we design for data in our product and analytic solutions, as well lead product and internal business solutions that leverage big data and analytic technologies. This position is also responsible for leveraging strategic technology direction to develop and maintain the architecture for data domain and driving the adoption of new technologies considering present and envisioned business environment, technology strategy and objectives by researching technical trends and developments.
In this role, you will work with Nio’s unique, proprietary data sets; and have the opportunity to analyze large amounts of data and help derive insights and value from them.

Responsibilities

Build and manage Nio’s Data Services for the big data platform
Build large-scale batch and real-time data pipelines with data processing frameworks
Partner with data scientists to build an infrastructure/pipeline to collect and analyze all necessary data
Build tools for data scientists to access and use the platform
Lead designs for application solutions to solve both product and analytic needs
Leverage best practices in continuous integration and delivery
Help drive optimization, testing and tooling to improve data quality
Collaborate with other engineers, ML experts and stakeholders, taking learning and leadership opportunities that will arise every single day
Work in cross-functional agile teams to continuously experiment, iterate and deliver on new product objectives
Influence and advocate for the data ecosystem—how data should be optimized and leverage through the application and analytic platforms.
Lead solutions that leverage big data / Hadoop stacks, evaluate and advocate for fit-for-purpose usage of big data architecture for product and analytic solutions.
Stay current with big data architecture / product advances and advocate where appropriate.

Qualifications

Bachelor's degree in Computer Science or mathematics, statistics, data sciences or engineering with at least 5+ years of progressive experience in the industry
5 - 10 years of hands on software development experience, preferably in an enterprise application development environment shipping products to the market.
Solid understanding of Linux or Unix operating systems with expertise in programming languages preferably in Python, Scala, Java or R
3+ years of experience designing, building and operating in-production big data/stream processing and/or enterprise data warehouse is required
Demonstrated experience leading teams that analyze complex data related issues and/or logical data models in support of corporate and customer information systems requirements.
Solid understanding of methodologies and technologies that depict the flow of data within and between technology systems and business functions/operations.
Solid background in data integration, staging, quality and distribution.
Knowledgeable in various Data Integration and RDMS technologies.
Working knowledge using Cassandra, Hadoop, MySQL, MS SQL, PostgreSQL, MongoDB, Elastic Search and graph Databases.


Preferred Qualifications

Experience developing Restful web applications preferred
3+ years of experience using data management tools, including SQL/DBMS and NoSQL is required
Experience handling data with relational databases is preferred
Proficiency with HDFS and MapReduce is preferred
One+ year of experience with Apache Spark/Storm and NoSQL storage is preferred
Experience with big data platforms is preferred
Knowledge of machine learning/distributed systems is preferred


Client : N

             

Similar Jobs you may be interested in ..