Job Description :
JOB DESCRIPTION:
Role: Big Data engineer
Duration: 12 months
Location: Santa Monica, CA
Interview: Phone + Skype
CANDIDATES have to complete the following tests to be considered.
As an Engineer, you will work on all parts of our data platform: data pipeline, data warehouse, API services, web application, mobile apps, and custom features.
Build and maintain well-engineered data systems that support UMG’s analytical needs; design and develop high performance ETL processes in AWS Data Lake and Google Big Query analytics environment.
Architecting and developing data pipelines, API, web/mobile apps, prototypes, or proofs of concepts (POCs)
You will work across the entire frontend and backend stack.
GENERAL QUALIFICATION:
Preferred Big Data Experience:
Proficient understanding of distributed computing principles
Experience with building batch and stream-processing systems, using solutions such as Spark, Storm/Spark-Streaming
Experience with Google Dataflow/Dataproc, or Amazon EMR, or Cloudera/MapR/Hortonwork
Good knowledge of Big Data querying tools, such as Hive, Impala, SparkSql
Experience with integration of data from multiple data sources
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Knowledge of various ETL techniques and frameworks, such as Flume or Camel
Experience with various messaging systems, such as Kafka or RabbitMQ
Experience with Big Data ML toolkits, such as Mahout, SparkML, or TensorFlow
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Preferred General Software Engineering Experience:
Expertise with any of the following languages: Java/J2EE, Python, GO, Node.JS, Scala
Expertise with any of the following UI technologies: HTML, CSS framework such as LESS, Sass, Javascript, JS frameworks – React, Relay & GraphQL
Expertise with the entire Software Development Life Cycle (SDLC)
5+ years experience with web services (consuming or creating) with REST or SOAP
Excellent communication skills: Demonstrated ability to explain complex technical issues to both technical and non-technical audiences
Expertise in the Software design/architecture process
Expertise with unit testing & Test Driven Development (TDD)