Job Description :
Hope you been
Reach me : mahipal dot pasham at criticalriver dot com

Big Data Engineer
Location: Sunnyvale and San Bruno
2 positions
As an Big Data engineer, you will be responsible for working on applications and services that handle all types of Walmart Labs transactions. You will work in a fast-paced environment where continuous innovation and experimentation are a given. You will master both established and cutting-edge technologies like Hive, Spark, Presto, Hadoop, Oracle, Casandra, Storm, Kafka, Druid, MongoDB, CouchBase among others.
Responsibility
Working with and extracting value from large, disconnected and/or unstructured datasets
Strong interpersonal skills and ability to project manage and work with cross-functional teams
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets involving petabyte and terabyte of data.
Should have basic understanding of various data science modules and process.
Experience in building micro services and rest endpoint development
Requirements:
Minimum of 7 years experience in architecture, design, and development of Big data systems using Java/Scala/Spark, working on systems that are distributed, highly available, performant and scalable.
Strong experience with MapReduce, HDFS, Hadoop, and Hive are required.
Experience with designing and implementing large-scale systems to process Terabytes to Petabytes of data.
Relational database experience preferably Teradata and demonstrated abilities in SQL and data modeling are required.
Proficiency with NoSQL.
Strong experience with data deep dives and product analytical skills are required.
Experience E2E automation of data pipelines is required


Client : N/A

             

Similar Jobs you may be interested in ..