Job Description :
? Proficient understanding of distributed computing principles
? Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
? ETL or Pipeline design/implementation with Large Distributed Databases (Hive/Spark/Scala preferred)
? Experience in data validation, sampling & regression tests
? Pipeline stability and performance tuning
? Working knowledge of relational databases and query authoring (SQL)
? Experience with Spark / Scala / Java is helpful
? Love to use and develop open source technologies like Kafka, Hadoop, Hive, Presto, and Spark
? Rigor in high code quality, automated testing, and other engineering standard methodologies
? Payment data processing or system design knowledge is a plus (not required)
? Experience with NoSQL databases, such as HBase or Cassandra is a plus (not required)
? Outstanding interpersonal skills
? BS/MS/PhD in Computer Science or a related field (ideal)