Job Description :
Proven expertise in writing Spark based data pipeline with the latest releases of Spark SQL, Spark Streaming and various ecosystem things such as ORC, Sequence files, Parquet. The gotchas
Background in coding with Java and/or Scala as well.