Job Description :
Role: Big Data Architect
Location: Parsippany, NJ
Duration: 6 month contract
Interview: Phone then Skype
Job Description
· Design big data pipelines architecture including data ingestion, streaming data processing, batch data transformation, data integration with structured and non-structured data sources
· Setup and configure big data platform components and their communications with related data and application systems
· Design templates and develop examples of specific big data processing job according to business application and technology requirement
· Good communication and business skills
Qualifications
· Experience with Hadoop ecosystem technologies including Hadoop, HDFS, Spark, Spark Streaming, Kafka
· Experience with developing Spark applications, Spark data processing technologies (RDD, Dataframe, SparkSQL)
· Solid understanding of parallel data processing and distributed file systems, Java and python programming skills.
· Experience with big data technologies in either Google Cloud (Big Query, Pubsub, Dataflow) or Azure (HDInsight, EventHubs
· Nice to have experience with NoSQL technologies, Cassandra etc