Job Description :
Direct Client

This is a Sr level position

Need to have atleast 10 years of total EXP

Need to go Face to Face interview

NYC NY

2+ years of building large scale data-processing systems with experience in Big Data technologies such as MapReduce, Hadoop, AWS EMR, S3, Spark, Kafka, or equivalent Distributed, fault-tolerant architectures (Spark or Hadoop ok)

Experience in Database technologies such as Vertica, Teradata, Athena, MySQL, AWS Redshift with proficiency in SQL 3+ years and proficiency in Java, Scala or Python on Linux Platforms Basic knowledge of Informatica Good exposure to Data Modelling ( Star , Snowflake, SCDs ) Collect, process and cleanse data from a wide variety of sources.

Transform and convert unstructured data set into structured data for algorithm input. Evaluate the effectiveness of user experiences, determining what data is needed and how to collect it. Proficiency in shell scripting Experience with data warehousing, streaming architecture, ETL pipelines and workload scheduling (Tidal, Airflow)