Job Description :
Role: BigData Developer Location: East Hanover, NJ Deliverables: Must have a minimum of 7 years of experience working in software engineering role with the following experience Python Application Dev -Restful API/endpoint using Flask or Django; used some ML libraries like pandas, spark, sparkML Big data Processing using technologies like spark, hadoop, s3, aws, pyspark Streaming technology exposure -Kafka/Kinesis firehose, spark streaming/structured streaming Container Technologies: Docker, Kubernetes Any experience with RDBMS,SQL, Databricks, Data-iku, Airflow is nice to have. Minimum: Experience using Python IDEs, debugging, error-handling and Python integration with Cloud services 5+ years Experience in Python or Py-Spark scripting to handle data load / extraction, transformation and loading 5+ years Experience in AWS technologies such as API Gateway, EMR Cluster, AWS S3, Glue, Athena, and AWS Analytics 2+ years Big data related technologies like HIVE, Spark, ETL, Hadoop, RedShift 2+ years Data Streaming/Processing: Kinesis/Kafka/SQS, Spark CICD: Jenkins, GitHub/Bitbucket Container Technologies: Docker, Kubernetes