Job Description :
Role- Python Developer with AWS
Location- Jersey city,NJ
Duration- 12+ Months,
Search for Python developer with AWS and Big data exepreince,
Duration 1 Year
Location Jersey City, NJ
Key Responsibilities
Develop an AWS Cloud platform that will support Big Data processing and analytics
Partner with the Data Science team to investigate and implement advanced statistical models and machine learning pipelines
Implementing, maintaining and improving ETL/DDL processes
Monitoring performance and costs; and advising any necessary infrastructure changes
Working with the various internal teams to deliver various analytical needs by building both large systematic reports and small custom pieces
Mandatory Skills / Qualification
8+ years of experience in architecting, building and maintaining software platforms and large-scale data infrastructures in a commercial or open source environment
Excellent knowledge of Python and pandas/numpy libraries
Experience with integration of data from multiple data sources, knowledge of various ETL techniques and frameworks
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Comfortable and Hands on experience with AWS cloud (S3, EC2, EMR, Redshift, etc
At least 3 years'' experience in Hadoop MapReduce or other big data technologies and pipelines (Hadoop, Spark/pyspark, R, MapReduce, NoSQL, Kafka, RDBMS, etc
Strong written and oral communication skills
Preferred Skills and Qualification
Understanding of Machine Learning and Data Science processes, techniques
Ability to work on multiple projects in parallel while meeting changing deadlines and priorities
ADVANTAGE
Bash Scripting
Experience in Java / Scala
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.