Remote - Pyspark Developer

Remote, Work from Home Remote Work from Home 00000

Date : Nov-09-21

Remote - Pyspark Developer

Remote, Work from Home

Nov-09-21

Work Authorization

US Citizen
GC
H1B
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain :

IT/Software

Work Authorization

US Citizen
GC
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain : IT/Software

Apply Now

New York Technology Partners
Iselin, NJ
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Pyspark Developer

Location: Remote

Duration: Long Term Contract

Job Description:

Design and Developed real time streaming pipelines for sourcing data from IOT devices, defining strategy for data lakes, data flow, retention, aggregation, summarization for optimizing the performance of analytics products.
Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
Proficiency with Big Data processing technologies (Hadoop, Hive, or Databricks)
Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
Experience with SQL and relational databases
Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse
Experience in optimizing Hive SQL quarries and Spark Jobs.
Implemented various frameworks like Data Quality Analysis, Data Governance, Data Trending, Data Validation and Data Profiling with the help of technologies like Bigadata,Data Stage, Spark, Python, Mainframe with databases like Netezza and DB2,Hive & Snowflakes
Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram with MS Visio.
Having experience in delivering the highly complex project with Agile and Scrum methodology.
Quick learner and up-to-date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.

Hot Job

Remote - QA Developer/Analyst (Hybrid- P, Remote, Work from Home

Jun-27-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well Please find the job description given below and let me know your interest. Position: QA Developer/Analyst (Hybrid) Location: (Portland, OR) 4 days/ Week onsite Duration: 6-12 months Job Description Must Have Strong understanding of SDLC, Agile concepts and their interrelationships with QA practices Strong test definition and execution skills Strong knowledge of Quality assurance principles and best practices Should be self-sufficient at performing and dri

Hot Job

Remote - QA Developer Portland, OR (Hyb, Remote, Work from Home

Jun-29-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well, Please find the job description given below and let me know your interest. Position: QA Developer (Hybrid) Location: Portland, OR (4 days Onsite/week) Duration : 12 months Note Candidate must be already local to the Portland, Oregon area Job Description: Must Have Strong understanding of SDLC, Agile concepts and their interrelationships with QA practices Strong test definition and execution skills Strong knowledge of Quality assurance principles and best prac

Remote - Agile Project Manager/Scrum Mas, Atlanta, GA

Jun-07-25

JPS Tech Solutions LLC

($) : Market

Short Description: Project Manager/Scrum Master is responsible for leading and directing 2-3 Agile teams that support multiple Agile projects or one larger Agile project within the GTA organization. Job Description: JOB SUMMARY: Under the general direction of the PMO Office Director or Dev-Ops Office Director, the Project Manager/Scrum Master is responsible for leading and directing 2-3 Agile teams that support multiple Agile projects or one larger Agile project within the organization. In co

Hot Job

Remote - QA Automation Tester (Hybrid), Remote, Work from Home

Jun-27-25

DMS Vision, Inc.

($) : Market

Hi Hope you are doing well !! I have an urgent position. Kindly go through the Job description and let me know if this would be of interest to you. Role : QA Automation Tester (Hybrid) Location: Mesa, AZ (2 days on site Monday and Thursday) MUST BE ALREADY LOCAL TO THE AREA Duration : 6+ Months Must have LinkedIn Interview Process: First round over MS Teams and then final round in-person. Job Description: Tech Stack: C# with Selenium, JMeter/Postman, SQL, API Testing, and Azure DevOps

Remote - Architect, Remote, Work from Home

Jun-06-25

Intone Networks

($) : Market

Job title: Architect Location: CHARLOTTE, NC (2 DAYS Onsite) Long Term Experience: 7 to 10 Yrs Must have experience with similar platform engineering/management solutions: Building/optimizing Data LakeHouse with Open Table formats Kubernetes deployments/cluster administration Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS Distributed Systems, Microservice architecture, and containers Cloud Streaming use cases in Big Data Ecosystems (

GCP Data Engineer Dallas, TX or Hartford, Dallas, TX

Jun-13-25

Dynasticx LLC

($) : Market

GCP Data Engineer Location: Dallas, TX or Hartford, CT (if candidate is very good can try for remote as exception) Rate: $40/hr on W2 Only(No C2C) Long Term Contract The goal is to migrate data warehouse assets and ETL pipelines from Teradata to Google Cloud Platform (GCP The role involves hands-on development, testing, and optimization of data pipelines and warehouse structures in GCP, ensuring minimal disruption and maximum performance. Key Responsibilities: Lead and execute mig

[Already Applied]

Hot Job

DFA AWS Cloud Solutions Engineer, Little Rock, AR

Jun-30-25

Cook Systems International

($) : Market

Launch Your Career with Cook SystemsReady to elevate your career? Cook Systems, a certified veteran owned IT consulting firm, has been transforming businesses and careers since 1990. Whether you're aiming to work with a Fortune 500 company or a small business, we've got you covered.Our core values: integrity, investment, and innovation drive everything we do, ensuring you grow and succeed in a dynamic, supportive environment. We understand the importance of work life balance and personal growth.

Hot Job

Sr. Snowflake Data Engineer, Sacramento, CA

Jun-30-25

Global Soft Systems, Inc

($) : $60k - $130k/year

Role: Sr. Snowflake Data Engineer Location: Sacramento, CA Perform data engineering in support of a migration effort between client's legacy platform (in Microsoft) to Snowflake. Must have: AWS Glue as the ETL Tool AWS S3 Snowflake MQ: At least three (3) years of experience in developing and monitoring data pipelines, ETL/ELT (Extract Transform Load / Extract At least three (3) years of experience with Microsoft SQL Server and T-SQL. At least three (3) years of experience develop

Remote - Senior Application Operations E, New York, NY

Jun-26-25

Sonaevo LLC

($) : $60K-140K/ Year

Position: Senior Application Operations Engineer - Lev.3 Location: New York, NY (100% Remote) Duration: 12 months Rate: Quote your best Resource Must provide Three (3) Professional References; Work Authorization & Valid Photo ID Job Description: The Application Operations Engineer is responsible for daily operational tasks including deployments, triaging issues, creating fixes, and resolving service tickets in a timely fashion. Also will also be responsible for maintaining up

[Already Applied]

Java Full Stack Developer with Node.js,, Mesa, AZ

Jun-18-25

DMS Vision, Inc.

($) : Market

Position: Full Stack Java Developer with node.js, React & AWS (Onsite) Location: Mesa, AZ 85201 (Local Only) Duration : 6-12 months Note -- Candidate must be a Arizona resident Only Job Description: Required Skills: 7+ years of full stack development experience Strong backend development in Java (Springboot/microservices) Proficient in React for frontend development AWS Lambda functions development in Node.js Comfortable working in Agile/Scrum environments RESTful API de