Remote - Pyspark Developer

Remote, Work from Home Remote Work from Home 00000

Date : Nov-09-21

Remote - Pyspark Developer

Remote, Work from Home

Nov-09-21

Work Authorization

US Citizen
GC
H1B
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain :

IT/Software

Work Authorization

US Citizen
GC
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain : IT/Software

Apply Now

New York Technology Partners
Iselin, NJ
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Pyspark Developer

Location: Remote

Duration: Long Term Contract

Job Description:

Design and Developed real time streaming pipelines for sourcing data from IOT devices, defining strategy for data lakes, data flow, retention, aggregation, summarization for optimizing the performance of analytics products.
Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
Proficiency with Big Data processing technologies (Hadoop, Hive, or Databricks)
Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
Experience with SQL and relational databases
Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse
Experience in optimizing Hive SQL quarries and Spark Jobs.
Implemented various frameworks like Data Quality Analysis, Data Governance, Data Trending, Data Validation and Data Profiling with the help of technologies like Bigadata,Data Stage, Spark, Python, Mainframe with databases like Netezza and DB2,Hive & Snowflakes
Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram with MS Visio.
Having experience in delivering the highly complex project with Agile and Scrum methodology.
Quick learner and up-to-date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.

Need Data Engineer, Frisco, TX

Aug-19-25

AETG Services PVT LTD

($) : $55/Hr.

Role: Data Engineer Location: Frisco, TX Duration: 6 Months Job Description Engineers in this role accomplish business objectives by monitoring system functions from all points of system processing, identifying, and assisting in solving processing problems. The engineer works closely with internal partners and external clients by providing technical assistance on products and services, department reporting and process trending. They are responsible for otimizing Python/PySpark in a Had

[Already Applied]

Hot Job

Senior AWS Data Engineer opening in Colu, Columbus, OH

Sep-17-25

Robotics technology LLC

($) : Market

Job Summary We are seeking a highly skilled Senior Data Engineer with strong expertise inAWS cloud services, Python, and PySpark to join our team in Columbus, OH. The ideal candidate will design, build, and optimize scalable data pipelines, ensuring high data quality, performance, and reliability. This role requires hands-on technical expertise, strong problem-solving skills, and the ability to collaborate across business and technology teams. Key Responsibilities Design, develop, and

Hot Job

QA Automation Engineer, Alpharetta, GA

Sep-17-25

Robotics technology LLC

($) : 70$

12+ years of proven work experience in QA with an emphasis on QA automation. 5+ years of demonstrable experience in automation technologies including Rest Assured, Playwright, Selenium, Junit, TestNG, Gherkin, JMeter etc. and scripting languages (Java, Python) Strong experience in services/API testing and automation In-depth knowledge of test management software (e.g., Jira and xRay) Proficiency in usage of SQL queries for databases or large datasets Expertise with CI tools (GitHub, Te

Need Software Engineer ( AI/ML), Frisco, TX

Aug-18-25

AETG Services PVT LTD

($) : $55/Hr.

Role: SW Engineer ( AI/ML) Location: Frisco, TX - 100% REMOTE Duration: 6 Months Visa: No OPT, CPT, H1B, H4 Job Description Engineers in this role accomplish business objectives by monitoring system functions from all points of system processing, identifying, and assisting in solving processing problems. The engineer works closely with internal partners and external clients by providing technical assistance on products and services, department reporting and process trending. They are r

[Already Applied]

Hot Job

QA Automation Engineer, Cincinnati, OH

Sep-17-25

Robotics technology LLC

($) : 70$

We are looking for a highly skilled QA Automation Engineer IV with strong expertise inETL automated testing, test frameworks, and modern QA practices. The successful candidate will work closely with cross-functional teams to review requirements, develop and execute automated test cases, and ensure the delivery of high-quality software solutions. Primary Responsibilities: Review requirements, specifications, and design documents to provide comprehensive feedback. Participate in requirem

Remote - ERP QA Testers Washington DC (, Remote, Work from Home

Aug-30-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well, Please find the job description given below and let me know your interest. Position: ERP QA Testers (Hybrid) Location: Washington DC (3 days Onsite) Duration : 6+ months Note - Relocation will be workable Job Description: We are looking experienced testers to join our dedicated project team to develop, execute releases and to ensure that the delivered system meets business requirements. Key Responsibilities: Execute functional testing during implementation of Ora

Remote - ERP QA Testers Washington DC (, Remote, Work from Home

Aug-24-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well, Please find the job description given below and let me know your interest. Position: ERP QA Testers (Hybrid) Location: Washington DC (3 days Onsite) Duration : 6+ months Note - Relocation will be workable Job Description: We are looking experienced testers to join our dedicated project team to develop, execute releases and to ensure that the delivered system meets business requirements. Key Responsibilities: Execute functional testing during implementation of Ora

Hot Job

ETL designer with GCP (Telecom is prefer, Mclean, VA

Sep-17-25

Robotics technology LLC

($) : $70

Job Title: ETL designer with GCP (Telecom is preferred) Location: McLean, VA Experience: 12+ years Job Description: We are seeking a highly experienced ETL designer to join our team. The ideal candidate will have over 12-15 years of experience in designing and implementing data solutions, with a strong focus on cloud data warehousing and real-time data processing. This role requires advanced knowledge in various data technologies and the ability to translate business requirements into

Hot Job

Remote - Sr. QA Automation Engineer (Hyb, Remote, Work from Home

Sep-17-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well, Please find the job description given below and let me know your interest. Position: Sr. QA Automation Engineer (Hybrid) Location: Houston TX (3 days Onsite/week) Duration : 6+ months Job Description: Minimum Requirements and Wow Factors We are seeking highly skilled Quality Assurance (QA) Specialist to ensure our software deliverables consistently meet the highest industry standards. This role involves designing and executing automated test plans, interpreting

Hot Job

IT Application Solutions Architect, Sabetha, KS

Sep-17-25

Robotics technology LLC

($) : Market

IT Application Solutions Architect Sr. (Hybrid – EST Time Zone) Location: Candidates must be able to travel to Washington, DC on an as-needed basis for important SAFe ceremonies such as PI Planning. Note: This is not a 100% remote role. 12 Months Important Notes We have transitioned to SAFe (Scaled Agile Framework) and strongly encourage candidates with SAFe training or certification. Contractors are expected to: Keep their camera on for the majority of meetings. Fully engage as