Remote - Pyspark Developer

Remote, Work from Home Remote Work from Home 00000

Date : Nov-09-21

Remote - Pyspark Developer

Remote, Work from Home

Nov-09-21

Work Authorization

US Citizen
GC
H1B
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain :

IT/Software

Work Authorization

US Citizen
GC
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain : IT/Software

Apply Now

New York Technology Partners
Iselin, NJ
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Pyspark Developer

Location: Remote

Duration: Long Term Contract

Job Description:

Design and Developed real time streaming pipelines for sourcing data from IOT devices, defining strategy for data lakes, data flow, retention, aggregation, summarization for optimizing the performance of analytics products.
Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
Proficiency with Big Data processing technologies (Hadoop, Hive, or Databricks)
Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
Experience with SQL and relational databases
Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse
Experience in optimizing Hive SQL quarries and Spark Jobs.
Implemented various frameworks like Data Quality Analysis, Data Governance, Data Trending, Data Validation and Data Profiling with the help of technologies like Bigadata,Data Stage, Spark, Python, Mainframe with databases like Netezza and DB2,Hive & Snowflakes
Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram with MS Visio.
Having experience in delivering the highly complex project with Agile and Scrum methodology.
Quick learner and up-to-date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.

Hot Job

Sr Python Developer, Jamaica, NY

Jul-09-25

Unique Comp Inc.

($) : $75-80

UCI's Direct client is looking for Sr. Python Developer with following qualification experience and long-term project inJamaica Central Control, New York. JOB SUMMARY:The qualified candidate will be working in the Revenue Fare Management Systems team performing back-office web application development. Their work will support the Rail Road's legacy revenue applications and aid in ramping up development efforts for the New Fare Payment System project and the roadmap to merge and unify LIRR and M

[Already Applied]

Hot Job

Need submission details for Software Dev, Charlotte, NC

Jul-11-25

Nukasani Group Inc

($) : Market

Dear Partner, Good Morning ,Greetings from Nukasani group Inc !, We have below urgent long term contract project immediately available forSoftware Developer (Python/.NET), Charlotte, NC, Hybrid need submissions you please review the below role, if you are available, could you please send me updated word resume, and below candidate submission format details, immediately. If you are not available, any referrals would be greatly appreciated. Interviews are in progress, urgent response is apprec

Hot Job

Remote - AWS Cloud Engineer Hybrid in R, Remote, Work from Home

Jul-11-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well, Please find the job description given below and let me know your interest. Position: AWS Cloud Engineer Hybrid in Raleigh, NC (Local only) Location: Hybrid in Raleigh, NC (Local only) Duration: 12+ months project Visa: Open Note: Job Description DHHS-ITD is seeking an AWS Engineer specializing in Data modernization using cloud solutions on AWS. DHHS-ITD is seeking an AWS Engineer specializing in Data modernization using cloud solutions on AWS .This role wi

Remote - QA Developer/Analyst (Hybrid- P, Remote, Work from Home

Jun-27-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well Please find the job description given below and let me know your interest. Position: QA Developer/Analyst (Hybrid) Location: (Portland, OR) 4 days/ Week onsite Duration: 6-12 months Job Description Must Have Strong understanding of SDLC, Agile concepts and their interrelationships with QA practices Strong test definition and execution skills Strong knowledge of Quality assurance principles and best practices Should be self-sufficient at performing and dri

Remote - QA Developer Portland, OR (Hyb, Remote, Work from Home

Jun-29-25

DMS Vision, Inc.

($) : Market

Hi, Hope you are doing well, Please find the job description given below and let me know your interest. Position: QA Developer (Hybrid) Location: Portland, OR (4 days Onsite/week) Duration : 12 months Note Candidate must be already local to the Portland, Oregon area Job Description: Must Have Strong understanding of SDLC, Agile concepts and their interrelationships with QA practices Strong test definition and execution skills Strong knowledge of Quality assurance principles and best prac

Remote - QA Automation Tester (Hybrid), Remote, Work from Home

Jun-27-25

DMS Vision, Inc.

($) : Market

Hi Hope you are doing well !! I have an urgent position. Kindly go through the Job description and let me know if this would be of interest to you. Role : QA Automation Tester (Hybrid) Location: Mesa, AZ (2 days on site Monday and Thursday) MUST BE ALREADY LOCAL TO THE AREA Duration : 6+ Months Must have LinkedIn Interview Process: First round over MS Teams and then final round in-person. Job Description: Tech Stack: C# with Selenium, JMeter/Postman, SQL, API Testing, and Azure DevOps

Hot Job

Remote - Accela Quality Assurance (QA) A, Remote, Work from Home

Jul-11-25

SoftPath Technologies LLC

($) : Market

Accela Quality Assurance (QA) Analyst / Tester Location: Seattle, WA Primarily remote. However, the client may require occasional on-site presence on short notice, and all proposed candidates must be able to accommodate such visits. Duration: Five-years contract Candidates who can work independly are more preffered Perform testing and regression testing of new and existing solutions. Document and track defects. Participate in the creation of new functional and technical specification

GCP Data Engineer Dallas, TX or Hartford, Dallas, TX

Jun-13-25

Dynasticx LLC

($) : Market

GCP Data Engineer Location: Dallas, TX or Hartford, CT (if candidate is very good can try for remote as exception) Rate: $40/hr on W2 Only(No C2C) Long Term Contract The goal is to migrate data warehouse assets and ETL pipelines from Teradata to Google Cloud Platform (GCP The role involves hands-on development, testing, and optimization of data pipelines and warehouse structures in GCP, ensuring minimal disruption and maximum performance. Key Responsibilities: Lead and execute mig

[Already Applied]

DFA AWS Cloud Solutions Engineer, Little Rock, AR

Jul-04-25

Cook Systems International

($) : Market

Launch Your Career with Cook SystemsReady to elevate your career? Cook Systems, a certified veteran owned IT consulting firm, has been transforming businesses and careers since 1990. Whether you're aiming to work with a Fortune 500 company or a small business, we've got you covered.Our core values: integrity, investment, and innovation drive everything we do, ensuring you grow and succeed in a dynamic, supportive environment. We understand the importance of work life balance and personal growth.

Database developer, Atlanta, GA

Jul-07-25

AETG Services PVT LTD

($) : Market

Role: Database developer Location: Atlanta, GA Duration: 11 Months Need Local Resume. Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical business information. Responsibilities: Collaborate with internal customers, prospects, and stakeholders, understand, and translates business use cases and/or requirements into data analysis and data mapping and consequently data integration routines which involv

[Already Applied]