Remote - Pyspark Developer

Remote, Work from Home Remote Work from Home 00000

Date : Nov-09-21

Remote - Pyspark Developer

Remote, Work from Home

Nov-09-21

Work Authorization

US Citizen
GC
H1B
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain :

IT/Software

Work Authorization

US Citizen
GC
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain : IT/Software

Apply Now

New York Technology Partners
Iselin, NJ
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Pyspark Developer

Location: Remote

Duration: Long Term Contract

Job Description:

Design and Developed real time streaming pipelines for sourcing data from IOT devices, defining strategy for data lakes, data flow, retention, aggregation, summarization for optimizing the performance of analytics products.
Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
Proficiency with Big Data processing technologies (Hadoop, Hive, or Databricks)
Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
Experience with SQL and relational databases
Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse
Experience in optimizing Hive SQL quarries and Spark Jobs.
Implemented various frameworks like Data Quality Analysis, Data Governance, Data Trending, Data Validation and Data Profiling with the help of technologies like Bigadata,Data Stage, Spark, Python, Mainframe with databases like Netezza and DB2,Hive & Snowflakes
Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram with MS Visio.
Having experience in delivering the highly complex project with Agile and Scrum methodology.
Quick learner and up-to-date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.

Hot Job

QA Test Engineer ETL, Seattle, WA

Mar-28-26

Accord Tecnologies.Inc

($) : $60k - $130k/year

QA/Test Engineer Seattle, WA Position type: C2C Visa: USC/ GC Role Summary: The QA/Test Engineer is responsible for building and executing comprehensive test strategies for all ingestion and ETL pipelines. This role ensures that every pipeline meets the 98 99% data quality pass rate required by the SOW before production promotion, and that automated tests are embedded in the CI/CD process. Key Responsibilities: Design and implement a reusable test framework for unit, integration, and end-t

Hot Job

AWS Data Architect 100% Remote, Remote, Work from Home

Mar-26-26

Apetan Consulting

($) : Market

AWS Data Architect 100% Remote Job Summary:The AWS Data Architect is responsible for designing, building, and optimizing scalable data architectures on Amazon Web Services (AWS This role focuses on creating data pipelines, data lakes, and analytics platforms that support business intelligence, reporting, and advanced analytics. Key Responsibilities: Design and implement scalable data architecture solutions on AWS. Develop and maintain data lakes, data warehouses, and ET

Senior Lead Data Engineer (Snowflake, Da, Remote, Work from Home

Mar-23-26

Apetan Consulting

($) : Market

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations) 100% Remote Job Summary We are seeking a highly skilled Senior Lead Data Engineer with strong experience in modern data platforms includingSnowflake, Databricks, Apache Iceberg, andApache Spark. The ideal candidate will lead the design, development, and optimization of scalable data pipelines and analytics platforms while ensuring high performance for large-scaleSQL workloads. This role

Senior Lead Data Engineer 100% Remote, Remote, Work from Home

Mar-13-26

Apetan Consulting

($) : Market

Senior Lead Data Engineer 100% Remote Job Summary: We are seeking a highly experienced Senior Lead Data Engineer to design, build, and lead the development of scalable data platforms and pipelines. This role requires strong hands-on expertise in data engineering, architecture, and team leadership to support analytics, reporting, and advanced data solutions across the organization. Key Responsibilities: Lead the design and development of scalable data pipelines and data architectu

Python Developer 100% Remote, Remote, Work from Home

Mar-02-26

Apetan Consulting

($) : Market

Python Developer 100% Remote Job Summary: We are seeking a skilled Python Developer to design, develop, and maintain scalable applications and backend services. The ideal candidate should have strong programming skills, experience with Python frameworks, and the ability to work in a collaborative development environment. Key Responsibilities: Develop, test, and maintain Python-based applications Write clean, efficient, and reusable code Design and implement backend se

Hot Job

Ab Initio lead Developer, Charlotte, NC

Mar-28-26

Accord Tecnologies.Inc

($) : Market

Ab Initio lead Developer with Python & PySpark Charlotte, NC (Onsite Openings: 4 Position type; W2 contract Job Description: We are seeking a skilled Ab Initio Developer with strong experience in Python and PySpark to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data integration and processing solutions, ensuring high performance and data quality. Responsibilities: Develop and maintain ETL workflows using Ab I

Hot Job

Senior Technical Product Manager AWS & G, Remote, Work from Home

Mar-28-26

Apetan Consulting

($) : Market

Senior Technical Product Manager AWS & GenAI (LLM/RAG) 100% Remote Job Summary: We are seeking an experienced Senior Technical Product Manager to lead the development and delivery of AI-powered products leveraging AWS cloud services and Generative AI technologies (LLMs, RAG architectures The ideal candidate will bridge business strategy, technical execution, and customer needs to build scalable, intelligent solutions. Key Responsibilities: Define product vision, roadmap, and stra

Google Cloud Platform Data Lead 100% Rem, Remote, Work from Home

Mar-21-26

Apetan Consulting

($) : Market

Google Cloud Platform Data Lead 100% Remote Job Summary:We are seeking an experienced Google Cloud Platform (GCP) Data Lead to design, implement, and manage scalable data solutions on GCP. The ideal candidate will lead data engineering initiatives, oversee cloud-based data architectures, and ensure efficient data processing, storage, and analytics to support business insights. Key Responsibilities: Lead the design and implementation of data architecture and data pipelines on Google C

Hot Job

Enterprise Data Architect / Migration Ex, Remote, Work from Home

Mar-28-26

Apetan Consulting

($) : Market

Enterprise Data Architect / Migration Expert 100% Remote Job Summary: We are looking for an experienced Enterprise Data Architect / Migration Expert to design and execute enterprise-wide data architecture and migration strategies. The role focuses on modernizing legacy data systems, enabling seamless data migration (on-premise to cloud or system-to-system), and ensuring scalable, secure, and high-quality data solutions. Key Responsibilities: Define enterprise data architecture and

[Already Applied]

Hot Job

Senior Data Analytics Solutions Architec, Remote, Work from Home

Mar-28-26

Apetan Consulting

($) : Market

Senior Data Analytics Solutions Architect 100% Remote Job Summary: We are seeking an experienced Senior Data Analytics Solutions Architect to design, develop, and oversee scalable data analytics solutions. The role involves defining data architecture, enabling advanced analytics, and ensuring alignment with business objectives. You will work closely with stakeholders, data engineers, and analysts to deliver high-quality, data-driven insights. Key Responsibilities: Design and implem

[Already Applied]