Remote - Pyspark Developer

Remote, Work from Home Remote Work from Home 00000

Date : Nov-09-21

Remote - Pyspark Developer

Remote, Work from Home

Nov-09-21

Work Authorization

US Citizen
GC
H1B
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain :

IT/Software

Work Authorization

US Citizen
GC
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain : IT/Software

Apply Now

New York Technology Partners
Iselin, NJ
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Pyspark Developer

Location: Remote

Duration: Long Term Contract

Job Description:

Design and Developed real time streaming pipelines for sourcing data from IOT devices, defining strategy for data lakes, data flow, retention, aggregation, summarization for optimizing the performance of analytics products.
Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
Proficiency with Big Data processing technologies (Hadoop, Hive, or Databricks)
Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
Experience with SQL and relational databases
Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse
Experience in optimizing Hive SQL quarries and Spark Jobs.
Implemented various frameworks like Data Quality Analysis, Data Governance, Data Trending, Data Validation and Data Profiling with the help of technologies like Bigadata,Data Stage, Spark, Python, Mainframe with databases like Netezza and DB2,Hive & Snowflakes
Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram with MS Visio.
Having experience in delivering the highly complex project with Agile and Scrum methodology.
Quick learner and up-to-date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.

Hot Job

SQL Developer, Miami, FL

Dec-25-25

Shrinq Consulting Group Inc

($) : 45000

We are seeking a skilled SQL Developer to design, develop, optimize, and maintain database solutions that support business applications and analytics. The ideal candidate has strong SQL expertise, experience with relational databases, and a focus on performance, data integrity, and scalability. Key Responsibilities Design, write, and optimize complex SQL queries, stored procedures, functions, and views Develop and maintain relational database schemas and data models Ensure

Sr ETL Architect (Snowflake & AWS), Windsor, CT

Dec-04-25

Robotics technology LLC

($) : 75$

Job Details Job Description: About the RoleWe are seeking an experienced ETL Architect with strong expertise in Snowflake and AWS Cloud ecosystem to design, develop, and optimize data integration solutions. The ideal candidate will be responsible for architecting scalable ETL pipelines, enabling efficient data movement, transformation, and integration across enterprise systems to support business intelligence, analytics, and advanced data initiatives. Key ResponsibilitiesDesign and imp

Sr. AWS Glue ETL Developer, Boston, MA

Dec-18-25

Robotics technology LLC

($) : $70

Sr. AWS Glue ETL Developer Boston, MA Job Description:Total Force Alliance is seeking a Sr. AWS Glue ETL Developer with strong systems, software, and AWS cloud experience to support a major mainframe systems modernization initiative for federal customer. Based in DevOps framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding, unit testing, support depl

AWS Data Engineer, Boston, MA

Dec-10-25

Digital Minds Technologies Inc

($) : Market

Location: Boston, MA [100% onsite must and in-person interview is must] Job Description: An AWS data engineer job description typically involves designing, building, and maintaining scalable data pipelines, architectures, and solutions on the Amazon Web Services (AWS) cloud platform. Key responsibilities include data integration, building ETL processes using services like AWS Glue and Redshift, data modeling, and ensuring data quality and security. This role often requires proficiency in pr

[Already Applied]

Remote - Data Engineering Tech Lead – Ha, Remote, Work from Home

Dec-05-25

Robotics technology LLC

($) : Market

Job description: Must: Hadoop experience Led a small team or mentored jr developers(ideally, but not necessary) We are seeking an accomplished Tech Lead – Data Engineer to architect and drive the development of large-scale, high-performance data platforms supporting critical customer and transaction-based systems. The ideal candidate will have a strong background in data pipeline design, Hadoop ecosystem, andreal-time data processing, with proven experience building data solutions

ETL Developer (Snowflake & AWS), Windsor, CT

Nov-28-25

Robotics technology LLC

($) : $70

Job Title / Role: ETL Developer (Snowflake & AWS) Location: Windsor, CT Job Summary: We are seeking a skilled ETL Developer with strong experience in Snowflake and AWS to design, develop, and maintain scalable data pipelines and ETL processes. The ideal candidate will have a deep understanding of cloud-based data warehousing, data integration, and transformation techniques, and will play a key role in enabling data-driven decision-making across the organization. Key Responsibili

Data Engineer, Dallas, TX

Dec-06-25

Robotics technology LLC

($) : 60

We are seeking a highly skilled AWS Glue Data Engineer to design, develop, and optimize large-scale data pipelines and ETL workflows on AWS. The ideal candidate will have strong expertise in AWS cloud-native data services, data modeling, and pipeline orchestration, with hands-on experience building robust and scalable data solutions for enterprise environments.Key Responsibilities• Design, develop, and maintain ETL pipelines using AWS Glue, Glue Studio, and Glue Catalog.• Ingest, transform, and

Remote - Application Development Princip, Remote, Work from Home

Dec-04-25

Robotics technology LLC

($) : Market

Job description: Teradata Databricks Spark/PySpark Experience that takes initiative and has command of tools.works in a consultative manner vs waiting for direction and orders. Experience working with both business and IT leaders Duties: Collaborate with business and technical stakeholders to gather and understand requirements. Design scalable data solutions and document technical designs. Develop production-grade, high-performance ETL pipelines using Spark and PySpark.

Python Backend Developer with RFID Exper, Dallas, TX

Nov-28-25

VALIANT TECHNOLOGIES LLC

($) : $80

Role: –Python Backend Developer with RFID ExperienceBill Rate: $80/hour C2CLocation: Dallas, TXDuration: 12+ months/ long-term Interview Criteria: Telephonic + ZoomDirect Client Requirement Key Responsibilities Technical Leadership & Strategy Serve as the primary technical expert on all aspects of RFID technology, including UHF (RAIN RFID), HF, NFC, and associated protocols. Define and maintain the technical roadmap for RFID solutions, ensuring alignment with business goals and industr

Sr.Data Engineer, California City, CA

Dec-11-25

Enin Systems

($) : as per resume

Data Engineer Position Summary The Data Engineer is responsible for building and maintaining scalable data pipelines, data warehousing solutions, and data platforms that support analytics, machine learning, and business intelligence. This role focuses on data integration, ETL/ELT workflows, and ensuring data quality and availability. Key Responsibilities Develop, maintain, and optimize data pipelines (batch and streamingBuild and manage data lakes, data warehouses, and analytics platfor