Remote - Pyspark Developer

Remote, Work from Home Remote Work from Home 00000

Date : Nov-09-21

Remote - Pyspark Developer

Remote, Work from Home

Nov-09-21

Work Authorization

US Citizen
GC
H1B
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain :

IT/Software

Work Authorization

US Citizen
GC
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain : IT/Software

Apply Now

New York Technology Partners
Iselin, NJ
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Pyspark Developer

Location: Remote

Duration: Long Term Contract

Job Description:

Design and Developed real time streaming pipelines for sourcing data from IOT devices, defining strategy for data lakes, data flow, retention, aggregation, summarization for optimizing the performance of analytics products.
Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
Proficiency with Big Data processing technologies (Hadoop, Hive, or Databricks)
Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
Experience with SQL and relational databases
Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse
Experience in optimizing Hive SQL quarries and Spark Jobs.
Implemented various frameworks like Data Quality Analysis, Data Governance, Data Trending, Data Validation and Data Profiling with the help of technologies like Bigadata,Data Stage, Spark, Python, Mainframe with databases like Netezza and DB2,Hive & Snowflakes
Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram with MS Visio.
Having experience in delivering the highly complex project with Agile and Scrum methodology.
Quick learner and up-to-date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.

QA Automation Engineer, Atlanta, GA

Oct-02-25

Robotics technology LLC

($) : 80

Job Responsibilities•Write and execute automated test code in Java for web legacy apps and product public API using xUnit BDD and latest opensource packages and technologies•Write functional integration and customer workflow endtoend test automation to validate product functionality and integration with dependencies•Develops modifies and executes software test plans automated scripts and programs for testing•Plan and carry out performance load and stress tests•Participate in design architecture

Sr ETL Architect (Snowflake & AWS) $88/h, Windsor, CT

Oct-05-25

VALIANT TECHNOLOGIES LLC

($) : $88

Role: –Sr ETL Architect (Snowflake & AWS)Bill Rate: $88/hour C2CLocation: Windsor,CTDuration: 12+ months/ long-term Interview Criteria: Telephonic + ZoomDirect Client Requirement Job Description: We are seeking an experienced ETL Architect with strong expertise in Snowflake and AWS Cloud ecosystem to design, develop, and optimize data integration solutions. The ideal candidate will be responsible for architecting scalable ETL pipelines, enabling efficient data movement, transformation, and

Hot Job

Developer, New York, NY

Oct-23-25

Sage IT INC

($) : USD 70

Job Description:, ALL CAPS, NO SPACES B/T UNDERSCORES, , PTN_US_GBAMSREQID_CandidateBeelineID, i.e. PTN_US_9999999_SKIPJOHNSON0413, , Bill Rate: $65-70/hr, , MSP Owner: Kelly Gosciminski, Location: New York, NY - hybrid onsite, Duration: 6 months, GBaMS ReqID: 10272565, , - Experience 10 years of experience in data engineering or a related role., - Python Proficiency Strong proficiency in Python programming, including experience with data manipulation libraries such as Pandas and NumPy., - Data

Remote - SDET with ETL Testing, Remote, Work from Home

Oct-09-25

Avance Consulting Services

($) : Market

Position: SDET with ETL Testing Location: Remote Duration:06+Months Work Authorization: US Citizens, GC, GC-EAD, L2 -EAD, J2-EAD , TN 1 -2 & H1B Preferred Employment: Corp-Corp & W2 Contract Position Summary The SDET Software Development Engineer in Test is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as w

Remote - BigData Engineer, Remote, Work from Home

Oct-17-25

Robotics technology LLC

($) : Market

Job Description: ·Build a highly functional and efficient Big Data platform that brings together data from disparate sources and allows FinThrive to design and run complex algorithms providing insights to Healthcare business operations. ·Build ETL Data Pipelines in Aws Cloud using Aws ADF and Databricks using PySpark and Scala. ·Migrate ETL Data pipelines from On Prem Hadoop Cluster to Aws Cloud. ·Build Data Ingestion Pipelines in Aws to pull data from SQL Server. ·Perform Automated an

Databricks Data Engineer, Dallas, TX

Oct-06-25

Robotics technology LLC

($) : Market

JOB DESCRIPTION: ·Bug Fixes in the Databricks environment ·Ability to Monitoe, Transform and optimize ETL pipelines for Databricks and Knowledge of Data Lakehouse Architecture and knowledge of Pyspark (At least Mid-Level) ·Experience in complex data migration and familiarity with the knowledge is a plus ·Ensure data accessibility and integrity for the migrated objects ·Collaborate effectively with cross-functional teams. ·Communicate progress and challenges clearly to stakeholders.

QA Automation Engineer, Alpharetta, GA

Oct-05-25

Robotics technology LLC

($) : 70$

12+ years of proven work experience in QA with an emphasis on QA automation. 5+ years of demonstrable experience in automation technologies including Rest Assured, Playwright, Selenium, Junit, TestNG, Gherkin, JMeter etc. and scripting languages (Java, Python) Strong experience in services/API testing and automation In-depth knowledge of test management software (e.g., Jira and xRay) Proficiency in usage of SQL queries for databases or large datasets Expertise with CI tools (GitHub,

QA Automation Engineer, Dallas, TX

Oct-04-25

Robotics technology LLC

($) : 70$

Key Responsibilities:• Design, develop, and execute ETL test cases to validate data extraction, transformation, and loading processes.• Write and execute complex SQL queries to perform data validation and back-end testing.• Identify, report, and track defects systematically.• Participate in project meetings and be available for discussions in US EST working hours as needed Clarify requirements when necessary and ensure comprehensive coverage of all requirements in the testing process. Requi

ETL architect with Google Cloud, San Jose, CA

Oct-03-25

Robotics technology LLC

($) : 80$

Job Details Job Title: ETL architect with Google CloudWork From Office(5 days/weekUSA): San Jose, CA/Mountain View, CA (locals) Responsibilities:We are seeking a skilled and experienced ETL architect with Google Cloud as the core platform. ETL pipeline development, and Google Cloud Platform (Google Cloud Platform), and Cloud Storage. The ETL Architect will play a critical role in architecting scalable, efficient, and secure ETL (Extract, Transform, Load) solutions for data warehousing, b

QA Automation Engineer$80/hr Srinivasa K, Durham, NC

Oct-17-25

VALIANT TECHNOLOGIES LLC

($) : $80

Role: –QA Automation EngineerBill Rate: $80/hour C2CLocation:Durham ,NCDuration: 12+ months/ long-term Interview Criteria: Telephonic + ZoomDirect Client Requirement Job Details This client is a multination financial services company, and they are hiring for a QA Automation Engineer. They need someone that can quickly learn the business flows available in the UI and replicate them in end-to-end tests in their CI environment. They are looking for someone with extensive API and DB automation