Remote - Pyspark Developer

Remote, Work from Home Remote Work from Home 00000

Date : Nov-09-21

Remote - Pyspark Developer

Remote, Work from Home

Nov-09-21

Work Authorization

US Citizen
GC
H1B
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain :

IT/Software

Work Authorization

US Citizen
GC
OPT EAD, CPT EAD, GC EAD, L2 EAD, H4 EAD, TN EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Midlevel

Rate/Salary ($)

:

Market

Duration

:

long term

Sp. Area

:

Data Warehousing/ETL

Sp. Skills

:

Data Modeler

Consulting / Contract

Remote Work from Home

Required Skills :

Hive, AWS, Cloud Computing, Data Warehousing, ETL, Spark, SQL, Agile, Bamboo, Big Data, Bitbucket, Data Profiling, Data Stage, Data Validation, DB2, D

Preferred Skills :

Domain : IT/Software

Apply Now

New York Technology Partners
Iselin, NJ
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Pyspark Developer

Location: Remote

Duration: Long Term Contract

Job Description:

Design and Developed real time streaming pipelines for sourcing data from IOT devices, defining strategy for data lakes, data flow, retention, aggregation, summarization for optimizing the performance of analytics products.
Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
Proficiency with Big Data processing technologies (Hadoop, Hive, or Databricks)
Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
Experience with SQL and relational databases
Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse
Experience in optimizing Hive SQL quarries and Spark Jobs.
Implemented various frameworks like Data Quality Analysis, Data Governance, Data Trending, Data Validation and Data Profiling with the help of technologies like Bigadata,Data Stage, Spark, Python, Mainframe with databases like Netezza and DB2,Hive & Snowflakes
Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram with MS Visio.
Having experience in delivering the highly complex project with Agile and Scrum methodology.
Quick learner and up-to-date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.

Lead Data Engineer, Atlanta, GA

Dec-25-21

Cox Inc

($) : Market

*Primary Location: *3003 Summit Blvd, Atlanta, GA, USA*Division: *Cox Automotive*Job Level: *Individual Contributor*Travel: *No*Schedule: *Full-time*Shift: *Day Job*Requisition Number: *202105763VACCINE POLICY: WHERE PERMITTED BY APPLICABLE LAW, YOU MUST BE FULLY VACCINATED AGAINST COVID-19 TO BE CONSIDERED FOR THIS U.SBASED JOB (REASONABLE ACCOMMODATIONS FOR MEDICAL AND RELIGIOUS OBJECTIONS WILL BE CONSIDEREDDue to current COVID-19 restrictions, this is a temporary work from home role but will

Hot Job

AWS Cloud Delivery Lead-REMOTE, New York, NY

Jan-18-22

International Millennium Consultants Inc. (IMC)

($) : Market

AWS Cloud Delivery LeadDuration: 10 Months +Location: New York, NY/RemoteCitizenship required by federal contract.Consultant must open to considering a perm offer at end of contract period. Pre-Qualifying Questions:1. Are you eligible to work on a government project?2. Do you have all the requirements identified?Skills: • Technical Team Lead –AWS Cloud Delivery Lead• Project Manager-Act in role of Product Owner (PO) / Scrum Master (SM) Requirements:• Lead a team of onshore resources to suppo

[Already Applied]

Hot Job

Remote - Hadoop Developer with ETL, Remote, Work from Home

Jan-20-22

Atlantis IT Group

($) : Market

Hadoop ETL Developer Preferred location is Atlanta followed by any other locations including but not limited to Richmond VA, Atlanta GA, Norfolk VA, Mason, OH, Woodland Hills CA, Thousand Oaks, CA Description Looking for a Hadoop Developer to build end to end business solutions and to work with one of the leading healthcare providers in the US. The ideal candidate must possess an excellent background on Hadoop Development with ETL. The candidate must possess excellent written and verbal co

Remote - Data Analyst, Remote, Work from Home

Jan-11-22

Tekinspirations

($) : Market

Data & Analytics Development Engineer 100% Remote Role Definition: Data & Analytics developers are people who works with ETL (extract data, transform it, and load it) tools like Informatica, enterprise reporting tools like Tableau, Business objects. These people are also capable on working on Hadoop platforms. Skills required: o Very skilled in Python and DataStage coding and development o Very skilled in performing Python/Data Stage Code reviews o Very skilled in Data Modeling

[Already Applied]

Hot Job

Remote - Hadoop Developer, Remote, Work from Home

Jan-20-22

Atlantis IT Group

($) : DOE

· Should have thorough understanding of Hadoop concepts · Candidate with a mixture of Software Development, Data Engineering and Data Science skills · Strong Software Development and Engineering skills with some basic knowledge in Machine Learning and Deep Learning · Ability to write efficient code Good understanding of core Data Structures/algorithms is critical for engine development · Good python skills following software engineering best practices · Comfort & familiarity with SQL a

QA Automation Lead, Philadelphia, PA

Dec-31-21

Technogen, Inc

($) : USD 67 / Hourly / C2

Qa Automation Lead Location: Philadelphia, PA Duration: long term # of requirements 1 Job Title QE Automation Lead Relevant Experience (in Yrs) 10+ Years Technical/Functional Skills Selenium, UFT, Mainframe Application Testing, Testing on the applications hosted on cloud, AWS knowledge Experience Required Strong in Interface testing (Both Data & Application) Experience in Integrated landscape and API testing Capable to develop automation solution to compare data

Business Analyst, Denver, CO

Dec-25-21

AARATECH INC

($) : 65000

Strong analytical, abstraction and problem-solving skills to be able to translate business requirements into IT solutions. Motivation not only to document but also to design, implement, and test (no coding required, although past coding experience will benefit) Agile methodology, especially planning Sprints and creating stories for the Sprints JIRA tool experience Operational and/or customer service implementation experience System implementation experience Insurance project experience Famil

[Already Applied]

Business Analyst, Bridgeport, CT

Dec-25-21

AARATECH INC

($) : 65000

Strong analytical, abstraction and problem-solving skills to be able to translate business requirements into IT solutions Motivation not only to document but also to design, implement, and test (no coding required, although past coding experience will benefit) Agile methodology, especially planning Sprints and creating stories for the Sprints JIRA tool experience Operational and/or customer service implementation experience System implementation experience Insurance project experience Famili

[Already Applied]

Business Analyst, Minneapolis, MN

Dec-25-21

AARATECH INC

($) : 65000

Job Description: Strong analytical, abstraction and problem-solving skills to be able to translate business requirements into IT solutions Motivation not only to document but also to design, implement, and test (no coding required, although past coding experience will benefit) Agile methodology, especially planning Sprints and creating stories for the Sprints JIRA tool experience Operational and/or customer service implementation experience System implementation experience Insurance projec

[Already Applied]

Business Analyst, Bristol, RI

Dec-25-21

AARATECH INC

($) : 65000

Job Description: Strong analytical, abstraction and problem-solving skills to be able to translate business requirements into IT solutions Motivation not only to document but also to design, implement, and test (no coding required, although past coding experience will benefit) Agile methodology, especially planning Sprints and creating stories for the Sprints JIRA tool experience Operational and/or customer service implementation experience System implementation experience Insurance projec

[Already Applied]