Tech Evaluation Login
Tech Evaluation Signup
PasswordReset
Unsubscribe
PasswordReset
PasswordReset
PasswordReset
Register for Webinar
Register for Event
Job Channels
Skill Score
About Us
Contact Us
Our Blog
Toggle navigation
Home
Skill Score
DemandIndex
Jobs
FETCH Jobs
Java J2EE
Dot Net, C#
DBA
SAP
Admin, Networking
Datawarehousing
QA
Demo
Candidate
Recruiter
Services
Job Posting & Resume Access
Integrated Talent Sourcing
Sub Contractor Supply Chain
Merger & Acquisition
Candidate
Post Resume
Login
Create Job Alert
Recruiter
Login
Free Trial
Signup
Pricing
| Pricing
Dashboard
My Resumes
Resume List
Add Resume
Edit / Update Resume
My Jobs
Fetch Jobs
Matched Jobs
Applied Jobs
pyspark Developer with AWS EMR Experience
Portland, OR
Portland
OR
97298
Date
: Feb-21-17
2017-02-21
2018-02-21
pyspark Developer with AWS EMR Experience
Portland, OR
Feb-21-17
Work Authorization
US Citizen
GC
H1B
EAD (OPT/CPT/GC/H4)
Preferred Employment
Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire
Job Details
Experience
:
Architect
Rate/Salary ($)
:
Market
Duration
:
12 MONTHS
Sp. Area
:
Others
Sp. Skills
:
Others
Consulting / Contract
H1B OK
Third Party OK
CONTRACTOR
Required Skills
:
pyspark on AWS EMR, ETL data pipelines, Python, XML processing, Spark’s RDD API, Spark’s Dataframe and API, Apache Spark Data sources API, AWS S3 obje
Preferred Skills
:
Domain
:
Work Authorization
US Citizen
GC
EAD (OPT/CPT/GC/H4)
H1B
Preferred Employment
Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire
Job Details
Experience
:
Architect
Rate/Salary ($)
:
Market
Duration
:
12 MONTHS
Sp. Area
:
Others
Sp. Skills
:
Others
Consulting / Contract
H1B OK
Third Party OK
CONTRACTOR
Required Skills
:
pyspark on AWS EMR, ETL data pipelines, Python, XML processing, Spark’s RDD API, Spark’s Dataframe and API, Apache Spark Data sources API, AWS S3 obje
Preferred Skills
:
Domain
:
SVK Technology Solutions Inc
Edison, NJ
Post Resume to
View Contact Details &
Apply for Job
Job Description
:
Position: pySpark Developer with AWS EMR Experience
Location: Portland, OR
Duration: 12 Months
Mandatory skills:
5+ years of experience in programming with python. Strong proficiency in python
Familiarity with functional programming concepts
3+ years of Hands on experience in developing ETL data pipelines using pyspark on AWS EMR
Hands on experience of XML processing using python
Good understanding of Spark’s RDD API
Good understanding of Spark’s Dataframe and API
Experience and good understanding of Apache Spark Data sources API.
Experience of dealing with AWS S3 object storage from Spark.
Roles & Responsibilities:
Design, development and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR
Writing reusable, testable, and efficient code
Integration of data storage solutions in spark – especially with AWS S3 object storage.
Performance tuning of pySpark scripts.
Need to ensure overall build delivery quality is good and on time delivery is done at all times.
Should be able to handle meetings with customers with ease.
Need to have excellent communication skills to interact with customer.
Be a team player and willing to work in an onsite offshore model, mentor other folks in the team (onsite as well as offshore)
Turn OFF keyword highlights