Big Data Engineer (Spark/Scala)

Plymouth Meeting, PA Plymouth Meeting PA 19462

Date : Jun-15-18

Big Data Engineer (Spark/Scala)

Plymouth Meeting, PA

Jun-15-18

Work Authorization

US Citizen
GC
H1B
GC EAD

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Architect

Rate/Salary ($)

:

DOE

Duration

:

6 Months

Sp. Area

:

BigData, NoSQL

Sp. Skills

:

Hadoop

Consulting / Contract

Third Party OK

Required Skills :

Hadoop, Saprk, Scala, Hive

Preferred Skills :

Impala, Hbase

Domain :

Work Authorization

US Citizen
GC
GC EAD
H1B

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
1099-Contract
Contract to Hire

Job Details

Experience

:

Architect

Rate/Salary ($)

:

DOE

Duration

:

6 Months

Sp. Area

:

BigData, NoSQL

Sp. Skills

:

Hadoop

Consulting / Contract

Third Party OK

Required Skills :

Hadoop, Saprk, Scala, Hive

Preferred Skills :

Impala, Hbase

Domain :

Apply Now

Digital Minds Technologies Inc
Schaumburg, IL
Post Resume to
View Contact Details &
Apply for Job

Job Description :

Job Title: Big Data Engineer (Spark/Scala)
Location: Plymouth Meeting, PA
Duration: Long term contract

Job Description:

Required Experience (in order of importance):
Hadoop, Hive, Impala, HBase and related technologies
Spark, Scala
MPP, shared nothing database systems, NoSQL systems
Object Oriented and Functional Programming Experience
Modern DevOps experience
Linux
Data Warehousing design and concepts
RDBMS Experience

Minimum Education, Experience, & Specialized Knowledge Required:

Computer Science Degree
3+ years strong native SQL skills
3+ years strong experience in database and data warehousing/data lake concepts and techniques.
Understand: relational and dimensional modeling, star/snowflake schema design, BI, Data Warehouse operating environments and related technologies, ETL, MDM, and data governance practices.
2+ years’ experience with Hadoop, Hive, Impala, HBase, and related technologies
1+ years’ experience with Spark, Scala, Python, Java, and/or R
1+ years’ experience with MPP, shared nothing database systems, and NoSQL systems

Java Software Engineer, Jersey City, NJ

Mar-29-24

Computer Data Concepts Inc

($) : 65-70

Must have: Core Java, Spark, Scala, AWS (EMR)Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plusData set size is 500m-1b rows per batchInterviews - 2 rounds focused on technical - Scala, Spark, write code, answer design questionsExpert in in Full Stack design technique as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs e.g. Expert Engineers starting to be firm-wide resources working

[Already Applied]

Hot Job

Ab Initio Developer (W2, Only GC /Citize, Whippany, NJ

Apr-22-24

KK Associates

($) : Market

Experience in: Ab Initio, Hadoop, ETL, Hive, SQL, Oracle, ExpressIT, and Unix Have prior Ab Initio development experience, including experience in deployment architectures, debugging, and troubleshooting graphs. Extensive Hands-on creating graphs, pset, AI objects. Experience with PL SQL is required. Ability to understand source to target ETL mappings. Should be well versed on data investigation/data analysis. Ability to explain functional and technical details. Should have good SQL writing capa

Hot Job

AWS Solutions Architect, New York, NY

Apr-25-24

Global Soft Systems, Inc

($) : $60k - $130k/year

AWS Solution Architect Remote Required Skill Amazon Web Services (AWS), Java Preferred Qualification Experience with data analysis and using data visualization tools to describe data ? Understanding of big data and real time streaming analytics processing architecture and ecosystems Experience with DataLakes and data warehousing architecture and implementation, including MPP, data streams, hands on experience with source to target mappings and developing ETL code. Software developm

Jr. Data Engineer, Jersey City, NJ

Apr-21-24

APN Consulting Inc

($) : $100000 - $110000 yr

Direct Client Requirement Position: Jr. Data Engineer Location: Jersey City, NJ Type: Full Time/Permanent The Role: The client is looking for a talented and experienced developer to join our development team to support the continued development of our analytics platforms. Besides regular individual contributions, Data Engineers are expected to be deep technical experts in our tech stack and have a breadth of knowledge and experience on technology trends in the industry. Above all

Remote - Full Stack Developer, Jersey City, NJ

Mar-27-24

tanishasystems

($) : 00 yr

Job Role: Full Stack DeveloperLocation: Jersey City/New York location (3 days minimum onsite and 2 days hybrid)Hire Type: Fulltime / Permanent Job Description:Full Stack Developer Hands-on developer who is willing to go above and beyond. Initiative & Ownership - we want someone who can run with the task and see it through completion, whether it be doing analysis around the ask or testing the app along with other tech teams. Follow and add to our defined architecture, technology standard

Hot Job

Senior Data Modeler, New York, NY

Apr-25-24

Intone Networks

($) : USD 85 / Hourly / C2

Senior Data Modeler Remote Statement of Work: Business Master File Modernization (BMF Mod) is one of multiple programs created to modernize the Internal Revenue Services (IRS) the legacy Tax processing systems and is critical to the IRS IT Application Development (AD) and IRS IT Enterprise Service (ES) organizations' goal to support the objectives of the IRS IT Modernization Business Plan. BMF Mod's initiative will modernize IRS systems and processes, improve taxpayer experience, inc

SDET (Python), New York, NY

Apr-17-24

Global Soft Systems, Inc

($) : $60k - $130k/year

SDET (Python) REMOTE Long Term Must have: J Python Test plan and test case development Owning and maintaining test framework Data pipeline or ETL experience (Airflow, dbt, dagster) Big Data (Spark / EMR) AWS CI/CD and continuous testing Nice to have: Experience testing pipelines with ML models embedded Crypto (development or testing of apps for blockchain, or tokens)

Sr. Fullstack Java Developer, New York, NY

Apr-17-24

Global Soft Systems, Inc

($) : $60k - $130k/year

Sr. Java fullstack Developer Remote position Must have : Java, Cloud UI(Ideally Angular or similar like react or other UI framework) Bigdata (for example Spark,EMR, Presto) ideally 2+ years- can figure out to query/store data and logically understand what is causing performance issue and come up with redesign issue SQL Production support. Nice to have AWS

Hot Job

Data Architect with Mongo DB, Jersey City, NJ

Apr-25-24

tanishasystems

($) : $150000 - $200000 yr

Role : Data Architect with Mongo DBLocation : Jersey City, NJ OnsiteHire Type : Full Time & Contract W2Data Architect with Mongo DB. Expertise in Mongo DB Hands-on, " Performance Tuning on systems built on MongoDB " Experience in large highly scalable and resilient systems using MongoDB. " Looking for real/deep technical expertise in Mongo space. " Looking for prior experience in designing/architecting/building a resilient and highly scalable Mongo infrastructure. " Translates to ha

Hot Job

RoPA Engineer (Data Governance), New York, NY

Apr-25-24

Intone Networks

($) : USD 70 / Hourly / C2

Job Title: RoPA Engineer (Data Governance) Location: Sunrise, FL/ New York City, NY/Phoenix, AZ (Onsite No Relocation) Duration: 6-12+ Months (Possible Extension) Job Description: Requires a strong understanding of data management and data engineering principles/concepts. Knows Java/Springboot and is familiar with Big Data and NoSQL (i.e. Redis or Couchbase) for data processing. Responsible for designing, building, and maintaining large-scale data management systems. Familiar with data