Job Description :


I am Swarna from TechnoGen. I am currently looking for Data Engineer or Big Data Developer.

Please let me know if you would be interested and share your updated resume.

You can reach me or else call me on .

Here we have openings for Data Engineer or Big Data Developer.

Its Hybrid(50% Remote and 50% DTC)


Note: Candidate must be your W2 Employee

Job Description:

The Data Engineer works within the ETL and Operations team to build high quality data pipelines driving analytic solutions from diverse, disparate sources of data.

This role requires a comprehensive understanding of data architecture, data engineering, and data analysis. The ideal candidate is a skilled data engineer with experience creating data products supporting analytic solutions. They are able to identify and implement solutions in a highly technical environment and work as part of a technical, cross-functional team. Strong problem-solving and troubleshooting skills are a must.

This role focuses on designing, developing, and maintaining datasets within AWS. Day-to-day responsibilities include:

  • Coordinating, building, and managing new data ingests
  • Architecting updates, fixes, and optimizations across suite of production jobs
  • Providing feedback on and enacting changes for improvements across the team including both technical and process updates
  • Learn and assess new technologies for implementation through proof-of-concept projects and testing
  • Mentoring junior developers
  • Partnering with data analysts and data scientists to design, build, and deploy aggregation processes

Top Skills:

  • Hadoop/Hive experience
  • Very Strong SQL
  • AWS experience (EMR, Lambda, Glue, Step Functions)
  • Experience working with large data sets (billions of records per day)
  • Write and review code
  • Python scripting (PySpark, control scripts)
  • Architecting/designing data pipelines
  • Query and data pipeline optimization
  • Strong communication and collaboration skills
  • Ability to help others and mentor junior resources

Nice to have

  • Spark
  • Scala
  • Git
  • Shell scripting
  • Linux

Required Skills : Strong SQL Experience manipulating data with SQL (experience with advanced functions, Group By, Queries pulling data from multiple tables, Windowing etc.) o They use complex queries and SQL for ETL instead of using ETL tools so must be strong in this AWS tools and services (S3, EC2, EMR etc.) Python or PySpark Hadoop / Hive exp VERY nice to have
Basic Qualification :
Additional Skills : ***EXCLSUVIE TO APEX***
Background Check :Yes
Notes :***EXCLSUVIE TO APEX*** - Have a couple people on the team, will move quick! HYBRID / 50% Remote
Selling points for candidate :***EXCLSUVIE TO APEX***
Project Verification Info :YES
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :Big Data: Dev
Branch Code :Denver

Similar Jobs you may be interested in ..