Ar Systems, Inc
Edison, NJ
Post Resume to
View Contact Details &
Apply for Job
Job Description :

Job Title: Big Data Engineer / SPARK

Location: New York City NY

Duration: 1 year

Spark, Scala, Python AWS Redshift Oracle PL/SQL T-SQL SQL SERVER HTML and CSS

Job Description:

  • Work with stakeholders including the Executive, Product, Data / Solution Architect and Design teams to assist with data-related technical issues and support validating data infrastructure needs
  • Experience 8 Plus years with skill set expanding from extensive usage of Spark Python AWS Redshift Oracle PLSQL TSQL SQL SERVER HTML and CSS
  • Strong expertise in Oracle Database SQL PLSQL and TSQL Hive MongoDB Hadoop AWS stack and Dockers
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Build the data pipeline required or use existing one for optimal extraction, transformation, and loading of data from multiple sources (SQL/Python) to target (Hadoop / Hive)
  • Have the ability to leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver solutions using PySpark, Dataframes, Python, Hive and other tools/frameworks available in and around the Hadoop ecosystem
  • Build the infrastructure required for optimal extraction transformation and loading of data from multiple sources to target Hadoop Hive
  • Experience implementing complex data analytics and transformations with PySpark/Spark (Scala/Java).
  • Demonstrate notion of software design principles and the protocols involved in the software delivery lifecycle.
Experience working on scrum methodologies like Agile and/or Kanban
             

Similar Jobs you may be interested in ..