Job Description :
Data Engineer

Location- Jersey, NJ


Contract to hire – 6 months

The candidate must be able to convert to FT after 6 months without sponsorship



Position Overview:

Under the leadership of the Data Management and Analytics organization, the Data Engineer is responsible fordelivering Data Lake, data warehouse, analytics and business intelligencesolutions. The main function of this role is serving as senior technical personfor coding, debugging, testing, documenting, and implementing AWS dataenvironments, and maintenance/enhancement to existing data environments.



Responsibilities:

? Design, develop, and test enhancements to Data Lake technology management using the Zaloni Data Platform Arena.

? Experience using Lake Formation or other third party toolsfor expediting creations of data pipelines

? Significant experience in Hue/Hive SQL

? Work with complex Data modeling and design patterns for BI/Analytics reporting requirements.

? Serve as senior technical person for data solutions andarchitectures in relation to storage, governance, quality, cleansing and distribution.

? Design the infrastructure and reusable processes for optimalexecution of data transformation.

? Facilitate the evaluation and selection of data toolsetsrequired to achieve business objectives.

? Provide design decisions around data warehouse solutionsthat involve multiple disparate business systems.

? Ensure quality level of documentation is produced andmaintained in regards to data solution architecture.



Required Knowledge:

? Bachelor's Degree in Computer Science or related field.

? 7 to 10 years' experiencein a data engineering environment, report automation, batch and real time processing

? Experience working inan Agile/Scrum environment

? Background in bankingand financial services industry



Strong Data Skills:

? SQL, ETL/ELT and MDM

? Python, Spark, PySpark,Jupyter/Zepplin

? Strong hands onexperience in Hive and HiveQL, SQL server

? AWS Data Lake srelated skills Hadoop, HDFS, S3, EMR, Hive, Athena, Redshift, Glue, QuickSight ,ApacheRanger

? Familiarity with Linux Shell Scripting

? C# is a plus

? Kafka streaming a big plus

? AWS Certified is a plus
             

Similar Jobs you may be interested in ..