Job Description :
Data Engineer
Location- Jersey, NJ ( Open to relocating will be accepted)
Contract to hire – 6 months
PositionOverview:
Under the leadership of the Data Management and Analytics organization, the Data Engineer is responsible fordelivering Data Lake, data warehouse, analytics and business intelligence solutions. The main function of this role is serving as senior technical person for coding, debugging, testing, documenting, and implementing AWS data environments, and maintenance/enhancement to existing data environments.
Responsibilities:
? Design, develop, and test enhancements to Data Lake technology management using the Zaloni Data Platform Arena.
? Experience using Lake Formation or other third party tools for expediting creations of data pipelines
? Significant experience in Hue/Hive SQL
? Work with complex Data modeling and design patterns forBI/Analytics reporting requirements.
? Serve as senior technical person for data solutions andarchitectures in relation to storage, governance, quality, cleansing and distribution.
? Design the infrastructure and reusable processes for optimalexecution of data transformation.
? Facilitate the evaluation and selection of data toolsetsrequired to achieve business objectives.
? Provide design decisions around data warehouse solutions that involve multiple disparate business systems.
? Ensure quality level of documentation is produced and maintained in regards to data solution architecture.
Required Knowledge:
? Bachelor's Degree in Computer Science or related field.
? 7 to 10 years' experience in a data engineering environment, report automation, batch and real time processing
? Experience working in an Agile/Scrum environment
? Background in banking and financial services industry
Strong Data Skills:
? SQL, ETL/ELT and MDM
? Python, Spark, PySpark, Jupyter/Zepplin
? Strong hands onexperience in Hive and HiveQL, SQL server
? AWS Data Lakes related skills Hadoop, HDFS, S3, EMR, Hive, Athena, Redshift, Glue, QuickSight,Apache Ranger
? Familiarity with Linux Shell Scripting
? C# is a plus
? Kafka streaming a big plus
? AWS Certified is a plus