Job Description :
Cerebra Consulting Inc is a System Integrator and IT Services Solution provider with a focus on Big Data, Business Analytics, Cloud Solutions, Amazon Web Services, Salesforce, Oracle EBS, Peoplesoft, Hyperion, Oracle Configurator, Oracle CPQ, Oracle PLM and Custom Application Development. Utilizing solid business experience, industry-specific expertise, and proven methodologies, we consistently deliver measurable results for our customers. Cerebra has partnered with leading enterprise software companies and cloud providers such as Oracle, Salesforce, Amazon and able to leverage these partner relationships to deliver high-quality, end-to-end customer solutions that are targeted to the needs of each customer.
 
 
 
 
 

AWS Data Lake Engineer

ISELIN, NJ

Job Description

Requirements

Under the leadership of the Data Management and Analytics organization, the Data Engineer is responsible for delivering data lake, data warehouse, analytics and business intelligence solutions. The main function of this role is serving as senior technical person for coding, debugging, testing, documenting, and implementing AWS data environments, and maintenance/enhancement to existing data environments.

Responsibilities:

  • Design, develop, and test enhancements to Data Lake technology management using the Zaloni Data Platform Arena.
  • Experience using Lake Formation or other third party tools for expediting creations of data pipelines
  • Significant experience in Hue/Hive SQL
  • Work with complex Data modeling and design patterns for BI/Analytics reporting requirements.
  • Serve as senior technical person for data solutions and architectures in relation to storage, governance, quality, cleansing and distribution.
  • Design the infrastructure and reusable processes for optimal execution of data transformation.
  • Facilitate the evaluation and selection of data toolsets required to achieve business objectives.
  • Provide design decisions around data warehouse solutions that involve multiple disparate business systems.
  • Ensure quality level of documentation is produced and maintained in to data solution architecture.

Education/ Experience:

  • Bachelor's Degree in Computer Science or related field.
  • 7 to 10 years' experience in a data engineering environment, report automation, batch and real time processing
  • Experience working in an Agile/Scrum environment
  • Background in banking and financial services industry

Strong data skills required:

  • SQL, ETL/ELT and MDM
  • Python, Spark, PySpark, Jupyter/Zepplin
  • Strong hands on experience in Hive and HiveQL, SQL server
  • AWS Data Lakes related skills Hadoop, HDFS, S3, EMR, Hive, Athena, Redshift, Glue, QuickSight, Apache Ranger
  • Familiarity with Linux Shell Scripting
  • C# is a plus
  • Kafka streaming a big plus
  • AWS Certified is a plus

Additional Notes to Vendor

This role is 90% Data lake and 10% SQL

If you are interested, can you please send an email

             

Similar Jobs you may be interested in ..