Job Description :
Mandatory Required Skills: Hadoop with PySpark, Hive, Kudu
Preferred /Desired Skills : Hands-on Exp with Cloudera along with Hive Impala
Creation of the Finance Data Lake to provide a single source of data to be leveraged by Finance applications and users. This would leverage ARN instrument balances where possible and provide consistent financial and non-financial data to be consumed by multiple finance users and applications.
· ASG Tool rollout will provide data lineage across any data transformation on the element for every data source.
The DQ Program will support 71 contracts for Finance Owners and Data consumers, develop DQ metrics design, provide operational support for remediation, setup operational process of data lineage functions and expand EMEA and APAC DQ support