Job Description :
Position: Hadoop Application Support Engineer
Location: NYC, NY
Employment Type: contract
Interview: Phone and F2F


Job Description:
Hadoop Application Support Engineer

Purpose
Contributes to the overall success of Technology for Global Banking and Markets by ensuring specific individual goals, plans, initiatives are executed / delivered in support of the team''s business strategies and objectives. Ensures all activities conducted are in compliance with governing regulations, internal policies and procedures
Accountabilities
Champions a customer focused culture to deepen client relationships and leverage broader Bank relationships, systems and knowledge
· Engages a broad range of stakeholders across Front and Middle Office, Product Control, Risk Management, Back Office Application Development and Infrastructure teams.
· Setting up the Hadoop Cluster, configuration, installation, patching, upgrading and support on high availability applications.
· Hands on experience with BI and Analytics Solution Architecture.
· Experience in monitoring technologies, platform optimization, tuning, big data backup strategies and virtualization environments.
· Perform the monitoring & automation tasks for the large scale distributed systems, especially those involving Hadoop, HIVE, BEELINE, AMBARI, SOLR, Spark, NoSQL databases and analytical programming languages (Python/R
· Handling set up of scheduling jobs e.g. autosys, tidal, windows scheduler, crontabs.
· Ensures that scheduled data factory jobs (metadata tagging, classification, quality rules checking) and customer data services jobs for (a) de-duping and resolving customer entities, (b) merging data into master records, (c) materializing consumption views of the customer data, and (d) provisioning data to downstream consumers run when expected, complete successfully, meet SLA targets and produce expected outputs. When abnormalities are encountered, they are responsible for accurately and comprehensively recording them in the Incident Log, performing Level 1 incident resolution and, if necessary, activating the incident resolution escalation protocol.
· Ensures application support is performed in a professional, effective, and efficient manner.
· Shows initiative in recommending innovative solutions and continuous improvements to existing processes.
· Identifies critical issues and escalates them accordingly.
Responds to user inquiries and other issues.
· Configuring the connectivity e.g. SFTP, MQ, HTTPS, SOAP/REST with multiple upstream and downstream applications.
· Handling user''s entitlements and provisioning for the applications supported.
· Coordinates with Development and Business Analysts to improve sustainability.
· Adheres to established information security standards and procedures.
· Conducts the disaster recovery failover and the required project planning.
Understands how the Bank''s risk appetite and risk culture should be considered in day-to-day activities and decisions.
· Actively pursues effective and efficient operations of his/her respective areas, while ensuring the adequacy, adherence to and effectiveness of day-to-day business controls to meet obligations with respect to operational risk, regulatory compliance risk, AML/ATF risk and conduct risk, including but not limited to responsibilities under the Operational Risk Management Framework, Regulatory Compliance Risk Management Framework, AML/ATF Global Handbook and the Guidelines for Business Conduct.

Qualifications
· Bachelor''s degree in a related field required, advanced degree preferred.
· Experience managing an application support function at a financial institution.
· 7 or more years'' experience performing application support at a financial institution
· Knowledge and experience with SQL and relational database structures, primarily Oracle and Sybase.
· Knowledge of ETL, KYC, Enterprise data lakes – Data acquisition, data discovery tools and Enterprise Data Dictionary.
· Knowledge of active directory, LDAP and Kerberos authentication.
· Hands on experience on Hadoop platform.
· Knowledge of data acquisition, data factory and data services tools e.g. Attunity, LORE, Global ID, Waterline, TAMR and IBM datastage.
· Hands on experience of Linux/Windows platforms.
Knowledge of the SDLC and tools such as Source Repositories, Automated Building, and Release Management