Job Description :
As a Cloudera Administrator, you will help to implement a Hadoop Platform in the Shared Services organization of a large Public Sector banking client. You will consult on the design and build of an automated provisioning solution
allowing rapid deployment of the platform. You will also document how the solution will be monitored and will interface to internal monitoring systems. You will also assist with the certification process for complying with security policies.
This position is based out of Richmond and we are looking for US Citizens/GC candidates.
As a Cloudera Administrator, You Will:
· Work with internal technical staff with expertise in Puppet to assist in creation and configuration of Puppet to templatize required components to define nodes.
· Work with technical staff to assist in creation of bash/python scripts which will ready nodes for an installation of Cloudera Data Hub (“CDH”) via Cloudera Manager (“CM”
· Produce step-by-step documentation for provisioning CDH via CM. Components of Cloudera to be documented include the Hadoop Distributed File System (“HDFS”); Impala, Oozie, Hbase, SOLR, Hue, Spark, YARN, Hive, Navigator.
· Installation scripts and documentation will include the following security components:
o Kerberos, KeyTrustee, encryption, Sentry
· Create templates for selected Bare Metal Automatic Deployment solution like Puppet Enterprise and Puppet Razor (collectively “Puppet”) which will allow bootstrap and then installation of a Hadoop solution using the standard configuration templates.
· Create standard configuration templates which may be later adjusted by the client or vendor and which will be used to deploy, install and operate a Hadoop solution.
· Use software (Cloudera Manager and Cloudera Navigator Server) features to publish events to the Monitoring system (Omnipoint
· Develop a Monitoring Strategy and Solution that connects to the event management solution - syslog format.
· Create work instructions for the following discrete steps:
o Expansion of Hadoop cluster by adding a new node.
o Non-disruptively patching a Hadoop cluster with latest software.
o Non-disruptively updating the firmware on one of the Hadoop x86 systems.
o Shrinking a Hadoop cluster.
o Recovery from failure of a single Hadoop x86 system.
o Disaster recovery testing.
o Adding a complete new additional site at an additional location.
· System compliance with SAFR standards/policies.
· Provide guidance to the client security team
o Document controls, steps, procedures and personnel requirements specific to vendor software.
o Classify access and authorization to conform with SAFR.
o Assess vendor system components relative to requirements for conformance.
o Confirm support for requirement.
o When requirement is not met:
· Define and document a plan to resolve requirement.
· Assist security team to resolve requirement.
· Provisioning
· Manual builds that cannot be built through current automation.
o Install featured software/database components.
o Implement and configure environments for disaster recovery and high availability.
· Build Support
o Deploy project-related support during project lifecycle.
o Participate in testing customer applications as support during specific project phases.
o Support Business Recovery Testing (“BRT”) and Technical Readiness Testing (“TRT”) activities.
o Update technical readiness checklists in response to environmental configuration changes.
· Request Fulfillment
o Fulfill standard requests to build new data nodes and adding supporting components.
o Fulfill standard change requests to configure existing data nodes or adding supporting components.
· Incident and Problem Management
o Provide incident management support, including participation in National IT’s post-incident Problem Quality Assurance Review (“PQAR”) and Proactive Problem Management (“PPM”) processes.
o Provide problem management support, including contributing to Root Cause Analysis (“RCA”) and After Action Review (“AAR”) documentation, and the subsequent action items associated with those documents.
· Compliance Management
o Remediate or document nonstandard configurations.
o Develop technical solutions for vulnerability alerts.
o Analyze and develop or identify short term and long term solution compliance enforcement mechanisms