Job Description :
Day to Day maintenance activities including but not limited to Log monitoring and cleanup, Cluster monitoring, deployments, production support and performance tuning
Build and administer Cloudera Hadoop cluster in multiple environments involving Kafka, Zookeeper, Spark, Yarn, Hive, HBase, Impala, MapReduce, MySQL, Oozie, Solr and Nifi services
Build, Tune and administer Search and Index frameworks like Solr and Elastic Search
Build, Tune and administer HBase cluster in multiple environments
Automate daily administrative tasks to guarantee high availability of systems, applications and data
Troubleshoot issues with applications, services and clusters in multiple environments
Implement and administer Active-Active cluster configuration for Disaster Recovery
Manage cluster hardening activities with security implementation to enforce data governance for the data accessed by data scientists and analysts using Sentry and LDAP integration
Performance tune cluster services in multiple environments
Capacity planning for cluster upgrades
Setup Monitoring and Alerting for applications and services on the clusters using tools like Splunk.
Automate data and log backups and archival
Automate log analysis and setup alerting
Build, Maintain and administer clusters to support highly available and fast real-time streaming applications
Daily communication with Business and Technical teams to understand the needs and build, maintain and support environments that help solve the use cases
Cluster patching activities
Cluster upgrades when required