Job Description :
Title: Platform Engineer Location: Toronto Duration: Contract Job Description: Responsible for the platform building, monitoring, tuning, and troubleshooting. E.g. Installation and configuration, tooling integration, process automation, and platform management. Administration experience on Hadoop platform. Strong proficiency in Linux shell scripting and system administration. Familiar with Hadoop data management methodology and all the security implementations of Hadoop Eco system. E.g. Atlas, Ranger, Knox, Hive Metastore, AD/LDAP etc. Work with Big Data tools and building high performance, high throughput, and distributed data pipeline and big data platform with Hadoop, NiFi, Talend, Kafka, Hive, and Presto etc. Experience with S3 object storage technology. E.g. MinIO Experience with RDBMS and NOSQL. Troubleshoot, system capacity, bottlenecks, basics of memory, CPU, kernel, and storage. Test, monitor, administer, optimize and operate multiple big data clusters on premise and/or in cloud. Partner with ETL developers in building best practices for Data Warehouse and analytics environment. Documents and maintains operational procedures and processes. Familiarity with networking, firewalls and load balancing. Experience with Cloud infrastructure and Virtual Environments: KVM, Docker or Kubernetes. Familiarity with using orchestration systems, and automation tools such as Puppet, Chef, Ansible or Saltstack