Job Description :
Job Description::
Experience with large scale Big Data and AI/ML platform engineering with recent coding experience in one or more of the following languages: Java, Python
Experience in developing streaming/batch Big Data processing framework for Data Ingestion, Data Cataloging, Data Transformation and Data Distribution
Experience in developing AI/ML platform for model development, management and deployment
Experience in developing Hybrid Cloud Orchestration, Management and Monitoring platform for Virtual Machines and Containers
Experience is implementing full stack Cloud and Big Data security
Experience in developing monitoring and logging frameworks
Problem solving and debugging skills
Required Skills::
Big Data Processing Technologies: Spark/Flink, Nifi, Kafka, RESTful, Java, Python
Big Data Storage: Object Store, HDFS, Hive, Presto, Data Warehouse, NoSQL(HBase/Cassandra), SQL
AI/ML Technologies: Jupyter Lab, TensorFlow, CubeFlow, PyTorch, Pachyderm, Argo
Cloud: Google/AWS/Azure
DevOps: Terraform, VM’s, Docker, Kubernetes, Jenkins, Prometheus
Cloud & Big Data Security: Authentication, Authorization, Data Encryption, Key Management for big data stores