Mohammad Asif Siddiqui
Designation: Senior Technical Leader
Company: Huawei Technologies Co., Ltd
Topic: A Kubernetes Native DevOps System for AI/ML and BigData Applications
Track: DevOps Day
Date and Time: 18th October 2019 05:30 PM to 06:00 PM
Asif is a Senior Technical Leader in Huawei Cloud team and has been working on developing Kubernetes native system for HPC Workloads. His focus areas lies on resource management, resource scheduling, enterprise integrations and microservices for distributed systems and hybrid cloud solutions. He is a member of an Apache IMPC(Incubator Project Management Committee) and a Release Manager of Apache ServiceComb.
Kubernetes started as a general purpose orchestration framework with a focus on serving jobs. But as it gains popularity, users want to migrate the DevOps for HPC Workloads to Kubernetes. Running these types of Workloads(Spark, TensorFlow etc) in kubernetes needs advanced capabilities like batch intelligent scheduling, job management and data management. This talk will address these issues and discuss various frameworks available in Opensource which can be used to run DevOps jobs for AI/ML and BigData Applications.