KServe Presentations and Demos
This page contains a collection of presentations, demos, and talks about KServe from various conferences, meetups, and community events. If you'd like to add a presentation or demo here, please send a pull request to the KServe website repository.
Conference Talks by Year
2023
| Event | Title | Speaker(s) | Resources |
|---|---|---|---|
| KubeCon EU | The State and Future of Cloud Native Model Serving | Dan Sun, Theofilos Papapanagiotou | Video |
| Kubeflow Summit | Scale your Models to Zero with Knative and KServe | Jooho Lee | Video |
| Kubeflow Summit | What to choose? ModelMesh vs Model Serving? | Vaibhav Jain | Video |
| KubeCon | Platform Building Blocks: How to Build ML Infrastructure with CNCF Projects | Yuzhui Liu, Leon Zhou | Info |
| ML Systems Conference | Optimizing Load Balancing and Autoscaling for LLM Inference on Kubernetes | David Gray | Video |
| ML/AI Conference | Best Practices for Deploying LLM Inference, RAG and Fine Tuning Pipelines | Meenakshi Kaushik, Shiva Krishna Merla | Video |
| KubeCon | Production AI at Scale: Cloudera's Journey Adopting KServe | Zoram Thanga, Peter Ableda | Video |
| KubeCon | From Bash Scripts to Kubeflow and GitOps: Our Journey to Operationalizing ML at Scale | Luca Grazioli, Dennis Ohrndorf | Video |
| KubeCon | Production-Ready AI Platform on Kubernetes | Yuan Tang | Video |
| KubeCon | Fortifying AI Security in Kubernetes with Confidential Containers | Suraj Deshmukh, Pradipta Banerjee | Video |
| KubeCon AI Days | Advancing Cloud Native AI Innovation Through Open Collaboration | Yuan Tang | Video |
| KubeCon | Engaging the KServe Community | Adam Tetelman, Taneem Ibrahim, Johnu George, Tessa Pham, Andreea Munteanu | Video |
2022
| Event | Title | Speaker(s) | Resources |
|---|---|---|---|
| KubeCon AI Days | Exploring ML Model Serving with KServe | Alexa Nicole Griffith | Video |
| KubeCon AI Days | Enhancing the Performance Testing Process for gRPC Model Inferencing at Scale | Ted Chang, Paul Van Eck | Video |
| KubeCon Edge Days | Model Serving at the Edge Made Easier | Paul Van Eck | Video |
| KnativeCon | How We Built an ML inference Platform with Knative | Dan Sun | Video |
2021
| Event | Title | Speaker(s) | Resources |
|---|---|---|---|
| KubeCon AI Days | Serving Machine Learning Models at Scale Using KServe | Yuzhui Liu | Video |
| KubeCon | Serving Machine Learning Models at Scale Using KServe | Animesh Singh | Video |
| KubeCon China | Accelerate Federated Learning Model Deployment with KServe | Fangchi Wang & Jiahao Chen | Video |
2020
| Event | Title | Speaker(s) | Resources |
|---|---|---|---|
| NVIDIA GTC | Accelerate and Autoscale Deep Learning Inference on GPUs with KFServing | Dan Sun, David Goodwin | Video |
| ICML Workshop | Serverless inferencing on Kubernetes | Clive Cox | Video |
| Serverless Summit | Serverless Machine Learning Inference with KFServing | Clive Cox, Yuzhui Liu | Video |
| Kubeflow Dojo | KFServing - Production Model Serving Platform | Animesh Singh, Tommy Li | Video |
| Kubeflow Dojo | Demo - KFServing End to End through Notebook | Animesh Singh, Tommy Li | Video |
| Kubeflow Dojo | Demo - KFServing with Kafka and Kubeflow Pipelines | Animesh Singh | Video |
| Kubeflow Community | KFServing - Enabling Serverless Workloads Across Model Frameworks | Ellis Tarn | Video |
| Google Cloud | Kubeflow 101: What is KFServing? | Stephanie Wong | Video |
| Anchor MLOps | MLOps Coffee Sessions - Serving Models with Kubeflow | David Aponte, Demetrios Brinkmann | Podcast |
2019
| Event | Title | Speaker(s) | Resources |
|---|---|---|---|
| KubeCon | Introducing KFServing: Serverless Model Serving on Kubernetes | Dan Sun, Ellis Tarn | Video |
| KubeCon | Advanced Model Inferencing Leveraging KNative, Istio & Kubeflow Serving | Animesh Singh, Clive Cox | Video |
Books and Publications
Books
"Distributed Machine Learning Patterns"
- Author: Yuan Tang
- Publisher: Manning Publications
- Description: Covers distributed machine learning patterns including model serving with KServe
- Book Repository
Community Demos and Tutorials
Live Demos and Tutorials
"MLOps Meetup: KServe Live Coding Session"
- Speaker: Theofilos Papapanagiotou
- Features Shown: Building a KServe deployment from scratch
- Video