Announcing KServe v0.7 - Smooth Transition from KFServing to KServe
Published on October 11, 2021
KFServing is now KServe and KServe 0.7 release is available, the release also ensures a smooth user migration experience from KFServing to KServe.
โ ๏ธ What's Changedโ
InferenceService
API group is changed fromserving.kubeflow.org
toserving.kserve.io
#1826, the migration job is created for smooth transition.- Python SDK name is changed from kfserving to kserve.
- KServe Installation manifests #1824.
- Models-web-app is separated out of the kserve repository to models-web-app.
- Docs and examples are moved to separate repository website.
- KServe images are migrated to kserve docker hub account.
- v1alpha2 API group is deprecated #1850.
๐ What's Newโ
-
ModelMesh project is joining KServe under repository modelmesh-serving!
ModelMesh is designed for high-scale, high-density and frequently-changing model use cases. ModelMesh intelligently loads and unloads AI models to and from memory to strike an intelligent trade-off between responsiveness to users and computational footprint. To learn more about ModelMesh features and components, check out the ModelMesh announcement blog and Join talk at #KubeCon NA to get a deeper dive into ModelMesh and KServe.
-
(Alpha feature) Raw Kubernetes deployment support, Istio/Knative dependency is now optional and please follow the guide to install and turn on
RawDeployment
mode. -
KServe now has its own documentation website temporarily hosted on website.
-
Support v1 crd and webhook configuration for Kubernetes 1.22 #1837.
-
Triton model serving runtime now defaults to 21.09 version #1840.
๐ง What's Fixedโ
- Bug fix for Azure blob storage #1845.
- Tar/Zip support for all storage options #1836.
- Fix AWS_REGION env variable and add AWS_CA_BUNDLE for S3 #1780.
- Torchserve custom package install fix #1619.
๐ Release Notesโ
For complete release notes including all changes, bug fixes, and known issues, visit the GitHub release page.
๐ Acknowledgmentsโ
We want to thank all the contributors who made this release possible:
Individual Contributors:
- Andrews Arokiam
- Animesh Singh
- Chin Huang
- Dan Sun
- Jagadeesh
- Jinchi He
- Nick Hill
- Paul Van Eck
- Qianshan Chen
- Suresh Nakkiran
- Sukumar Gaonkar
- Theofilos Papapanagiotou
- Tommy Li
- Vedant Padwal
- Yao Xiao
- Yuzhui Liu
Core Contributors: The KServe maintainers and working group members
Community: Everyone who reported issues, provided feedback, and tested features during this important transition
๐ค Join the Communityโ
- Visit our Website or GitHub
- Join the Slack (#kubeflow-kfserving)
- Attend a Biweekly community meeting on Wednesday 9am PST
- Contribute at developer and doc contribution guide to make code or doc contributions. We are excited to work with you to make KServe better and promote its adoption by more and more users!
Happy serving!
The KServe team is committed to making machine learning model serving simple, scalable, and standardized. Thank you for being part of our community during this important transition!