Skip to content

Serverless Installation Guide

KServe Serverless installation enables autoscaling based on request volume and supports scale down to and from zero. It also supports revision management and canary rollout based on revisions.

Kubernetes 1.22 is the minimally required version and please check the following recommended Knative, Istio versions for the corresponding Kubernetes version.

Kubernetes Version Recommended Istio Version Recommended Knative Version
1.27 1.18,1.19 1.10,1.11
1.28 1.19,1.20 1.11,1.12.4
1.29 1.20,1.21 1.12.4,1.13.1

1. Install Knative Serving

Please refer to Knative Serving install guide.

Note

If you are looking to use PodSpec fields such as nodeSelector, affinity or tolerations which are now supported in the v1beta1 API spec, you need to turn on the corresponding feature flags in your Knative configuration.

Warning

Knative 1.13.1 requires Istio 1.20+, gRPC routing does not work with previous Istio releases, see release notes.

2. Install Networking Layer

The recommended networking layer for KServe is Istio as currently it works best with KServe, please refer to the Istio install guide. Alternatively you can also choose other networking layers like Kourier or Contour, see how to install Kourier with KServe guide.

3. Install Cert Manager

The minimally required Cert Manager version is 1.9.0 and you can refer to Cert Manager.

Note

Cert manager is required to provision webhook certs for production grade installation, alternatively you can run self signed certs generation script.

4. Install KServe

kubectl apply -f https://github.com/kserve/kserve/releases/download/v0.13.0/kserve.yaml

5. Install KServe Built-in ClusterServingRuntimes

kubectl apply -f https://github.com/kserve/kserve/releases/download/v0.13.0/kserve-cluster-resources.yaml

Note

ClusterServingRuntimes are required to create InferenceService for built-in model serving runtimes with KServe v0.8.0 or higher.

Back to top