KServe Documentation Website

V1beta1InferenceServiceSpec

GitHub

KServe Documentation Website

GitHub

Home
Getting started
Getting started
Administration Guide
Administration Guide
- Install KServe
  Install KServe
  - Serverless
    Serverless
    
    Serverless installation
    
    Istio Service Mesh
    
    Kourier Networking Layer
  - ModelMesh installation
  - Kubernetes deployment installation
  - Migrating from KFServing
User Guide
User Guide
- Concepts
  Concepts
  - Control Plane
    Control Plane
    
    Model Serving Control Plane
  - Data Plane
    Data Plane
    
    Model Serving Data Plane
    
    V1 Inference Protocol
    
    Open Inference Protocol (V2 Inference Protocol)
  - Serving Runtimes
- Model Serving Runtimes
  Model Serving Runtimes
  - Supported Model Frameworks/Formats
    Supported Model Frameworks/Formats
    
    Overview
    
    Tensorflow
    
    PyTorch
    
    Scikit-learn
    
    XGBoost
    
    PMML
    
    Spark MLlib
    
    LightGBM
    
    Paddle
    
    MLFlow
  - Multi-Framework Serving Runtimes
    Multi-Framework Serving Runtimes
    
    Nvidia Triton
    Nvidia Triton
    
    Torchscript
    
    Tensorflow
    
    AMD
  - LLM Runtime
    LLM Runtime
    
    TorchServe LLM
    TorchServe LLM
    
    Bloom7b1
  - How to write a custom predictor
- Multi Model Serving
  Multi Model Serving
  - Overview
    Overview
    
    The Scalability Problem
    
    ModelMesh Overview
- Transformers
  Transformers
- Inference Graph
  Inference Graph
  - Concept
  - Image classification inference graph
- Model Storage
  Model Storage
  - Storage Containers
  - Azure
  - PVC
  - S3
  - URI
- Model Explainability
  Model Explainability
  - Concept
  - Alibi Explainer
    Alibi Explainer
    
    Image Explainer
    
    Income Explainer
    
    Text Explainer
  - AIX Explainer
- Model Monitoring
  Model Monitoring
- Request Batching
  Request Batching
  - Inference Batcher
- Payload Logging
  Payload Logging
  - Inference Logger
- Autoscaling
  Autoscaling
  - Inference Autoscaling
- Node Scheduling
  Node Scheduling
  - Overview
  - InferenceService Node Scheduling
- Kafka
  Kafka
  - Inference with Kafka event source
- Rollout Strategies
  Rollout Strategies
  - Canary
  - Canary Example
- Inference Observability
  Inference Observability
  - Prometheus Metrics
  - Grafana Dashboards
API Reference
API Reference
Developer Guide
Developer Guide
- How to contribute
- Debugging guide
Blog
Blog
- Releases
  Releases
- Articles
  Articles
  - KFserving Transition
Community
Community
- Adopters
- Demos and Presentations

V1beta1InferenceServiceSpec¶

InferenceServiceSpec is the top level type for this resource

Properties¶

Name	Type	Notes
explainer	V1beta1ExplainerSpec	[optional]
predictor	V1beta1PredictorSpec
transformer	V1beta1TransformerSpec	[optional]

[Back to Model list] [Back to API list] [Back to README]