V1alpha1InferenceGraphSpec¶
InferenceGraphSpec defines the InferenceGraph spec
Properties¶
Name | Type | Description | Notes |
---|---|---|---|
nodes | dict(str, V1alpha1InferenceRouter) | Map of InferenceGraph router nodes Each node defines the router which can be different routing types |