V1beta1Batcher¶
Batcher specifies optional payload batching available for all components
Properties¶
Name | Type | Description | Notes |
---|---|---|---|
max_batch_size | int | Specifies the max number of requests to trigger a batch | [optional] |
max_latency | int | Specifies the max latency to trigger a batch | [optional] |
timeout | int | Specifies the timeout of a batch | [optional] |