Skip to content


Batcher specifies optional payload batching available for all components


Name Type Description Notes
max_batch_size int Specifies the max number of requests to trigger a batch [optional]
max_latency int Specifies the max latency to trigger a batch [optional]
timeout int Specifies the timeout of a batch [optional]

[Back to Model list] [Back to API list] [Back to README]

Back to top