Types

class bentoml.types.InferenceTask(*args, **kwds)

The data structure passed to the BentoML API server for inferring. Contains payload data and context like HTTP headers or CLI args.

class bentoml.types.InferenceResult(*args, **kwds)

The data structure that returned by BentoML API server. Contains result data and context like HTTP headers.

class bentoml.types.InferenceError(*args, **kwds)

The default InferenceResult when errors happened.