Skip to main content

Module serving

Module serving 

Source
Expand description

serving.hyprstream.io/v1alpha1 — InferenceService.

Serving intent for a model:branch, with autoscaling bounds and a statefulness class. The group is DNS-subspaced under hyprstream.io so it never collides with serving.kserve.io/InferenceService; KServe is an optional adapter target (K6b), never the owner of this noun.

spec is desired intent; status is observed serving truth.

Structs§

InferenceService
Serving intent for a model:branch with autoscaling bounds and a statefulness class. Subspaced under serving.hyprstream.io so it never collides with serving.kserve.io.
InferenceServiceSpec
Desired state of an InferenceService.
InferenceServiceStatus
Observed serving truth for an InferenceService. Written only by the operator.

Enums§

Statefulness
Statefulness class of a served model, which the serving controller (K6a) uses to decide autoscaling behaviour.