Skip to main content

ANN_GPU_REQUEST

Constant ANN_GPU_REQUEST 

Source
pub const ANN_GPU_REQUEST: &str = "hyprstream.io/gpu-request";
Expand description

Annotation key: per-request GPU count demand (a plain non-negative integer string, e.g. "1"). Independent of oci_backend’s existing boolean hyprstream.io/gpu passthrough flag — see module docs, point 4.