Skip to main content

preflight_gpu_check

Function preflight_gpu_check 

Source
pub fn preflight_gpu_check(
    device: Device,
    estimated_model_size_mb: f64,
) -> Result<(), Error>
Expand description

Pre-flight check before loading a model

Attempts to detect if there’s enough GPU memory before starting to load a model. This is a best-effort check.