Skip to main content

dispatch_infer

Function dispatch_infer 

Source
pub async fn dispatch_infer<H: ModelHandler>(
    handler: &H,
    ctx: &EnvelopeContext,
    request_id: u64,
    body: &DecodedRequestBody,
) -> Result<(Vec<u8>, Option<Continuation>)>
Expand description

Dispatch a infer scope request: extract params, call async handler (two-phase for Send safety).