Skip to main content

dispatch_inference

Function dispatch_inference 

Source
pub async fn dispatch_inference<H: InferenceHandler>(
    handler: &H,
    ctx: &EnvelopeContext,
    body: &DecodedRequestBody,
) -> Result<(Vec<u8>, Option<Continuation>)>
Expand description

Dispatch a Inference request: deserialize, call handler, serialize response.