Skip to main content

chat_completion_via_api

Function chat_completion_via_api 

Source
pub async fn chat_completion_via_api(
    base_url: &str,
    lora_id: &str,
    messages: &[Value],
    max_tokens: Option<usize>,
    temperature: Option<f32>,
    stream: bool,
) -> Result<Value, Box<dyn Error>>
Expand description

Perform chat completion via REST API