Skip to main content

GenerationRequest

Type Alias GenerationRequest 

Source
pub type GenerationRequest = GenerationRequest;

Aliased Type§

pub struct GenerationRequest {
Show 16 fields pub prompt: String, pub max_tokens: Option<u32>, pub temperature: Option<f32>, pub top_p: Option<f32>, pub top_k: Option<u32>, pub repeat_penalty: Option<f32>, pub repeat_last_n: Option<u32>, pub stop_tokens: Option<Vec<String>>, pub seed: Option<u32>, pub images: Option<Vec<Vec<u8>>>, pub timeout_ms: Option<u64>, pub ttt_enabled: bool, pub ttt_gradient_steps: Option<u32>, pub ttt_learning_rate: Option<f32>, pub adaptation_strategy: AdaptationStrategy, pub writeback_threshold: Option<f32>,
}

Fields§

§prompt: String§max_tokens: Option<u32>§temperature: Option<f32>§top_p: Option<f32>§top_k: Option<u32>§repeat_penalty: Option<f32>§repeat_last_n: Option<u32>§stop_tokens: Option<Vec<String>>§seed: Option<u32>§images: Option<Vec<Vec<u8>>>§timeout_ms: Option<u64>§ttt_enabled: bool§ttt_gradient_steps: Option<u32>§ttt_learning_rate: Option<f32>§adaptation_strategy: AdaptationStrategy§writeback_threshold: Option<f32>