Skip to main content

handle_training_batch

Function handle_training_batch 

Source
pub async fn handle_training_batch(
    registry: &RegistryClient,
    policy_transport: TransportConfig,
    model_ref_str: &str,
    input_files: Vec<String>,
    input_dir: Option<PathBuf>,
    pattern: &str,
    format: &str,
    max_tokens: usize,
    chunk_size: usize,
    skip: usize,
    limit: Option<usize>,
    progress_interval: usize,
    checkpoint_interval: usize,
    test_set: Option<String>,
    max_context: Option<usize>,
    kv_quant: KVQuantArg,
    signing_key: SigningKey,
    verifying_key: VerifyingKey,
) -> Result<()>
Expand description

Handle training batch command

Batch training: starts InferenceService once and processes all files with TTT. Each file’s content is sent as a generation request, triggering TTT adaptation.