Structs§
- Chat
Message - Generated from Cap’n Proto struct ChatMessage
- Chat
Template Request - Generated from Cap’n Proto struct ChatTemplateRequest
- Delta
Status Result - Generated from Cap’n Proto struct DeltaStatusResult
- Embed
Images Request - Generated from Cap’n Proto struct EmbedImagesRequest
- Embed
Images Response - Generated from Cap’n Proto struct EmbedImagesResponse
- Export
Peft Request - Generated from Cap’n Proto struct ExportPeftRequest
- Export
Peft Result - Generated from Cap’n Proto struct ExportPeftResult
- Generation
Request - Generated from Cap’n Proto struct GenerationRequest
- Health
Status - Generated from Cap’n Proto struct HealthStatus
- Inference
Client - Auto-generated client for the Inference service.
- Layer
Profile Result - Generated from Cap’n Proto struct LayerProfileResult
- Lora
Config - Generated from Cap’n Proto struct LoraConfig
- Merge
Lora Request - Generated from Cap’n Proto struct MergeLoraRequest
- Method
Schema - Schema metadata for a single RPC method.
- Model
Info - Generated from Cap’n Proto struct ModelInfo
- Module
Norm Ratio - Generated from Cap’n Proto struct ModuleNormRatio
- Param
Schema - Schema metadata for a single RPC method parameter.
- Save
Adaptation Request - Generated from Cap’n Proto struct SaveAdaptationRequest
- Save
Adaptation Result - Generated from Cap’n Proto struct SaveAdaptationResult
- Snapshot
Delta Result - Generated from Cap’n Proto struct SnapshotDeltaResult
- Tool
Call - Generated from Cap’n Proto struct ToolCall
- Tool
Call Function - Generated from Cap’n Proto struct ToolCallFunction
- Train
Step Request - Generated from Cap’n Proto struct TrainStepRequest
- Train
Step Result - Generated from Cap’n Proto struct TrainStepResult
Enums§
- Adaptation
Strategy - Generated from Cap’n Proto enum AdaptationStrategy
- Dispatch
Result - Result of a dispatch call — either a JSON response or a streaming setup.
- Finish
Reason - Generated from Cap’n Proto enum FinishReason
- Inference
Response Variant - Response variants for the InferenceResponseVariant service.
- Role
- Generated from Cap’n Proto enum Role
Traits§
- Inference
Rpc - Generated RPC trait for the Inference service.
Functions§
- dispatch
- Transport-agnostic JSON dispatch for this service.
- render_
doc - Render documentation for this service.
- schema_
metadata - Schema metadata for the Inference service.
- scoped_
client_ tree - Returns the scoped client tree metadata for dynamic CLI/MCP dispatch.
- vfs_
nodes - Generated 9P/VFS node table for the inference service (epic #539).