Skip to main content

Module inference_methods

Module inference_methods 

Source
Expand description

Canonical InferenceRequest union discriminants.

The values are the Cap’n Proto union discriminants: 0-based DECLARATION order of the members in hyprstream-rpc-std/schema/inference.capnp — NOT the members’ explicit @N field ordinals (generateStream is @1 on the wire-field axis but carries union discriminant 0). Every member declares $dispatchMac("internal:pq-hybrid"), so every row these constants index carries the schema-declared hybrid label. The drift test in this module decodes real serialized requests and pins representative values to the schema; changing the union order fails CI rather than silently relabeling the dispatch plane.

Constants§

APPLY_CHAT_TEMPLATE
CLEAR_SESSION
CREATE_LORA
CREATE_LORA_STREAM
EMBED
EXPORT_PEFT_ADAPTER
EXPORT_PEFT_ADAPTER_STREAM
GENERATE_STREAM
generateStream — tenant-authorized streaming generation.
GET_DELTA_STATUS
GET_LAYER_PROFILE
HAS_LORA
HEALTH_CHECK
IS_READY
LOAD_LORA
LOAD_LORA_STREAM
MERGE_LORA
MERGE_LORA_STREAM
MODEL_INFO
RELEASE_SESSION
SAVE_ADAPTATION
SAVE_ADAPTATION_STREAM
SAVE_LORA
SAVE_LORA_STREAM
SET_SESSION
SHUTDOWN
shutdown — engine lifecycle management ($scope(manage)).
SNAPSHOT_DELTA
SNAPSHOT_DELTA_STREAM
TRAIN_STEP
TRAIN_STEP_STREAM
TTT_EVICT
TTT_WRITEBACK
TTT_ZERO
UNLOAD_LORA