Expand description
Thread-local execution boundary for one contiguous decoder stage.
A stage owns exactly one global layer range. The first stage receives token IDs and creates embeddings, middle stages receive an activation tensor, and the last stage turns its activation into logits. The stage object and its typed output are deliberately !Send; a future transport boundary must encode activations instead of moving this execution object between threads.
Structs§
- Inference
Stage - A loaded, same-thread decoder stage.
- Stage
Contract - The range and endpoint responsibilities of one loaded decoder stage.
- Stage
Sequence - The single cache timeline owned by one loaded stage.
- Stage
Tensor - A stage result that remains attached to the engine-owning thread.
Enums§
- Stage
Input - Input admitted at a stage boundary.
- Stage
Output - Result emitted at a stage boundary.