Skip to main content

MAX_SERIALIZED_SPEC_TOKENS

Constant MAX_SERIALIZED_SPEC_TOKENS 

Source
pub const MAX_SERIALIZED_SPEC_TOKENS: usize = 2048;
Expand description

The serialized-spec token budget at the 2k-token serving context. Exceeding it makes the two-stage >255 recipe mandatory. Enforced with the real tokenizer in P1.1; this constant is the contract.