Skip to main content

hyprstream_bench/
lib.rs

1//! # hyprstream-bench — verifiable-outcome calibration benchmark (System One, P0.6)
2//!
3//! The program's **truth anchor**: score-bearing items with mechanically
4//! verifiable outcomes, emitted as jev-1 question specs
5//! ([`hyprstream_decision`]). Everything is **procedurally generated fresh**
6//! from published generators and pinned seeds ([`gen`]) — no public corpora
7//! in the gating strata, so the benchmark is immune to teacher-pretraining
8//! contamination by construction.
9//!
10//! ## What the release pins
11//!
12//! - **Generators + seeds** ([`gen`], [`rng::BenchRng`] — a frozen splitmix64
13//!   stream). Same config ⇒ bit-identical items, forever. The PRNG, the
14//!   canonical item bytes ([`Item::canonical_bytes`]), and the family
15//!   taxonomy are all part of the frozen contract.
16//! - **Adversarial strata** ([`Stratum`]): `clean`, `nearmiss` (near-miss
17//!   JSON, near-miss arithmetic, close distractors), reported per stratum by
18//!   the P0.2 measurement protocol.
19//! - **Cyclic-permutation stratum** (CircularEval precedent, S6b1): every
20//!   generated *choice* item is additionally emitted under all `k−1` non-
21//!   identity cyclic option rotations, linked by [`Item::group`], truth
22//!   rotating with the options — so option-order robustness (flip rate, ECE
23//!   drift) is measured at zero retraining cost. Score levels are **not**
24//!   permuted: level order is the semantics there. Noul has no options.
25//! - **Family-level holdout firewall** ([`Family::designation`],
26//!   [`Manifest::gate_families`]): `temporal` and `syllogism` are designated
27//!   **gate** families — never synthesized into training data; the P1.4
28//!   leg-(e) zero-shot transfer gate measures the model on exactly these.
29//! - **Frozen item manifest** ([`manifest`], `manifest/vob-1.0.manifest.json`):
30//!   per-item blake3 hashes, frozen before any P1.3 synthesis run. P1.3
31//!   consumes the manifest as its item-level contamination firewall and its
32//!   family firewall list.
33//!
34//! ## Licensing
35//!
36//! Harness: Apache-2.0. Generated items: CC-BY-4.0 (the default public
37//! release shape per the program licensing policy). See `DISCLOSURE.md` for
38//! the pre-committed disclosure language that accompanies every published
39//! result.
40
41pub mod family;
42pub mod gen;
43pub mod item;
44pub mod manifest;
45pub mod rng;
46
47pub use family::{Designation, Family, Stratum};
48pub use gen::{generate_all, BenchConfig, BASE_STRATA, DEFAULT_SEEDS_PER_STRATUM, SEED_BASE};
49pub use item::Item;
50pub use manifest::{Manifest, ManifestItem, VerifyError, RELEASE};