hyprstream_bench/lib.rs
1//! # hyprstream-bench — verifiable-outcome calibration benchmark (System One, P0.6)
2//!
3//! The program's **truth anchor**: score-bearing items with mechanically
4//! verifiable outcomes, emitted as jev-1 question specs
5//! ([`hyprstream_decision`]). Everything is **procedurally generated fresh**
6//! from published generators and pinned seeds ([`gen`]) — no public corpora
7//! in the gating strata, so the benchmark is immune to teacher-pretraining
8//! contamination by construction.
9//!
10//! ## What the release pins
11//!
12//! - **Generators + seeds** ([`gen`], [`rng::BenchRng`] — a frozen splitmix64
13//! stream). Same config ⇒ bit-identical items, forever. The PRNG, the
14//! canonical item bytes ([`Item::canonical_bytes`]), and the family
15//! taxonomy are all part of the frozen contract.
16//! - **Adversarial strata** ([`Stratum`]): `clean`, `nearmiss` (near-miss
17//! JSON, near-miss arithmetic, close distractors), reported per stratum by
18//! the P0.2 measurement protocol.
19//! - **Cyclic-permutation stratum** (CircularEval precedent, S6b1): every
20//! generated *choice* item is additionally emitted under all `k−1` non-
21//! identity cyclic option rotations, linked by [`Item::group`], truth
22//! rotating with the options — so option-order robustness (flip rate, ECE
23//! drift) is measured at zero retraining cost. Score levels are **not**
24//! permuted: level order is the semantics there. Noul has no options.
25//! - **Family-level holdout firewall** ([`Family::designation`],
26//! [`Manifest::gate_families`]): `temporal` and `syllogism` are designated
27//! **gate** families — never synthesized into training data; the P1.4
28//! leg-(e) zero-shot transfer gate measures the model on exactly these.
29//! - **Frozen item manifest** ([`manifest`], `manifest/vob-1.0.manifest.json`):
30//! per-item blake3 hashes, frozen before any P1.3 synthesis run. P1.3
31//! consumes the manifest as its item-level contamination firewall and its
32//! family firewall list.
33//!
34//! ## Licensing
35//!
36//! Harness: Apache-2.0. Generated items: CC-BY-4.0 (the default public
37//! release shape per the program licensing policy). See `DISCLOSURE.md` for
38//! the pre-committed disclosure language that accompanies every published
39//! result.
40
41pub mod family;
42pub mod gen;
43pub mod item;
44pub mod manifest;
45pub mod rng;
46
47pub use family::{Designation, Family, Stratum};
48pub use gen::{generate_all, BenchConfig, BASE_STRATA, DEFAULT_SEEDS_PER_STRATUM, SEED_BASE};
49pub use item::Item;
50pub use manifest::{Manifest, ManifestItem, VerifyError, RELEASE};