The Orthemology experimental program consists of two fully designed, frozen, and deterministically validated study packets. Both packets were built to test a single core question: does the framework’s occurrence-centered machinery provide measurable incremental value over matched ordinary baselines? Neither packet has been executed. No result, finding, or empirical claim exists for either study.Documentation Index
Fetch the complete documentation index at: https://mintlify.com/theislampill/orthemology/llms.txt
Use this file to discover all available pages before exploring further.
What these experiments are designed to test
Both experiments operationalize the utility hypothesis: that the framework’s explicit occurrence-anchored structure — maintained candidate families, typed and scoped evidence, route composition, per-burden closure ledgers, and episode/verdict records — provides incremental value over matched ordinary audit records carrying the same underlying facts. This is not a test of whether the framework’s structures can be written (the repository’s schemas already demonstrate that). The question is whether auditors equipped with those structures do measurably better at defect detection, false-closure prevention, and correct remedy selection than auditors working from an ordinary chronological record.The utility hypothesis is tested separately from the terminology hypothesis. A favorable result from either experiment licenses only a claim about the structure or machinery tested in that study. It transfers nothing to the other experiment, and neither can adopt or retire coined terms — that is reserved for the terminology benchmark program.
The two packets
ER-1: Episode Reification
Tests whether the joint verdict vector and episode reification structure provide incremental value over a baseline audit log. Five synthetic cases (E1–E5), two arms, and a frozen analysis script. Status: READY TO RUN, NOT RUN.
FCSP-1: False-Closure Selective Prediction
Tests whether the framework’s handling machinery reduces false-closure and improves selective-prediction behaviour. Forty synthetic items across nine scenario families, two arms, and a power simulation. Status: READY TO RUN, NOT RUN.
Current status
Both packets reachedREADY_TO_RUN through the closed readiness ladder defined by Decision 0018. The vocabulary has two dimensions — readiness state and registration state — and both are tracked separately in experiment-status.yaml.
| Packet | Readiness state | Registration state | Run exists |
|---|---|---|---|
ER-1 | READY_TO_RUN | PREREGISTRATION_READY | false |
FCSP-1 | READY_TO_RUN | PREREGISTRATION_READY | false |
The canonical and authoritative source for all packet states is
experiments/experiment-status.yaml, validated in CI by scripts/validate_experiment_readiness.py. Any summary here defers to that file.Preregistration requirement
PREREGISTRATION_READY means the packet has been locally frozen with a verified SHA-256 hash, but a Git freeze is not an external preregistration. External registry submission is an owner/external act, distinct from any repository artifact. No document in this project may describe a packet as “preregistered” without naming a real external registry record with a URL or identifier.
Both packets carry the required remaining gates before any run may proceed:
- Owner authorization of execution (model spend and run responsibility)
- External preregistration (owner/external act; optional but strongly recommended before any run)
Decision 0018
Decision 0018 resolved a structural problem: the project had described unbuilt, unregistered designs as “preregistered” and had conflated packet preparation (a project-side task) with execution (an owner-only act requiring spend and human-subjects responsibility). Decision 0018:- Defined the closed eight-state readiness vocabulary
- Defined the separate four-state registration vocabulary
- Made
experiment-status.yamlthe canonical machine-readable state index - Established freeze discipline (per-packet
FREEZE-HASH.txt) - Enforced the no-run guard: deterministic smoke tests are never empirical outcomes