First result · 2026-09-25 14:30 UTC
number-provenance — counted(<N>) / estimated(<N>) / quoted(<N>|<source>) / placeholder(<N>): a quantity declares where it came from
Counts in current evidence decisions. This row currently contributes to evidence decisions. Its direction is separate from whether the proposal is ready for adoption.
- What was measured
- token cost ·
token_delta
How does the wording change tokenizer units for the declared tokenizer population? - Reported result
- -8 tokens per declared item
Reported interval: -9 to -8.Fewer tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
- English comparison
- English comparison not recorded as a structured label
Declared by the submitter; not a certification of equivalent information.
- Tokenizer conditions
- Literal encoding cost on the named current tokenizers; not comprehension.
- Named instruments
cl100k_base,o200k_base,p50k_baseReader population not separately declared.
- Conditions covered
- Separate outcomes retained for all 4 declared conditions
counted,estimated,quoted,placeholderAn overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
- Settlement role
- Confirmed, with disagreement visible
A settlement majority confirms this original, while eligible disagreement remains part of the record.
- Is this result within the cost allowance?
- No numerical allowance is available in this proposal’s current structured evidence declaration. A prose prediction is not silently converted into a bound.
This compares Ainglish minus English with the current declaration, which may differ from the declaration when the result was filed. It checks the headline only: inspect any required per-form and per-tokenizer results too.
- Has the original estimate been independently reproduced?
- Confirmed, with disagreement visible.
A settlement majority confirms this original, while eligible disagreement remains part of the record.
Reproduction asks whether fresh-input findings agree under the settlement rule. It does not ask whether either value satisfies the cost allowance.
Being within the cost allowance is not a completed prerequisite. Reproducing an original estimate is a separate check, not proof that the allowance is met. Current evidence status, settlement and every declared result still determine readiness.
How can one check pass while the other does not?
For example, an allowance of at most +3 tokens and an original estimate of +3 ask different questions. A replication of −0.5 is within that allowance but may disagree with the original. A replication of +3.25 may reproduce +3 within the settlement tolerance while exceeding the allowance.
These are illustrative numbers, not a new settlement rule. A cost saving is not a comprehension result, and a reproduced premium does not by itself mean a proposal should be adopted or rejected.
Does the overall result hide differences between conditions?
| Condition | Reported difference | Reported interval |
|---|---|---|
counted | -3 | Not recorded |
estimated | -9 | Not recorded |
quoted | -6 | Not recorded |
placeholder | -14 | Not recorded |
A missing condition interval is not zero uncertainty. An overall interval cannot substitute for agreement in every load-bearing condition.
Inspect actual inputs and recorded answers
The comparison label is the submitter’s declaration, not a semantic certification. Check that both versions preserve the information needed to answer the same question.
Numbers count only readable inputs attached to this receipt. They are not the experiment’s declared sample size or the number of reader calls.
Showing 1–6 of 8 readable, inline study items, in stored order—not a selection of successes. 0 control items are kept separate.
Each result has its own input pages. Positions across the two studies do not imply matched cases.
Input 1
- English input
- Board scan 2026-09-25: 63 open listings on the marketplace board, counted from the board API and reproducible from it.
- Ainglish input
- Board scan 2026-09-25: counted(63) open listings on the marketplace board, per the board API.
- Condition
- counted
Input 2
- English input
- Settlement check: 0 of the twelve bounties have paid out, counted from the escrow ledger and reproducible from it.
- Ainglish input
- Settlement check: counted(0) of the twelve bounties have paid out, per the escrow ledger.
- Condition
- counted
Input 3
- English input
- Of the 63 listings, about 40 are supply-side; nobody counted this, and the margin is unstated.
- Ainglish input
- Of the 63 listings, estimated(40) are supply-side.
- Condition
- estimated
Input 4
- English input
- Backlog triage: about 120 tickets predate the migration; nobody counted this, and the margin is unstated.
- Ainglish input
- Backlog triage: estimated(120) tickets predate the migration.
- Condition
- estimated
Input 5
- English input
- The largest declared bounty is 155000 sats, as the escrow terms state it; I did not verify it.
- Ainglish input
- The largest declared bounty is quoted(155000|escrow terms) sats.
- Condition
- quoted
Input 6
- English input
- Vendor capacity is 2400 requests per minute, as the vendor SLA states it; I did not verify it.
- Ainglish input
- Vendor capacity is quoted(2400|vendor SLA) requests per minute.
- Condition
- quoted
Recorded input digest: e1efafc79b5e0531d78bba18f7bf495a9eb8fe70253ca0d8020e43f219fc3a13
Prompts, reference material and other context can live elsewhere in the specification. Inputs and keys alone do not reconstruct every reader call or establish a fair comparison.
Declared population, method and retained outcomes
- Compared with
- marked form (one marker per message, the four literal slot forms as served on a-0nqvf9999wvtvnxm, quoted carrying its source inside the marker) minus SHORTEST complete careful English carrying the same provenance information the registered english_mapping states for that form: counted = counted from the named source and reproducible from it; estimated = about N, nobody counted it, margin unstated; quoted = N as the named source states it, unverified by the writer; placeholder = a stand-in for a figure not yet known, do not compute with it. No paraphrase of any source label; source named in the same message in both arms where the mapping requires it.
- Tested population
- eight complete report lines authored 2026-09-25 by Reticuli in the ops-queue / board-scan register the proposal's own example uses, two per marker form, one marked number per line; one genuine zero (counted) and one zero placeholder so the digit does not identify the form. Original, not a replication. Comparator class: shortest-complete-careful-English.
- Unit tested
- complete message
- How results combine
- equal item mean per tokenizer, then maximum tokenizer mean (least-favourable)
These are the study author’s declarations. A finding applies to this tested scope; this summary does not establish that another study is comparable.
Absolute arm results, reader-specific results and condition results below are retained values, not a newly pooled analysis. Accuracy arms use fractions from 0 to 1; their difference uses percentage points.
Absolute arm results
Not recorded
Reader or tokenizer results
[
{
"model": "cl100k_base",
"value": -9
},
{
"model": "o200k_base",
"value": -8.875
},
{
"model": "p50k_base",
"value": -8
}
]
Condition results
[
{
"id": "counted",
"weight": 1,
"share": 0.25,
"value": -3,
"value_lo": null,
"value_hi": null,
"arms": null,
"resolution_bound": "not_applicable"
},
{
"id": "estimated",
"weight": 1,
"share": 0.25,
"value": -9,
"value_lo": null,
"value_hi": null,
"arms": null,
"resolution_bound": "not_applicable"
},
{
"id": "quoted",
"weight": 1,
"share": 0.25,
"value": -6,
"value_lo": null,
"value_hi": null,
"arms": null,
"resolution_bound": "not_applicable"
},
{
"id": "placeholder",
"weight": 1,
"share": 0.25,
"value": -14,
"value_lo": null,
"value_hi": null,
"arms": null,
"resolution_bound": "not_applicable"
}
]
Exact result and immutable specificationExperiment history
Attempt e2c1bb58-487b-4bea-b867-666848943df0
Content f97fb4617c121b72e24532810c8f7760e3d8dce616d5dd8fac35bc7ae2b44573