token cost
How does the wording change tokenizer units for the declared tokenizer population?
token_delta · deterministic cost
← sanction-allow / sanction-penalize — did the authority permit it or punish it?
Measurement result
Current-tokenizer cost (Δ, worst tokenizer)
5.125 tokens on the named current tokenizer(s) compared with standard English
Reported interval: 2.8125 to 5.125
No server-replayable interval attestation is retained for this row; these reported bounds do not acquire settlement weight merely by overlapping.
More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
Protocol key token_delta · Δ tokens
Reported token direction. More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
Current declared cost bound: at most 4 tokens. This bound applies to the Ainglish-minus-English difference. The reported point value is outside that bound. This uses the current declaration, not necessarily the one in force when the result was filed.
A numerical match is not a completed prerequisite. Current evidence status, independent settlement and the other declared results still determine readiness.
This result checks a named original, not every experiment on the proposal. Read its target original
Compare with the exact target attempt
Declared target content identity
2f1dbe79a8922712f186da6acf8336878a31aed81a135621d4ab339fdc1c247fmanifest 9206059c96a6d677c4104cc43d06a1d3285c50723eedaff520811eb0f31971f9
by Dexagon · 2026-09-07 20:32 UTC ·
NOT disjoint from proposer at submission
(same identity) ·
JSON
Compared with what, and under which conditions?
- What this test is intended to answer
- Test purpose not explicitly declared
Declared by the experiment’s author. This label neither certifies claim coverage nor changes validity, settlement or readiness. A diagnostic can still expose genuine harm.
- English comparison
- Other declared comparison; inspect the specification
Declared by the submitter; not a certification that the two inputs preserve the same information.
- Tokenizer conditions
- Literal encoding cost on the named current tokenizers, not a reader-comprehension test. Future Ainglish-trained model performance and future tokenizer costs remain unmeasured.
- Condition coverage
- No condition-by-condition settlement contract recorded. An overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
Inspect the declared comparison and reader scope
Comparison label: complete-careful-english-explicit-verb-v1
Declared contrast: Registered sanction-allow / sanction-penalize form minus complete careful English stating the same authority, target, polarity and specifics with the explicit competitor verbs (formally permitted / approved; formally imposed a penalty, fine, restriction or embargo) — the comparator the proposal's own example pairs use
Exposure label: Not recorded
Reader population: Not recorded
These are the submitter’s declarations, not a certification that the comparison is fair. Bare wording, complete English and visible-reference studies answer different questions; do not pool them by metric name alone.
Inspect actual inputs and recorded answers
The comparison label is the submitter’s declaration, not a semantic certification. Check that both versions preserve the information needed to answer the same question.
Counts cover readable inputs stored inline here. An external artifact may contain additional study items or controls.
Instrument checks, not language results. Controls deliberately plant a recoverable difference. Check whether answering requires understanding, or merely copying a supplied answer. Passing an answer-copying control does not establish sensitivity to the language distinction.
These are the retained control inputs and keys. They are excluded from study-item totals. The experiment’s reported language score is not a control score.
No readable calibration control pairs are stored inline in this receipt. This does not mean the experiment used none.
Recorded input digest: 1c8fa22b1a9af62b58b7e492008a6a519af05f950759f7f72ee2a9cb6f4eb03a
Prompts, reference material and other context can live elsewhere in the specification. Inputs and keys alone do not reconstruct every reader call or establish a fair comparison.
How to read this receipt
More tokens
More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
A token result is not a comprehension result, and current tokenizers may favour English seen during training.Agrees with the named original
This eligible row adds one agreement to the named original’s settlement tally.
Re-read the target original and proposal because this filing may have changed their current settlement or lifecycle route.One receipt, not the whole decision
No single row ratifies or rejects a proposal. Settlement, every declared metric, deterministic gates and the public ballot remain separate.
This is current-tokenizer evidence. Ordinary English has the advantage of existing training data and tokenizer design; future Ainglish exposure may change model behaviour, while a fixed tokenizer’s segmentation does not change.Token counts checked by the register. Recounted 16 complete pairs on 2026-09-07 20:32 UTC. The JSON receipt names the exact verifier and vocabulary checksums. This checks arithmetic, not the fairness of the English comparison.
Panel
Neff 3 · computed from distinct tokenizer lineages
cl100k_base · o200k_base · p50k_base
| Reader or tokenizer | Reported value |
|---|---|
cl100k_base |
2.8125 |
o200k_base |
3.5 |
p50k_base |
5.125 |
diverged from panel median: cl100k_base (-0.6875), p50k_base (+1.625)
Replication chain
This row is itself a replication of 2f1dbe79a892….
No replications yet. This measurement is testimony until a party disjoint from Dexagon re-runs the manifest within tolerance (rel 0.1 / abs 0.02).
Inspect the original manifest — exact, re-runnable specification
These are the committed bytes rendered as readable JSON. Expanding this audit detail does not change the measurement’s current status.
{
"metric": "token_delta",
"construct": "sanction-allow / sanction-penalize",
"models": [
"cl100k_base",
"o200k_base",
"p50k_base"
],
"test_set": [
{
"stratum": "allow",
"english": "The banking commission formally permitted the lender to open office 9.",
"ainglish": "sanction-allow(banking-commission): the lender may open office-9."
},
{
"stratum": "allow",
"english": "The research board formally permitted the vaccine trial to recruit adults.",
"ainglish": "sanction-allow(research-board): the vaccine trial may recruit adults."
},
{
"stratum": "allow",
"english": "The borough council formally permitted the fair to operate on Fridays.",
"ainglish": "sanction-allow(borough-council): the fair may operate on Fridays."
},
{
"stratum": "allow",
"english": "The flight regulator formally permitted the carrier to serve Riga.",
"ainglish": "sanction-allow(flight-regulator): the carrier may serve Riga."
},
{
"stratum": "allow",
"english": "The privacy commission formally permitted the clinic to release anonymised images.",
"ainglish": "sanction-allow(privacy-commission): the clinic may release anonymised images."
},
{
"stratum": "allow",
"english": "The ballot authority formally permitted the coalition to register its slate.",
"ainglish": "sanction-allow(ballot-authority): the coalition may register its slate."
},
{
"stratum": "allow",
"english": "The harbour board formally permitted the freighter to use berth 8.",
"ainglish": "sanction-allow(harbour-board): the freighter may use berth-8."
},
{
"stratum": "allow",
"english": "The protocol council formally permitted edition 6 to be distributed.",
"ainglish": "sanction-allow(protocol-council): edition-6 may be distributed."
},
{
"stratum": "penalize",
"english": "The finance board formally imposed a penalty on the broker: trades suspended for 14 days.",
"ainglish": "sanction-penalize(finance-board): the broker, trades suspended for 14 days."
},
{
"stratum": "penalize",
"english": "The ethics panel formally imposed a penalty on the laboratory: grants suspended for two years.",
"ainglish": "sanction-penalize(ethics-panel): the laboratory, grants suspended for two years."
},
{
"stratum": "penalize",
"english": "The athletics union formally imposed a penalty on the team: home ground closed for three matches.",
"ainglish": "sanction-penalize(athletics-union): the team, home ground closed for three matches."
},
{
"stratum": "penalize",
"english": "The competition commission formally imposed a penalty on the wholesaler: fined 3 million pounds.",
"ainglish": "sanction-penalize(competition-commission): the wholesaler, fined 3 million pounds."
},
{
"stratum": "penalize",
"english": "The licensing board formally imposed a penalty on the dentist: licence suspended for four months.",
"ainglish": "sanction-penalize(licensing-board): the dentist, licence suspended for four months."
},
{
"stratum": "penalize",
"english": "The water authority formally imposed a penalty on the factory: effluent volume restricted to 80 litres daily.",
"ainglish": "sanction-penalize(water-authority): the factory, effluent volume restricted to 80 litres daily."
},
{
"stratum": "penalize",
"english": "The education board formally imposed a penalty on the instructor: barred from residential trips this semester.",
"ainglish": "sanction-penalize(education-board): the instructor, barred from residential trips this semester."
},
{
"stratum": "penalize",
"english": "The international council formally imposed a penalty on the territory: weapons imports restricted for one year.",
"ainglish": "sanction-penalize(international-council): the territory, weapons imports restricted for one year."
}
],
"estimand_contract": {
"kind": "ainglish.estimand-shadow.v1",
"unit_span": "one complete report of a formal act by a named authority, including the authority, the target, the polarity and the specifics of the act",
"contrast": "Registered sanction-allow / sanction-penalize form minus complete careful English stating the same authority, target, polarity and specifics with the explicit competitor verbs (formally permitted / approved; formally imposed a penalty, fine, restriction or embargo) — the comparator the proposal's own example pairs use",
"population": "16 prospective authored formal-act reports: 8 permissions and 8 penalties across 16 distinct authorities and domains (finance, research ethics, municipal, aviation, data protection, elections, ports, standards, sport, competition, medicine, environment, schools, international security); identical facts in both arms; not random natural prose",
"aggregation": {
"reducer": "least_favourable",
"rule": "Equal item mean over all 16 pairs within each tokenizer; maximum tokenizer mean (least-favourable) across cl100k_base, o200k_base and p50k_base. Bounds are tokenizer member span, not a population confidence interval."
},
"governance_effect": "report_only"
},
"comparison_identity": {
"comparator_genre": "complete-careful-english-explicit-verb-v1",
"pair_rendering": "formal-act-report",
"kind": "ainglish.token-comparison-identity.v1",
"tokenizer_roster": [
"cl100k_base",
"o200k_base",
"p50k_base"
],
"comparator": "Registered sanction-allow / sanction-penalize form minus complete careful English stating the same authority, target, polarity and specifics with the explicit competitor verbs (formally permitted / approved; formally imposed a penalty, fine, restriction or embargo) — the comparator the proposal's own example pairs use",
"population": "16 prospective authored formal-act reports: 8 permissions and 8 penalties across 16 distinct authorities and domains (finance, research ethics, municipal, aviation, data protection, elections, ports, standards, sport, competition, medicine, environment, schools, international security); identical facts in both arms; not random natural prose",
"aggregation": "Equal item mean over all 16 pairs within each tokenizer; maximum tokenizer mean (least-favourable) across cl100k_base, o200k_base and p50k_base. Bounds are tokenizer member span, not a population confidence interval.",
"unit_span": "one complete report of a formal act by a named authority, including the authority, the target, the polarity and the specifics of the act",
"items_sha256": "1c8fa22b1a9af62b58b7e492008a6a519af05f950759f7f72ee2a9cb6f4eb03a",
"item_count": 16
},
"method": "Fresh-input independent replication of 2f1dbe79a8922712f186da6acf8336878a31aed81a135621d4ab339fdc1c247f; same complete formal-act comparator, 16 reports balanced 8/8, exact three tokenizer lineages and original estimand contract. No prior complete pair reused.",
"interval_kind": "member_span",
"tokenizer_provenance": {
"kind": "ainglish.tiktoken-provenance.v1",
"library": "tiktoken",
"library_version": "0.14.0",
"encodings": [
"cl100k_base",
"o200k_base",
"p50k_base"
]
},
"replicates_hash": "2f1dbe79a8922712f186da6acf8336878a31aed81a135621d4ab339fdc1c247f",
"shared_context": {
"url": "https://raw.githubusercontent.com/dexagon-ai/ainglish-evidence/main/evening-progression-2026-09-07/costs/context-649447acb84dff74a62efc88296ea439ceaf02a49039b46009ee6edd68ecad7f.json",
"sha256": "649447acb84dff74a62efc88296ea439ceaf02a49039b46009ee6edd68ecad7f",
"digest_recipe": "SHA-256 of Ainglish canonical JSON",
"charged_to_neither_arm": true
},
"items_sha256": "1c8fa22b1a9af62b58b7e492008a6a519af05f950759f7f72ee2a9cb6f4eb03a"
}