Evidence

Compare two experiments

Check what changed in the question, wording or readers before comparing the numbers.

This view keeps both results separate. It does not calculate a combined score or decide whether they reproduce each other.

Find experiments by proposal

Choose two experiments by title, measurement and date. The choices include up to 50 newest public completed results, plus your current selections. Historical results stay labelled. For older records, use the evidence explorer or exact entry below.

Use an exact experiment identifier instead

A full attempt UUID entered here replaces the corresponding choice above. Content hashes are not result identifiers.

Clear comparison

What differs in the declared methods?

These are literal recorded values, not a compatibility test. Matching declarations do not prove equivalent inputs or fair scoring. A missing structured field may be described elsewhere in the immutable specification.

What was measured · Same recorded value

First result

token_delta

Second result

token_delta

English comparison declarations · Not recorded on either side

First result

Not recorded in this structured field

Second result

Not recorded in this structured field

Tested population · Same recorded value

First result

cl100k_base/o200k_base/p50k_base

Second result

cl100k_base/o200k_base/p50k_base

Unit tested · Same recorded value

First result

pair

Second result

pair

Named instruments (including order) · Same recorded value

First result

[
    "cl100k_base",
    "o200k_base",
    "p50k_base"
]

Second result

[
    "cl100k_base",
    "o200k_base",
    "p50k_base"
]

Reader exposure · Not recorded on either side

First result

Not recorded in this structured field

Second result

Not recorded in this structured field

Exposure window · Not recorded on either side

First result

Not recorded in this structured field

Second result

Not recorded in this structured field

How results combine · Same recorded value

First result

{
    "reducer": "least_favourable",
    "rule": "maximum tokenizer mean"
}

Second result

{
    "reducer": "least_favourable",
    "rule": "maximum tokenizer mean"
}

Scoring declaration · Not recorded on either side

First result

Not recorded in this structured field

Second result

Not recorded in this structured field

Conditions (including order) · Not recorded on either side

First result

Not recorded in this structured field

Second result

Not recorded in this structured field

First result · 2026-09-06 10:16 UTC

sanction-allow / sanction-penalize — did the authority permit it or punish it?

Counts in current evidence decisions. This row currently contributes to evidence decisions. Its direction is separate from whether the proposal is ready for adoption.

What was measured: token cost · token_delta
How does the wording change tokenizer units for the declared tokenizer population?
Reported result: 4.875 tokens per declared item
Reported interval: 3.125 to 4.875.
More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
English comparison: English comparison not recorded as a structured label
Declared by the submitter; not a certification of equivalent information.
Tokenizer conditions: Literal encoding cost on the named current tokenizers; not comprehension.
Named instruments: cl100k_base, o200k_base, p50k_base
Reader population not separately declared.
Conditions covered: No condition-by-condition settlement contract recorded
An overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
Settlement role: Confirmed, with disagreement visible
A settlement majority confirms this original, while eligible disagreement remains part of the record.

Is this result within the cost allowance?

This headline is outside the allowance. The reported difference is 4.875 tokens; the current declaration allows at most 4 tokens.

This compares Ainglish minus English with the current declaration, which may differ from the declaration when the result was filed. It checks the headline only: inspect any required per-form and per-tokenizer results too.

Has the original estimate been independently reproduced?

Confirmed, with disagreement visible.

A settlement majority confirms this original, while eligible disagreement remains part of the record.

Reproduction asks whether fresh-input findings agree under the settlement rule. It does not ask whether either value satisfies the cost allowance.

Being within the cost allowance is not a completed prerequisite. Reproducing an original estimate is a separate check, not proof that the allowance is met. Current evidence status, settlement and every declared result still determine readiness.

How can one check pass while the other does not?

For example, an allowance of at most +3 tokens and an original estimate of +3 ask different questions. A replication of −0.5 is within that allowance but may disagree with the original. A replication of +3.25 may reproduce +3 within the settlement tolerance while exceeding the allowance.

These are illustrative numbers, not a new settlement rule. A cost saving is not a comprehension result, and a reproduced premium does not by itself mean a proposal should be adopted or rejected.

Inspect actual inputs and recorded answers

The comparison label is the submitter’s declaration, not a semantic certification. Check that both versions preserve the information needed to answer the same question.

Numbers count only readable inputs attached to this receipt. They are not the experiment’s declared sample size or the number of reader calls.

Showing 1–6 of 8 readable, inline study items, in stored order—not a selection of successes. 0 control items are kept separate.

Each result has its own input pages. Positions across the two studies do not imply matched cases.

Input 1

English input: The financial regulator formally permitted bank 7 to acquire branch 2.
Ainglish input: sanction-allow(financial-regulator): bank-7 may acquire branch-2.

Input 2

English input: The financial regulator formally imposed a restrictive penalty on bank 7: transfers are suspended for 30 days.
Ainglish input: sanction-penalize(financial-regulator): bank-7, transfers suspended for 30 days.

Input 3

English input: The headline's bare word is quoted rather than interpreted as either registered claim.
Ainglish input: force-suspended The headline says 'the regulator sanctioned bank-7.'

Input 4

English input: The regulator permitted the merger.
Ainglish input: sanction-allow(regulator): merger may proceed.

Input 5

English input: The regulator penalized the bank for violations.
Ainglish input: sanction-penalize(regulator): bank, violations cited.

Input 6

English input: The authority allowed the transfer.
Ainglish input: sanction-allow(authority): transfer may proceed.

Recorded input digest: afc02a87ee693d9430904cafec93756143a47b4fd78673e400440250d3fb5a1c

Prompts, reference material and other context can live elsewhere in the specification. Inputs and keys alone do not reconstruct every reader call or establish a fair comparison.

Declared population, method and retained outcomes

Compared with: token_delta
Tested population: cl100k_base/o200k_base/p50k_base
Unit tested: pair
How results combine: maximum tokenizer mean

These are the study author’s declarations. A finding applies to this tested scope; this summary does not establish that another study is comparable.

Absolute arm results, reader-specific results and condition results below are retained values, not a newly pooled analysis. Accuracy arms use fractions from 0 to 1; their difference uses percentage points.

Absolute arm results

Not recorded

Reader or tokenizer results

[
    {
        "model": "cl100k_base",
        "value": 3.125
    },
    {
        "model": "o200k_base",
        "value": 3.5
    },
    {
        "model": "p50k_base",
        "value": 4.875
    }
]

Condition results

Not recorded

Exact result and immutable specification Experiment history

Attempt 961cf945-d650-4e84-a7fa-dd51b0ed9844
Content 29e5627d7e55f01d9a884b26c4833e54af6c8a362465b569d9dc435c2b75ef79

Second result · 2026-09-08 17:26 UTC

sanction-allow / sanction-penalize — did the authority permit it or punish it?

Counts in current evidence decisions. This row currently contributes to evidence decisions. Its direction is separate from whether the proposal is ready for adoption.

What was measured: token cost · token_delta
How does the wording change tokenizer units for the declared tokenizer population?
Reported result: 5.125 tokens per declared item
Reported interval: 3.375 to 5.125.
More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
English comparison: English comparison not recorded as a structured label
Declared by the submitter; not a certification of equivalent information.
Tokenizer conditions: Literal encoding cost on the named current tokenizers; not comprehension.
Named instruments: cl100k_base, o200k_base, p50k_base
Reader population not separately declared.
Conditions covered: No condition-by-condition settlement contract recorded
An overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
Settlement role: Agrees with the named original
This eligible row adds one agreement to the named original’s settlement tally.

Is this result within the cost allowance?

This headline is outside the allowance. The reported difference is 5.125 tokens; the current declaration allows at most 4 tokens.

Has the original estimate been independently reproduced?

Agrees with the named original. This replication reports 5.125 tokens; the named original reported 4.875.

This eligible row adds one agreement to the named original’s settlement tally.

Reproduction asks whether fresh-input findings agree under the settlement rule. It does not ask whether either value satisfies the cost allowance.

How can one check pass while the other does not?

These are illustrative numbers, not a new settlement rule. A cost saving is not a comprehension result, and a reproduced premium does not by itself mean a proposal should be adopted or rejected.

This result checks a named original, not every experiment on the proposal. Read its target original

Compare with the exact target attempt

Declared target content identity

29e5627d7e55f01d9a884b26c4833e54af6c8a362465b569d9dc435c2b75ef79

Inspect actual inputs and recorded answers

The comparison label is the submitter’s declaration, not a semantic certification. Check that both versions preserve the information needed to answer the same question.

Numbers count only readable inputs attached to this receipt. They are not the experiment’s declared sample size or the number of reader calls.

Showing 1–6 of 8 readable, inline study items, in stored order—not a selection of successes. 0 control items are kept separate.

Each result has its own input pages. Positions across the two studies do not imply matched cases.

Input 1

English input: The aviation authority formally permitted carrier 9 to open route 4.
Ainglish input: sanction-allow(aviation-authority): carrier-9 may open route-4.

Input 2

English input: The aviation authority formally imposed a restrictive penalty on carrier 9: landings are suspended for 60 days.
Ainglish input: sanction-penalize(aviation-authority): carrier-9, landings suspended for 60 days.

Input 3

English input: The bulletin board's bare word is quoted rather than interpreted as either registered claim.
Ainglish input: force-suspended The bulletin says 'the inspector sanctioned dock-3.'

Input 4

English input: The warden permitted the visit.
Ainglish input: sanction-allow(warden): visit permitted.

Input 5

English input: The warden penalized the inmate for violations.
Ainglish input: sanction-penalize(warden): inmate penalized for violations.

Input 6

English input: The council allowed the parade.
Ainglish input: sanction-allow(council): parade allowed.

Recorded input digest: de846014fc313d43cf23e1edd64ba23da38b765983f5b9d12fc8cea27e20df93

Prompts, reference material and other context can live elsewhere in the specification. Inputs and keys alone do not reconstruct every reader call or establish a fair comparison.

Declared population, method and retained outcomes

Compared with: token_delta
Tested population: cl100k_base/o200k_base/p50k_base
Unit tested: pair
How results combine: maximum tokenizer mean

These are the study author’s declarations. A finding applies to this tested scope; this summary does not establish that another study is comparable.

Absolute arm results

Not recorded

Reader or tokenizer results

[
    {
        "model": "cl100k_base",
        "value": 3.375
    },
    {
        "model": "o200k_base",
        "value": 3.75
    },
    {
        "model": "p50k_base",
        "value": 5.125
    }
]

Condition results

Not recorded

Exact result and immutable specification Experiment history

Attempt e3f8c846-5b65-4dcc-91df-011a76f70eb0
Content 8b4e563654caf99a2e72eda4e60aa23f3d5c7de686fdd351949b3ac48a426da7

Different wording, readers, exposure or populations can legitimately produce different results. A visible reference is not training the model’s weights. Current models and tokenizers have learned English; future Ainglish-trained performance remains a research question.