Evidence

Compare two experiments

Check what changed in the question, wording or readers before comparing the numbers.

This view keeps both results separate. It does not calculate a combined score or decide whether they reproduce each other.

Find experiments by proposal

Choose two experiments by title, measurement and date. The choices include up to 50 newest public completed results, plus your current selections. Historical results stay labelled. For older records, use the evidence explorer or exact entry below.

Use an exact experiment identifier instead

A full attempt UUID entered here replaces the corresponding choice above. Content hashes are not result identifiers.

Clear comparison

First result · 2026-09-03 09:53 UTC

on-purpose / by-accident — say whether an action you report was chosen or a slip

Not yet counting in evidence decisions. This row remains available for assessment, but does not currently carry a counting evidence result.

What was measured: token cost · token_delta
How does the wording change tokenizer units for the declared tokenizer population?
Reported result: 2 tokens per declared item
Reported interval: 2 to 2.
More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
English comparison: English comparison not recorded as a structured label
Declared by the submitter; not a certification of equivalent information.
Tokenizer conditions: Literal encoding cost on the named current tokenizers; not comprehension.
Named instruments: cl100k_base, o200k_base, p50k_base
Reader population not separately declared.
Conditions covered: No condition-by-condition settlement contract recorded
An overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
Settlement role: Disputed
Eligible replications disagree and this original does not hold a settlement majority.

Reported token direction. More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.

Current declared cost bound: at most 3 tokens. This bound applies to the Ainglish-minus-English difference. The reported point value is within that bound. This uses the current declaration, not necessarily the one in force when the result was filed.

A numerical match is not a completed prerequisite. Current evidence status, independent settlement and the other declared results still determine readiness.

Inspect actual inputs and recorded answers

The comparison label is the submitter’s declaration, not a semantic certification. Check that both versions preserve the information needed to answer the same question.

Showing the first 3 of 10 readable, inline non-control items, in stored order—not a selection of successes. 0 control items omitted.

Input 1

English input: I deleted the file on purpose.
Ainglish input: I deleted the file on-purpose.

Input 2

English input: I deleted the file by accident.
Ainglish input: I deleted the file by-accident.

Input 3

English input: The migration was skipped on purpose.
Ainglish input: The migration was skipped on-purpose.

Prompts, reference material and other context can live elsewhere in the specification. Inputs and keys alone do not reconstruct every reader call or establish a fair comparison.

Declared population, method and retained outcomes

No structured study scope is declared here. Inspect the immutable manifest; do not infer a comparator or population from the headline.

Absolute arm results, reader-specific results and condition results below are retained values, not a newly pooled analysis. Accuracy arms use fractions from 0 to 1; their difference uses percentage points.

Absolute arm results

Not recorded

Reader or tokenizer results

[
    {
        "model": "cl100k_base",
        "value": 2
    },
    {
        "model": "o200k_base",
        "value": 2
    },
    {
        "model": "p50k_base",
        "value": 2
    }
]

Condition results

Not recorded

Exact result and immutable specification Experiment history

Attempt a9ae3bfa-7957-4710-86d6-c7dcf7c574b0
Content f504b3fcb597190e4b71ef059b2bc2a47fe15c15f839bb1d058189f4fbfbb0ff

Second result · 2026-09-07 07:35 UTC

on-purpose / by-accident — say whether an action you report was chosen or a slip

Counts in current evidence decisions. This row currently contributes to evidence decisions. Its direction is separate from whether the proposal is ready for adoption.

What was measured: token cost · token_delta
How does the wording change tokenizer units for the declared tokenizer population?
Reported result: 1.5 tokens per declared item
Reported interval: 1 to 1.5.
More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.
English comparison: English comparison not recorded as a structured label
Declared by the submitter; not a certification of equivalent information.
Tokenizer conditions: Literal encoding cost on the named current tokenizers; not comprehension.
Named instruments: cl100k_base, o200k_base, p50k_base
Reader population not separately declared.
Conditions covered: No condition-by-condition settlement contract recorded
An overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
Settlement role: Disagrees with the named original
This eligible row adds one disagreement. An adverse or null direction is a valid result and remains visible.

Reported token direction. More tokens on the named current tokenizers; this is the encoded-length difference, not the proposal decision.

A numerical match is not a completed prerequisite. Current evidence status, independent settlement and the other declared results still determine readiness.

This result checks a named original, not every experiment on the proposal. Read its target original

Compare with the exact target attempt

Declared target content identity

f504b3fcb597190e4b71ef059b2bc2a47fe15c15f839bb1d058189f4fbfbb0ff