First result · 2026-09-03 12:43 UTC
part-chosen(<rule>) / part-capped(<limiter>) — was the edge of the set you examined your decision or the instrument's?
Not yet counting in evidence decisions. This row remains available for assessment, but does not currently carry a counting evidence result.
- What was measured
- token cost ·
token_delta
How does the wording change tokenizer units for the declared tokenizer population? - Reported result
- -15.5 tokens per declared item
Reported interval: -15.5625 to -15.5.The value falls on the registered helpful side of this metric’s neutral point.
- English comparison
- Complete, careful English
Declared by the submitter; not a certification of equivalent information.
- Tokenizer conditions
- Literal encoding cost on the named current tokenizers; not comprehension.
- Named instruments
cl100k_base,o200k_baseReader population not separately declared.
- Conditions covered
- Separate outcomes retained for all 2 declared conditions
part-capped,part-chosenAn overall average can hide a weak condition. A condition list is not proof that every form or claim in the proposal was tested.
- Settlement role
- Disputed
Eligible replications disagree and this original does not hold a settlement majority.
Does the overall result hide differences between conditions?
| Condition | Reported difference |
|---|---|
part-capped | -15.25 |
part-chosen | -15.75 |
Inspect actual inputs and recorded answers
The comparison label is the submitter’s declaration, not a semantic certification. Check that both versions preserve the information needed to answer the same question.
Showing the first 3 of 16 readable, inline non-control items, in stored order—not a selection of successes. 0 control items omitted.
Input 1
- English input
- I examined the 48 alerts that the severity-quartile rule chose, out of the 193 recorded; the rule picked which alerts to examine.
- Ainglish input
- part-chosen(severity-quartile): the 48 alerts.
- Condition
- part-chosen
Input 2
- English input
- I reviewed the 72 suppliers that the alphabetic-slice rule chose, out of the 418 listed; the rule picked which suppliers to review.
- Ainglish input
- part-chosen(alphabetic-slice): the 72 suppliers.
- Condition
- part-chosen
Input 3
- English input
- I inspected the 96 sessions that random seed 77 chose, out of the 630 captured; that rule picked which sessions to inspect.
- Ainglish input
- part-chosen(random-seed-77): the 96 sessions.
- Condition
- part-chosen
Recorded input digest: fe2831507843811435c7a3511d420c9e83d0981eacdf1ee197ef62cb5de333a0
Prompts, reference material and other context can live elsewhere in the specification. Inputs and keys alone do not reconstruct every reader call or establish a fair comparison.
Declared population, method and retained outcomes
- Compared with
- Ainglish form versus complete careful English
- Tested population
- 16 frozen fresh pairs across part-capped and part-chosen
- Unit tested
- complete message
- How results combine
- equal item mean per stratum, weighted by stratum share, then maximum tokenizer mean
These are the study author’s declarations. A finding applies to this tested scope; this summary does not establish that another study is comparable.
Absolute arm results, reader-specific results and condition results below are retained values, not a newly pooled analysis. Accuracy arms use fractions from 0 to 1; their difference uses percentage points.
Absolute arm results
Not recorded
Reader or tokenizer results
[
{
"model": "cl100k_base",
"value": -15.5625
},
{
"model": "o200k_base",
"value": -15.5
}
]
Condition results
[
{
"id": "part-capped",
"weight": 1,
"share": 0.5,
"value": -15.25,
"value_lo": null,
"value_hi": null,
"arms": null,
"resolution_bound": "not_applicable"
},
{
"id": "part-chosen",
"weight": 1,
"share": 0.5,
"value": -15.75,
"value_lo": null,
"value_hi": null,
"arms": null,
"resolution_bound": "not_applicable"
}
]
Exact result and immutable specificationExperiment history
Attempt 8dbf38ab-f6db-4a80-848a-ecc32fb2cdab
Content 13a722dd4d8b0206a42ff6450c5de1fea05a0f828d14254c61889bd7af894e83