Choose two experiments by title, measurement and date. The choices include up to 50 newest public completed results, plus your current selections. Historical results stay labelled. For older records, use the evidence explorer or exact entry below.
First experiment
Choose an experiment
grader=graded · token cost · -16 · Not yet counting in evidence decisions · 2026-09-06 08:01 UTC · ed08aef0 because / ever since — did ‘since’ give a reason, or start a clock? · comprehension accuracy · -10.4975 · Not yet counting in evidence decisions · 2026-09-06 07:45 UTC · 8ab30123 removed-from(<surface>) / erased-from(<inventory>) — did “deleted” mean absent here, or unrecoverable from every declared copy? · token cost · -1.125 · Not yet counting in evidence decisions · 2026-09-06 07:26 UTC · b074d534 each-group / groups-combined — did the result hold in every group, or only after pooling them? · token cost · 3.125 · Not yet counting in evidence decisions · 2026-09-06 06:04 UTC · 8b80e78a among-others / and-no-others — is the list the whole list? · comprehension accuracy · -13.165 · Counts in current evidence decisions · 2026-09-06 05:01 UTC · fe2aad6d in-parallel / in-sequence — say whether listed actions may overlap · comprehension accuracy · -22.77 · Counts in current evidence decisions · 2026-09-06 02:09 UTC · 5f27eb06 mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · 1.295 · Counts in current evidence decisions · 2026-09-05 23:31 UTC · 03f14e38 same-for-all / may-vary-across — must every item use the same choice? · comprehension accuracy · 3.3325 · Not yet counting in evidence decisions · 2026-09-05 22:15 UTC · ae2fc895 same-for-all / may-vary-across — must every item use the same choice? · comprehension accuracy · -10.9438 · Not yet counting in evidence decisions · 2026-09-05 22:11 UTC · 96ac4706 set-to / adjust-by — is the number the new value, or the size of the change? · comprehension accuracy · -23.9283 · Not yet counting in evidence decisions · 2026-09-05 22:08 UTC · afb31cd2 set-to / adjust-by — is the number the new value, or the size of the change? · comprehension accuracy · -33.4683 · Not yet counting in evidence decisions · 2026-09-05 22:06 UTC · 00910c7b 14:00Z / 09:00@Europe/London — which instant does a bare clock time name? · comprehension accuracy · 10.7225 · Not yet counting in evidence decisions · 2026-09-05 22:03 UTC · 40abfceb this-once / from-now-on — does this instruction apply to this task, or to every task after it? · comprehension accuracy · -19.5975 · Not yet counting in evidence decisions · 2026-09-05 22:00 UTC · b8ca220e only-<focus> — weld "only" to the words it excludes over: speech carried the binding as stress, writing dropped it · token cost · 4.875 · Not yet counting in evidence decisions · 2026-09-05 21:17 UTC · 97fa38e4 you-one / you-all — say whether “you” addresses one recipient or the whole group · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 20:45 UTC · 7706be98 because / ever since — did ‘since’ give a reason, or start a clock? · token cost · -2 · Counts in current evidence decisions · 2026-09-05 20:15 UTC · 554a9f5c in-parallel / in-sequence — say whether listed actions may overlap · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 20:15 UTC · e19dca8d mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · -6.555 · Not yet counting in evidence decisions · 2026-09-05 20:10 UTC · 3979ed66 prob / odds-for / odds-against — is a risk a share or a ratio, and which side comes first? · token cost · -0.375 · Not yet counting in evidence decisions · 2026-09-05 19:43 UTC · f67c7b45 14:00Z / 09:00@Europe/London — which instant does a bare clock time name? · token cost · 1.5 · Counts in current evidence decisions · 2026-09-05 19:32 UTC · b4710cc4 part-chosen(<rule>) / part-capped(<limiter>) — was the edge of the set you examined your decision or the instrument's? · token cost · -9 · Not yet counting in evidence decisions · 2026-09-05 19:31 UTC · cc066309 replace(old=…, new=…) — which thing leaves, and which takes its place? · token cost · -2.75 · Not yet counting in evidence decisions · 2026-09-05 19:31 UTC · b9afa503 prob / odds-for / odds-against — is a risk a share or a ratio, and which side comes first? · token cost · -3 · Not yet counting in evidence decisions · 2026-09-05 19:31 UTC · 3dc6b4c5 repeat-or-front — "old logs and old backups" / "backups and old logs", never bare "old logs and backups" across a live boundary · token cost · -6.625 · Not yet counting in evidence decisions · 2026-09-05 18:49 UTC · 4b79c759 mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 18:44 UTC · 4b3610e3 choose-any / draw-uniform — does ‘pick a random one’ mean any member will do, or each must have equal odds? · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 18:33 UTC · 4478e07a Replication confirmation requires a different item set for deterministic metrics — same-items re-runs are build checks, not confirmation · protocol verdict regression · 0 · Not yet counting in evidence decisions · 2026-09-05 18:29 UTC · f68d590b no-charge / available-now — does ‘free’ mean zero price or ready to use? · token cost · 6.5 · Not yet counting in evidence decisions · 2026-09-05 17:56 UTC · 30bd8719 same-for-all / may-vary-across — must every item use the same choice? · comprehension accuracy · -5.3667 · Not yet counting in evidence decisions · 2026-09-05 17:15 UTC · 3cf5e320 set-to / adjust-by — is the number the new value, or the size of the change? · comprehension accuracy · 3.9433 · Not yet counting in evidence decisions · 2026-09-05 17:10 UTC · c709a96c no-charge / available-now — does ‘free’ mean zero price or ready to use? · token cost · -2 · Not yet counting in evidence decisions · 2026-09-05 17:06 UTC · b529d8bf mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · -1.16 · Not yet counting in evidence decisions · 2026-09-05 16:34 UTC · dab277f5 part-chosen(<rule>) / part-capped(<limiter>) — was the edge of the set you examined your decision or the instrument's? · token cost · -16.8125 · Counts in current evidence decisions · 2026-09-05 16:31 UTC · 8480b671 verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · comprehension accuracy · -6.545 · Not yet counting in evidence decisions · 2026-09-05 16:29 UTC · 90e081d0 verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · comprehension accuracy · 9.6 · Not yet counting in evidence decisions · 2026-09-05 16:20 UTC · 3c18b2a0 14:00Z / 09:00@Europe/London — which instant does a bare clock time name? · token cost · -3.5 · Not yet counting in evidence decisions · 2026-09-05 16:20 UTC · 1ca7eaf8 consider-now / postpone — did ‘table the proposal’ put it before the meeting, or take it off the agenda? · token cost · 3.5 · Not yet counting in evidence decisions · 2026-09-05 16:12 UTC · 5a862667 replace(old=…, new=…) — which thing leaves, and which takes its place? · token cost · 0.75 · Not yet counting in evidence decisions · 2026-09-05 15:10 UTC · 5b46e04f because / ever since — did ‘since’ give a reason, or start a clock? · token cost · -5.125 · Not yet counting in evidence decisions · 2026-09-05 14:08 UTC · dc1ca371 on-purpose / by-accident — say whether an action you report was chosen or a slip · token cost · 2 · Counts in current evidence decisions · 2026-09-05 14:03 UTC · b0650f16 mean-of / median-of — which ‘average’ did you report? · token cost · -7.5 · Counts in current evidence decisions · 2026-09-05 14:03 UTC · 12adbc1c verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · token cost · -1 · Counts in current evidence decisions · 2026-09-05 13:58 UTC · 616a1c38 choose-any / draw-uniform — does ‘pick a random one’ mean any member will do, or each must have equal odds? · token cost · -5 · Not yet counting in evidence decisions · 2026-09-05 13:51 UTC · c6e4e8cd no-delegation / one-hop-delegation-allowed — state whether a task may be handed to another principal · comprehension accuracy · -13.865 · Not yet counting in evidence decisions · 2026-09-05 13:26 UTC · f77f5977 fact-not-known / choice-not-made — distinguish missing evidence from a missing decision · comprehension accuracy · -25.055 · Not yet counting in evidence decisions · 2026-09-05 13:19 UTC · b63c5f65 no-delegation / one-hop-delegation-allowed — state whether a task may be handed to another principal · comprehension accuracy · -4.5 · Not yet counting in evidence decisions · 2026-09-05 13:13 UTC · d02eafa8 fact-not-known / choice-not-made — distinguish missing evidence from a missing decision · comprehension accuracy · -54.62 · Not yet counting in evidence decisions · 2026-09-05 13:05 UTC · aa6c1642 verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · token cost · -1 · Counts in current evidence decisions · 2026-09-05 12:54 UTC · 38f03130 no-charge / available-now — does ‘free’ mean zero price or ready to use? · token cost · 9.75 · Counts in current evidence decisions · 2026-09-05 11:37 UTC · 44b9d185 among-others / and-no-others — is the list the whole list? · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 11:36 UTC · 3a4e427d
Second experiment
Choose an experiment
grader=graded · token cost · -16 · Not yet counting in evidence decisions · 2026-09-06 08:01 UTC · ed08aef0 because / ever since — did ‘since’ give a reason, or start a clock? · comprehension accuracy · -10.4975 · Not yet counting in evidence decisions · 2026-09-06 07:45 UTC · 8ab30123 removed-from(<surface>) / erased-from(<inventory>) — did “deleted” mean absent here, or unrecoverable from every declared copy? · token cost · -1.125 · Not yet counting in evidence decisions · 2026-09-06 07:26 UTC · b074d534 each-group / groups-combined — did the result hold in every group, or only after pooling them? · token cost · 3.125 · Not yet counting in evidence decisions · 2026-09-06 06:04 UTC · 8b80e78a among-others / and-no-others — is the list the whole list? · comprehension accuracy · -13.165 · Counts in current evidence decisions · 2026-09-06 05:01 UTC · fe2aad6d in-parallel / in-sequence — say whether listed actions may overlap · comprehension accuracy · -22.77 · Counts in current evidence decisions · 2026-09-06 02:09 UTC · 5f27eb06 mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · 1.295 · Counts in current evidence decisions · 2026-09-05 23:31 UTC · 03f14e38 same-for-all / may-vary-across — must every item use the same choice? · comprehension accuracy · 3.3325 · Not yet counting in evidence decisions · 2026-09-05 22:15 UTC · ae2fc895 same-for-all / may-vary-across — must every item use the same choice? · comprehension accuracy · -10.9438 · Not yet counting in evidence decisions · 2026-09-05 22:11 UTC · 96ac4706 set-to / adjust-by — is the number the new value, or the size of the change? · comprehension accuracy · -23.9283 · Not yet counting in evidence decisions · 2026-09-05 22:08 UTC · afb31cd2 set-to / adjust-by — is the number the new value, or the size of the change? · comprehension accuracy · -33.4683 · Not yet counting in evidence decisions · 2026-09-05 22:06 UTC · 00910c7b 14:00Z / 09:00@Europe/London — which instant does a bare clock time name? · comprehension accuracy · 10.7225 · Not yet counting in evidence decisions · 2026-09-05 22:03 UTC · 40abfceb this-once / from-now-on — does this instruction apply to this task, or to every task after it? · comprehension accuracy · -19.5975 · Not yet counting in evidence decisions · 2026-09-05 22:00 UTC · b8ca220e only-<focus> — weld "only" to the words it excludes over: speech carried the binding as stress, writing dropped it · token cost · 4.875 · Not yet counting in evidence decisions · 2026-09-05 21:17 UTC · 97fa38e4 you-one / you-all — say whether “you” addresses one recipient or the whole group · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 20:45 UTC · 7706be98 because / ever since — did ‘since’ give a reason, or start a clock? · token cost · -2 · Counts in current evidence decisions · 2026-09-05 20:15 UTC · 554a9f5c in-parallel / in-sequence — say whether listed actions may overlap · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 20:15 UTC · e19dca8d mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · -6.555 · Not yet counting in evidence decisions · 2026-09-05 20:10 UTC · 3979ed66 prob / odds-for / odds-against — is a risk a share or a ratio, and which side comes first? · token cost · -0.375 · Not yet counting in evidence decisions · 2026-09-05 19:43 UTC · f67c7b45 14:00Z / 09:00@Europe/London — which instant does a bare clock time name? · token cost · 1.5 · Counts in current evidence decisions · 2026-09-05 19:32 UTC · b4710cc4 part-chosen(<rule>) / part-capped(<limiter>) — was the edge of the set you examined your decision or the instrument's? · token cost · -9 · Not yet counting in evidence decisions · 2026-09-05 19:31 UTC · cc066309 replace(old=…, new=…) — which thing leaves, and which takes its place? · token cost · -2.75 · Not yet counting in evidence decisions · 2026-09-05 19:31 UTC · b9afa503 prob / odds-for / odds-against — is a risk a share or a ratio, and which side comes first? · token cost · -3 · Not yet counting in evidence decisions · 2026-09-05 19:31 UTC · 3dc6b4c5 repeat-or-front — "old logs and old backups" / "backups and old logs", never bare "old logs and backups" across a live boundary · token cost · -6.625 · Not yet counting in evidence decisions · 2026-09-05 18:49 UTC · 4b79c759 mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 18:44 UTC · 4b3610e3 choose-any / draw-uniform — does ‘pick a random one’ mean any member will do, or each must have equal odds? · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 18:33 UTC · 4478e07a Replication confirmation requires a different item set for deterministic metrics — same-items re-runs are build checks, not confirmation · protocol verdict regression · 0 · Not yet counting in evidence decisions · 2026-09-05 18:29 UTC · f68d590b no-charge / available-now — does ‘free’ mean zero price or ready to use? · token cost · 6.5 · Not yet counting in evidence decisions · 2026-09-05 17:56 UTC · 30bd8719 same-for-all / may-vary-across — must every item use the same choice? · comprehension accuracy · -5.3667 · Not yet counting in evidence decisions · 2026-09-05 17:15 UTC · 3cf5e320 set-to / adjust-by — is the number the new value, or the size of the change? · comprehension accuracy · 3.9433 · Not yet counting in evidence decisions · 2026-09-05 17:10 UTC · c709a96c no-charge / available-now — does ‘free’ mean zero price or ready to use? · token cost · -2 · Not yet counting in evidence decisions · 2026-09-05 17:06 UTC · b529d8bf mean-of / median-of — which ‘average’ did you report? · comprehension accuracy · -1.16 · Not yet counting in evidence decisions · 2026-09-05 16:34 UTC · dab277f5 part-chosen(<rule>) / part-capped(<limiter>) — was the edge of the set you examined your decision or the instrument's? · token cost · -16.8125 · Counts in current evidence decisions · 2026-09-05 16:31 UTC · 8480b671 verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · comprehension accuracy · -6.545 · Not yet counting in evidence decisions · 2026-09-05 16:29 UTC · 90e081d0 verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · comprehension accuracy · 9.6 · Not yet counting in evidence decisions · 2026-09-05 16:20 UTC · 3c18b2a0 14:00Z / 09:00@Europe/London — which instant does a bare clock time name? · token cost · -3.5 · Not yet counting in evidence decisions · 2026-09-05 16:20 UTC · 1ca7eaf8 consider-now / postpone — did ‘table the proposal’ put it before the meeting, or take it off the agenda? · token cost · 3.5 · Not yet counting in evidence decisions · 2026-09-05 16:12 UTC · 5a862667 replace(old=…, new=…) — which thing leaves, and which takes its place? · token cost · 0.75 · Not yet counting in evidence decisions · 2026-09-05 15:10 UTC · 5b46e04f because / ever since — did ‘since’ give a reason, or start a clock? · token cost · -5.125 · Not yet counting in evidence decisions · 2026-09-05 14:08 UTC · dc1ca371 on-purpose / by-accident — say whether an action you report was chosen or a slip · token cost · 2 · Counts in current evidence decisions · 2026-09-05 14:03 UTC · b0650f16 mean-of / median-of — which ‘average’ did you report? · token cost · -7.5 · Counts in current evidence decisions · 2026-09-05 14:03 UTC · 12adbc1c verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · token cost · -1 · Counts in current evidence decisions · 2026-09-05 13:58 UTC · 616a1c38 choose-any / draw-uniform — does ‘pick a random one’ mean any member will do, or each must have equal odds? · token cost · -5 · Not yet counting in evidence decisions · 2026-09-05 13:51 UTC · c6e4e8cd no-delegation / one-hop-delegation-allowed — state whether a task may be handed to another principal · comprehension accuracy · -13.865 · Not yet counting in evidence decisions · 2026-09-05 13:26 UTC · f77f5977 fact-not-known / choice-not-made — distinguish missing evidence from a missing decision · comprehension accuracy · -25.055 · Not yet counting in evidence decisions · 2026-09-05 13:19 UTC · b63c5f65 no-delegation / one-hop-delegation-allowed — state whether a task may be handed to another principal · comprehension accuracy · -4.5 · Not yet counting in evidence decisions · 2026-09-05 13:13 UTC · d02eafa8 fact-not-known / choice-not-made — distinguish missing evidence from a missing decision · comprehension accuracy · -54.62 · Not yet counting in evidence decisions · 2026-09-05 13:05 UTC · aa6c1642 verdict-fail / no-verdict — did 'the check failed' judge the target, or fail to judge it? · token cost · -1 · Counts in current evidence decisions · 2026-09-05 12:54 UTC · 38f03130 no-charge / available-now — does ‘free’ mean zero price or ready to use? · token cost · 9.75 · Counts in current evidence decisions · 2026-09-05 11:37 UTC · 44b9d185 among-others / and-no-others — is the list the whole list? · comprehension accuracy · 0 · Counts in current evidence decisions · 2026-09-05 11:36 UTC · 3a4e427d