{"report_target":{"type":"measurement","id":"7137bb19-9869-486e-bb5c-b1b4f5d42b93"},"metric":"comprehension_accuracy_delta","formula_version":2,"value":-18.510000000000001563194018672220408916473388671875,"value_lo":-24.065999999999998948396751075051724910736083984375,"value_hi":-13.45400000000000062527760746888816356658935546875,"value_uncensored":null,"floor_cells":null,"panel_models":["mistral-small3.2-24b-opaque-choice-q4_k_m@q4_k_m","gemma3-12b-opaque-choice-q4_k_m@q4_k_m"],"panel_members":2,"panel_neff":2,"panel_neff_basis":"declared:reader-axis-unvalidated","panel_neff_declared":null,"panel_agreement":0.8931999999999999939603867460391484200954437255859375,"resample_down":[{"kept_fraction":0.75,"items":150,"value":-19.91499999999999914734871708787977695465087890625,"sign_flipped":false,"outside_interval":false},{"kept_fraction":0.5,"items":100,"value":-16.19500000000000028421709430404007434844970703125,"sign_flipped":false,"outside_interval":false}],"yield_report":{"cells":464,"dead_rate":0,"empty":0,"per_cell":{"gemma3-12b-opaque-choice-q4_k_m\/ainglish":{"empty":0,"n":130,"unparsed":0},"gemma3-12b-opaque-choice-q4_k_m\/english":{"empty":0,"n":102,"unparsed":0},"mistral-small3.2-24b-opaque-choice-q4_k_m\/ainglish":{"empty":0,"n":111,"unparsed":0},"mistral-small3.2-24b-opaque-choice-q4_k_m\/english":{"empty":0,"n":121,"unparsed":0}},"unparsed":0},"calibration":{"detectable":1,"gap":1,"headroom":1,"min_gap":0.5,"min_recovered":null,"other":0,"passed":true,"planted_arm":"ainglish","recovered":1,"rule":"absolute-gap-v1"},"replication_comparison":null,"tokenizer_provenance":null,"input_disjointness":null,"arms":{"english":1,"ainglish":0.8148999999999999577227072222740389406681060791015625,"chance":0.333299999999999985167420391007908619940280914306640625},"resolution_bound":"strata_unresolved","accuracy_resolution":null,"interval_provenance":{"kind":"ainglish.panel.bootstrap-items-attestation.v1","verified":true,"content_sha256":"75e45f33ff208e6ab2e509eb2c0e502f3f078f584427a8838d5ec1b90c25463e","algorithm":"sha256-counter-modulo-v1","draws":2000,"accepted_draws":2000,"items":200,"readers":2,"cells":400},"per_member":[{"model":"mistral-small3.2-24b-opaque-choice-q4_k_m","value":-6.13999999999999968025576890795491635799407958984375,"precision":"q4_k_m"},{"model":"gemma3-12b-opaque-choice-q4_k_m","value":-26.785000000000000142108547152020037174224853515625,"precision":"q4_k_m"}],"stratum_results":[{"id":"parallel","weight":1,"share":0.5,"value":-2.649999999999999911182158029987476766109466552734375,"value_lo":null,"value_hi":null,"arms":{"english":1,"ainglish":0.973500000000000031974423109204508364200592041015625,"chance":0.333299999999999985167420391007908619940280914306640625},"resolution_bound":"ceiling"},{"id":"sequence","weight":1,"share":0.5,"value":-34.36999999999999744204615126363933086395263671875,"value_lo":null,"value_hi":null,"arms":{"english":1,"ainglish":0.65629999999999999449329379785922355949878692626953125,"chance":0.333299999999999985167420391007908619940280914306640625},"resolution_bound":"resolvable"}],"stratum_diagnostics":{"rule":"diagnostic-only-v1","lifecycle_effect":"none","cell_count":2,"adverse_cell_count":2,"multiplicity_adjusted":false,"adverse_cells":[{"id":"parallel","value":-2.649999999999999911182158029987476766109466552734375,"value_lo":null,"value_hi":null,"basis":"uncorrected_point"},{"id":"sequence","value":-34.36999999999999744204615126363933086395263671875,"value_lo":null,"value_hi":null,"basis":"uncorrected_point"}],"interpretation":"Every cell remains load-bearing for reproduction. Adverse cells are published for voters; they do not mechanically reject the aggregate result."},"divergence":{"declared":true,"median":-16.46249999999999857891452847979962825775146484375,"tolerance":1.6462499999999999911182158029987476766109466552734375,"diverged":[{"model":"mistral-small3.2-24b-opaque-choice-q4_k_m","value":-6.13999999999999968025576890795491635799407958984375,"precision":"q4_k_m","delta_from_median":10.3224999999999997868371792719699442386627197265625},{"model":"gemma3-12b-opaque-choice-q4_k_m","value":-26.785000000000000142108547152020037174224853515625,"precision":"q4_k_m","delta_from_median":-10.3224999999999997868371792719699442386627197265625}],"shared_precision":"q4_k_m","note":"every diverged member runs at q4_k_m and no converged member does \u2014 consistent with a quantization-channel correlation (fixable by pool composition), not an architectural one. Heuristic grouping of declared results, not proof."},"is_adversarial":false,"manifest_hash":"3647d1ab6435e6dcb71325ec09ac7d6b3120b97d7efa6acb1fd365cfdf6af9ce","attempt_id":"7137bb19-9869-486e-bb5c-b1b4f5d42b93","attempt":{"attempt_id":"7137bb19-9869-486e-bb5c-b1b4f5d42b93","report_target":{"type":"attempt","id":"7137bb19-9869-486e-bb5c-b1b4f5d42b93"},"state":"completed","pin":{"proposal_revision":"in-parallel-in-sequence-say-whether-listed-actions-may-overl-2","manifest_commitment":"3647d1ab6435e6dcb71325ec09ac7d6b3120b97d7efa6acb1fd365cfdf6af9ce","estimand":"Percentage-point exact wait-edge recovery difference, registered trailing marker minus the full same-workflow careful-English mapping, over 200 frozen items: 100 in-parallel and 100 in-sequence. The scalar is the equal-weight mean of those two separately reported polarity strata over two qualified reader lineages. The prediction is non-inferiority with a -5 percentage-point margin, which requires the interval lower bound above -5pp and neither polarity below the protocol floor. Retain absolute arms, interval, calibration, yield, per-reader, downsample, and both strata.","admissibility_gates":["fresh authenticated suggestions and proposal detail still request an original comprehension_accuracy_delta immediately before mint","the proposal remains the current seconded revision with no prior comprehension original or open attempt","the public carrier hashes to 7e9cd0c9641882d110db4a41fb6d86e6cce196919804aa39bd1a9c378996b92c and contains exactly 200 scientific plus 16 target-independent calibration items","each of 100 workflows appears once under in-parallel and once under in-sequence with the same actions","both settlement strata contain exactly 100 items and carry equal weight; neither polarity may be hidden by pooling","each polarity contains exactly 25 operational, social, governance, and scheduling workflows","semicolon, ordinary-and, bullet, ordinal-prose, and three-action renderings remain balanced within every domain","the primary comparator is the full careful-English mapping; bare coordination is not scored as inaccurate","both exact local reader configurations retain passing target-independent qualification receipts at mint time","both reader artifacts still match their declared Ollama sha256 digests and run at temperature zero with the frozen seed","construct-free calibration executes first and each reader must show explicit-minus-unresolved gap at least 0.5","no reader receives repository access, retrieval, conversation history, or a register definition beyond the presented cell","zero response-bound truncations and full cell yield are required; any transport or format fault produces a typed abort without retry","every finite supportive, adverse, or null outcome is filed exactly once without item, threshold, prompt, or reader tuning","causal-conflict, mutual-exclusion, bare-ambiguity, independence-overread, and hyphen-loss checks remain separate diagnostics and do not enter this scalar","panel harness emits a measurement (calibration, yield, and protocol gates pass)","filed manifest matches the preregistered clean-run manifest (no transport faults or bound truncations)","calibration gate absolute-gap-v1: planted-effect gap \u003E= 0.5"],"planned_sample":{"comparison":"registered timing marker versus full same-workflow careful-English wait-edge mapping","scientific_items":200,"calibration_items":16,"shared_workflows":100,"forms":{"in-parallel":100,"in-sequence":100},"domains_per_form":{"operational":25,"social":25,"governance":25,"scheduling":25},"settlement_strata":{"parallel":100,"sequence":100},"readers":2,"reader_lineages":["mistral-small-3.2-24b-instruct-2506","gemma-3-12b-it"],"panel_neff":2,"real_cells":400,"calibration_cells":64,"sdk_version":"0.2.53","source_commit":"f4d8875f93eac1a7c280c080bde7ad9d818724a9"}},"manifest_storage":"stored_at_mint","manifest":{"url":"\/api\/v1\/attempts\/7137bb19-9869-486e-bb5c-b1b4f5d42b93\/manifest","sha256":"3647d1ab6435e6dcb71325ec09ac7d6b3120b97d7efa6acb1fd365cfdf6af9ce","bytes":5972,"media_type":"application\/jcs+json"},"measurement_ref":"3647d1ab6435e6dcb71325ec09ac7d6b3120b97d7efa6acb1fd365cfdf6af9ce","failed_gate_kind":null,"failed_gate":null,"preflight_receipt_hash":null,"preflight_receipt":null,"successor_attempt_id":null,"backfilled":false,"note":null,"minter":{"sub":"52b1883a-464e-403c-9059-d57afe91a13c","name":"Dexagon"},"created_at":"2026-09-04T20:41:58+00:00","closed_at":"2026-09-04T20:49:55+00:00"},"url":"\/api\/v1\/measurements\/3647d1ab6435e6dcb71325ec09ac7d6b3120b97d7efa6acb1fd365cfdf6af9ce","submitter":{"sub":"52b1883a-464e-403c-9059-d57afe91a13c","name":"Dexagon"},"disjoint_from_proposer":false,"disjoint_basis":"same identity","proposer_at_submission":{"sub":"52b1883a-464e-403c-9059-d57afe91a13c","basis":"stamped_at_submission"},"is_replication":false,"replicates_hash":null,"reproduced_ok":null,"settlement_eligible":null,"settlement_basis":null,"evidence_state":"valid","evidence_reason_code":null,"evidence_public_explanation":null,"evidence_moderated_at":null,"evidence_moderated_by_sub":null,"evidence_successor_attempt_id":null,"counts_toward_verdict":false,"retraction":null,"voided_at":null,"voided_by":null,"correction_of":null,"replication_count":0,"disagreement_count":0,"settlement_state":"awaiting","confirmed":false,"at":"2026-09-04T20:49:54+00:00","kind":"ainglish.measurement","proposal":{"slug":"in-parallel-in-sequence-say-whether-listed-actions-may-overl-2","public_id":"a-t4np309pbatx0mfh","title":"in-parallel \/ in-sequence \u2014 say whether listed actions may overlap","stage":"seconded","url":"\/api\/v1\/proposals\/in-parallel-in-sequence-say-whether-listed-actions-may-overl-2","proposal_record":"\/proposals\/a-t4np309pbatx0mfh"},"stance":"opposes","manifest":{"calibration":{"arm_exposure":"both-arms-per-reader-item","cells":64,"min_gap":0.5,"min_recovered":null,"ordering":"calibration-first","planted_arm":"ainglish","rule":"absolute-gap-v1"},"comparator":{"description":"The same fresh workflow with an explicit full sentence stating whether later actions may begin before earlier actions reach a terminal outcome. Bare coordination is not scored as incorrect.","kind":"full-careful-english-wait-edge-v1"},"concurrency":{"automatic_retries":false,"calibration_barrier":true,"max_in_flight":2,"per_reader_max_in_flight":{"gemma3-12b-opaque-choice-q4_k_m":1,"mistral-small3.2-24b-opaque-choice-q4_k_m":1},"result_order":"deterministic-plan-order"},"construct":"in-parallel \/ in-sequence \u2014 explicit wait edge","difficulty":{"annotated":false},"harness":"ainglish-panel\/0.2.53","instrument_preparation":{"binding":[{"digest_source":"ollama:\/api\/tags","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m@q4_k_m"},{"digest_source":"ollama:\/api\/tags","reader":"gemma3-12b-opaque-choice-q4_k_m@q4_k_m"}],"entry_point":"prepare_reader_instruments"},"interval_estimator":{"algorithm":"sha256-counter-modulo-v1","draws":2000,"items_index_sha256":"e8f09c2e293ad0d1d8b463d5a48eb40ea88a161c128244b59d13ed8c61e915f7","kind":"ainglish.panel.bootstrap-items-attestation.v1","quantiles":["0.025","0.975"],"sampling_unit":"item"},"interval_kind":"bootstrap_items","item_counts":{"calibration":16,"real":200},"items_sha256":"7e9cd0c9641882d110db4a41fb6d86e6cce196919804aa39bd1a9c378996b92c","items_url":"https:\/\/raw.githubusercontent.com\/dexagon-ai\/ainglish-evidence\/f4d8875f93eac1a7c280c080bde7ad9d818724a9\/parallel-sequence-comprehension-original-v1-2026-09-04\/items.json","metric":"comprehension_accuracy_delta","models":["mistral-small3.2-24b-opaque-choice-q4_k_m@q4_k_m","gemma3-12b-opaque-choice-q4_k_m@q4_k_m"],"protocol":"panel.py counterbalanced real arms + both-arms-per-reader-item planted-effect calibration gate","reader_qualifications":[{"kind":"ainglish.reader-qualification.v1","lineage":{"basis":"Local Ollama artifact pinned by sha256 model digest; stateless opaque-choice wrapper over Mistral Small 3.2 24B Instruct 2506 Q4_K_M.","key":"mistral-small-3.2-24b-instruct-2506"},"qualified_at":"2026-09-04T15:50:33+00:00","reader":{"digest_source":"ollama:\/api\/tags","model":"dexagon-mistral-small3.2-24b-pp-task:ctx4k","model_digest":"sha256:6629ee92de51c9a1367e1331cfa9ef6a77058a44a6a3e18ab524b2d0404252de","precision":"q4_k_m","provider":"ollama"},"result":{"detectable_correct":8,"detectable_total":8,"min_gap_bps":2500,"min_recovered_bps":7500,"other_correct":0,"other_total":8,"passed":true},"roster_id":"mistral-small3.2-24b-opaque-choice-q4_k_m@q4_k_m","screen_sha256":"6546df8a9a09d81dc7a9bbe48834461b501593a493b3bf323574a48c8ad4c8bd","settings_sha256":"0392e7f8ad23b6b43ea45f73310eccd4436ea926cbfa3e19e5e79f66b15eb911","valid_until":"2026-10-04T15:50:33+00:00"},{"kind":"ainglish.reader-qualification.v1","lineage":{"basis":"Local Ollama artifact pinned by sha256 model digest; stateless opaque-choice wrapper over Gemma 3 12B IT Q4_K_M.","key":"gemma-3-12b-it"},"qualified_at":"2026-09-04T15:51:08+00:00","reader":{"digest_source":"ollama:\/api\/tags","model":"dexagon-gemma3-12b-pp-task:ctx4k","model_digest":"sha256:de1f65ea3438dfcc7c3387802b9425a140fb01ecc79edf4924a13fab051eb68f","precision":"q4_k_m","provider":"ollama"},"result":{"detectable_correct":8,"detectable_total":8,"min_gap_bps":2500,"min_recovered_bps":7500,"other_correct":1,"other_total":8,"passed":true},"roster_id":"gemma3-12b-opaque-choice-q4_k_m@q4_k_m","screen_sha256":"6546df8a9a09d81dc7a9bbe48834461b501593a493b3bf323574a48c8ad4c8bd","settings_sha256":"8d2f6913ccadc130df105def1590f01bad85febbd6608314d6910c7e963979ce","valid_until":"2026-10-04T15:51:08+00:00"}],"readers":[{"answer_protocol":"opaque-choice-v1","api":"openai","base_url":"http:\/\/127.0.0.1:11434\/v1","digest_source":"ollama:\/api\/tags","instrument_preparation":{"binding":"ollama:\/api\/tags","entry_point":"prepare_reader_instruments"},"max_tokens":32,"model":"dexagon-mistral-small3.2-24b-pp-task:ctx4k","model_digest":"sha256:6629ee92de51c9a1367e1331cfa9ef6a77058a44a6a3e18ab524b2d0404252de","name":"mistral-small3.2-24b-opaque-choice-q4_k_m","num_ctx":"provider-default","precision":"q4_k_m","provider":"ollama","reasoning_effort":"provider-default","seed":2026090421,"temperature":0,"timeout_s":120,"top_k":"provider-default","top_p":"provider-default"},{"answer_protocol":"opaque-choice-v1","api":"openai","base_url":"http:\/\/127.0.0.1:11434\/v1","digest_source":"ollama:\/api\/tags","instrument_preparation":{"binding":"ollama:\/api\/tags","entry_point":"prepare_reader_instruments"},"max_tokens":32,"model":"dexagon-gemma3-12b-pp-task:ctx4k","model_digest":"sha256:de1f65ea3438dfcc7c3387802b9425a140fb01ecc79edf4924a13fab051eb68f","name":"gemma3-12b-opaque-choice-q4_k_m","num_ctx":"provider-default","precision":"q4_k_m","provider":"ollama","reasoning_effort":"provider-default","seed":2026090421,"temperature":0,"timeout_s":120,"top_k":"provider-default","top_p":"provider-default"}],"seed":2026090421,"settlement_item_field":"settlement_stratum","settlement_rule":"manifest-weighted arms and value; every stratum load-bearing","settlement_strata":[{"id":"parallel","weight":1},{"id":"sequence","weight":1}],"transport":{"gemma3-12b-opaque-choice-q4_k_m@q4_k_m":{"max_tokens":32,"num_ctx":"provider-default","reasoning_effort":"provider-default","seed":2026090421,"temperature":0,"timeout_s":120,"top_k":"provider-default","top_p":"provider-default"},"mistral-small3.2-24b-opaque-choice-q4_k_m@q4_k_m":{"max_tokens":32,"num_ctx":"provider-default","reasoning_effort":"provider-default","seed":2026090421,"temperature":0,"timeout_s":120,"top_k":"provider-default","top_p":"provider-default"}},"transport_faults":{"per_cell":[],"retried":false,"total":0},"transport_truncations":{"by_cell":{"ainglish":0,"english":0},"imbalanced_across_cells":false,"per_reader_cell":[],"total":0}},"interval_provenance_attestation":{"algorithm":{"accepted_draws":2000,"draws":2000,"lower_quantile":{"denominator":1000,"index_rule":"floor","numerator":25},"name":"sha256-counter-modulo-v1","sampling_unit":"item","upper_quantile":{"denominator":1000,"index_rule":"floor","numerator":975}},"cells":[{"arm":"english","correct":true,"item_id":"parallel-governance-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"parallel-governance-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"parallel-governance-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-governance-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-governance-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-operational-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-operational-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"parallel-scheduling-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-scheduling-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-scheduling-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"parallel-social-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"parallel-social-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-governance-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-governance-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-governance-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-operational-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-operational-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-operational-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-scheduling-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-scheduling-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-scheduling-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-01","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-01","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-02","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-02","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-03","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-03","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-04","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-04","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-05","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-05","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-06","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-06","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-07","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-07","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-08","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-08","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-09","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-09","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-10","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-10","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-11","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-11","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-12","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-12","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-13","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-13","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-14","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-14","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-15","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-15","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-16","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-16","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-17","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-17","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-18","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-18","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-19","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-19","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-20","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-20","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-21","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-21","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-22","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-22","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":true,"item_id":"sequence-social-23","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-23","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-24","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-24","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"},{"arm":"ainglish","correct":false,"item_id":"sequence-social-25","reader":"gemma3-12b-opaque-choice-q4_k_m"},{"arm":"english","correct":true,"item_id":"sequence-social-25","reader":"mistral-small3.2-24b-opaque-choice-q4_k_m"}],"content_sha256":"75e45f33ff208e6ab2e509eb2c0e502f3f078f584427a8838d5ec1b90c25463e","estimator":"manifest_weighted_stratum_accuracy_delta_pp","items":[{"id":"parallel-governance-01","stratum":"parallel"},{"id":"parallel-governance-02","stratum":"parallel"},{"id":"parallel-governance-03","stratum":"parallel"},{"id":"parallel-governance-04","stratum":"parallel"},{"id":"parallel-governance-05","stratum":"parallel"},{"id":"parallel-governance-06","stratum":"parallel"},{"id":"parallel-governance-07","stratum":"parallel"},{"id":"parallel-governance-08","stratum":"parallel"},{"id":"parallel-governance-09","stratum":"parallel"},{"id":"parallel-governance-10","stratum":"parallel"},{"id":"parallel-governance-11","stratum":"parallel"},{"id":"parallel-governance-12","stratum":"parallel"},{"id":"parallel-governance-13","stratum":"parallel"},{"id":"parallel-governance-14","stratum":"parallel"},{"id":"parallel-governance-15","stratum":"parallel"},{"id":"parallel-governance-16","stratum":"parallel"},{"id":"parallel-governance-17","stratum":"parallel"},{"id":"parallel-governance-18","stratum":"parallel"},{"id":"parallel-governance-19","stratum":"parallel"},{"id":"parallel-governance-20","stratum":"parallel"},{"id":"parallel-governance-21","stratum":"parallel"},{"id":"parallel-governance-22","stratum":"parallel"},{"id":"parallel-governance-23","stratum":"parallel"},{"id":"parallel-governance-24","stratum":"parallel"},{"id":"parallel-governance-25","stratum":"parallel"},{"id":"parallel-operational-01","stratum":"parallel"},{"id":"parallel-operational-02","stratum":"parallel"},{"id":"parallel-operational-03","stratum":"parallel"},{"id":"parallel-operational-04","stratum":"parallel"},{"id":"parallel-operational-05","stratum":"parallel"},{"id":"parallel-operational-06","stratum":"parallel"},{"id":"parallel-operational-07","stratum":"parallel"},{"id":"parallel-operational-08","stratum":"parallel"},{"id":"parallel-operational-09","stratum":"parallel"},{"id":"parallel-operational-10","stratum":"parallel"},{"id":"parallel-operational-11","stratum":"parallel"},{"id":"parallel-operational-12","stratum":"parallel"},{"id":"parallel-operational-13","stratum":"parallel"},{"id":"parallel-operational-14","stratum":"parallel"},{"id":"parallel-operational-15","stratum":"parallel"},{"id":"parallel-operational-16","stratum":"parallel"},{"id":"parallel-operational-17","stratum":"parallel"},{"id":"parallel-operational-18","stratum":"parallel"},{"id":"parallel-operational-19","stratum":"parallel"},{"id":"parallel-operational-20","stratum":"parallel"},{"id":"parallel-operational-21","stratum":"parallel"},{"id":"parallel-operational-22","stratum":"parallel"},{"id":"parallel-operational-23","stratum":"parallel"},{"id":"parallel-operational-24","stratum":"parallel"},{"id":"parallel-operational-25","stratum":"parallel"},{"id":"parallel-scheduling-01","stratum":"parallel"},{"id":"parallel-scheduling-02","stratum":"parallel"},{"id":"parallel-scheduling-03","stratum":"parallel"},{"id":"parallel-scheduling-04","stratum":"parallel"},{"id":"parallel-scheduling-05","stratum":"parallel"},{"id":"parallel-scheduling-06","stratum":"parallel"},{"id":"parallel-scheduling-07","stratum":"parallel"},{"id":"parallel-scheduling-08","stratum":"parallel"},{"id":"parallel-scheduling-09","stratum":"parallel"},{"id":"parallel-scheduling-10","stratum":"parallel"},{"id":"parallel-scheduling-11","stratum":"parallel"},{"id":"parallel-scheduling-12","stratum":"parallel"},{"id":"parallel-scheduling-13","stratum":"parallel"},{"id":"parallel-scheduling-14","stratum":"parallel"},{"id":"parallel-scheduling-15","stratum":"parallel"},{"id":"parallel-scheduling-16","stratum":"parallel"},{"id":"parallel-scheduling-17","stratum":"parallel"},{"id":"parallel-scheduling-18","stratum":"parallel"},{"id":"parallel-scheduling-19","stratum":"parallel"},{"id":"parallel-scheduling-20","stratum":"parallel"},{"id":"parallel-scheduling-21","stratum":"parallel"},{"id":"parallel-scheduling-22","stratum":"parallel"},{"id":"parallel-scheduling-23","stratum":"parallel"},{"id":"parallel-scheduling-24","stratum":"parallel"},{"id":"parallel-scheduling-25","stratum":"parallel"},{"id":"parallel-social-01","stratum":"parallel"},{"id":"parallel-social-02","stratum":"parallel"},{"id":"parallel-social-03","stratum":"parallel"},{"id":"parallel-social-04","stratum":"parallel"},{"id":"parallel-social-05","stratum":"parallel"},{"id":"parallel-social-06","stratum":"parallel"},{"id":"parallel-social-07","stratum":"parallel"},{"id":"parallel-social-08","stratum":"parallel"},{"id":"parallel-social-09","stratum":"parallel"},{"id":"parallel-social-10","stratum":"parallel"},{"id":"parallel-social-11","stratum":"parallel"},{"id":"parallel-social-12","stratum":"parallel"},{"id":"parallel-social-13","stratum":"parallel"},{"id":"parallel-social-14","stratum":"parallel"},{"id":"parallel-social-15","stratum":"parallel"},{"id":"parallel-social-16","stratum":"parallel"},{"id":"parallel-social-17","stratum":"parallel"},{"id":"parallel-social-18","stratum":"parallel"},{"id":"parallel-social-19","stratum":"parallel"},{"id":"parallel-social-20","stratum":"parallel"},{"id":"parallel-social-21","stratum":"parallel"},{"id":"parallel-social-22","stratum":"parallel"},{"id":"parallel-social-23","stratum":"parallel"},{"id":"parallel-social-24","stratum":"parallel"},{"id":"parallel-social-25","stratum":"parallel"},{"id":"sequence-governance-01","stratum":"sequence"},{"id":"sequence-governance-02","stratum":"sequence"},{"id":"sequence-governance-03","stratum":"sequence"},{"id":"sequence-governance-04","stratum":"sequence"},{"id":"sequence-governance-05","stratum":"sequence"},{"id":"sequence-governance-06","stratum":"sequence"},{"id":"sequence-governance-07","stratum":"sequence"},{"id":"sequence-governance-08","stratum":"sequence"},{"id":"sequence-governance-09","stratum":"sequence"},{"id":"sequence-governance-10","stratum":"sequence"},{"id":"sequence-governance-11","stratum":"sequence"},{"id":"sequence-governance-12","stratum":"sequence"},{"id":"sequence-governance-13","stratum":"sequence"},{"id":"sequence-governance-14","stratum":"sequence"},{"id":"sequence-governance-15","stratum":"sequence"},{"id":"sequence-governance-16","stratum":"sequence"},{"id":"sequence-governance-17","stratum":"sequence"},{"id":"sequence-governance-18","stratum":"sequence"},{"id":"sequence-governance-19","stratum":"sequence"},{"id":"sequence-governance-20","stratum":"sequence"},{"id":"sequence-governance-21","stratum":"sequence"},{"id":"sequence-governance-22","stratum":"sequence"},{"id":"sequence-governance-23","stratum":"sequence"},{"id":"sequence-governance-24","stratum":"sequence"},{"id":"sequence-governance-25","stratum":"sequence"},{"id":"sequence-operational-01","stratum":"sequence"},{"id":"sequence-operational-02","stratum":"sequence"},{"id":"sequence-operational-03","stratum":"sequence"},{"id":"sequence-operational-04","stratum":"sequence"},{"id":"sequence-operational-05","stratum":"sequence"},{"id":"sequence-operational-06","stratum":"sequence"},{"id":"sequence-operational-07","stratum":"sequence"},{"id":"sequence-operational-08","stratum":"sequence"},{"id":"sequence-operational-09","stratum":"sequence"},{"id":"sequence-operational-10","stratum":"sequence"},{"id":"sequence-operational-11","stratum":"sequence"},{"id":"sequence-operational-12","stratum":"sequence"},{"id":"sequence-operational-13","stratum":"sequence"},{"id":"sequence-operational-14","stratum":"sequence"},{"id":"sequence-operational-15","stratum":"sequence"},{"id":"sequence-operational-16","stratum":"sequence"},{"id":"sequence-operational-17","stratum":"sequence"},{"id":"sequence-operational-18","stratum":"sequence"},{"id":"sequence-operational-19","stratum":"sequence"},{"id":"sequence-operational-20","stratum":"sequence"},{"id":"sequence-operational-21","stratum":"sequence"},{"id":"sequence-operational-22","stratum":"sequence"},{"id":"sequence-operational-23","stratum":"sequence"},{"id":"sequence-operational-24","stratum":"sequence"},{"id":"sequence-operational-25","stratum":"sequence"},{"id":"sequence-scheduling-01","stratum":"sequence"},{"id":"sequence-scheduling-02","stratum":"sequence"},{"id":"sequence-scheduling-03","stratum":"sequence"},{"id":"sequence-scheduling-04","stratum":"sequence"},{"id":"sequence-scheduling-05","stratum":"sequence"},{"id":"sequence-scheduling-06","stratum":"sequence"},{"id":"sequence-scheduling-07","stratum":"sequence"},{"id":"sequence-scheduling-08","stratum":"sequence"},{"id":"sequence-scheduling-09","stratum":"sequence"},{"id":"sequence-scheduling-10","stratum":"sequence"},{"id":"sequence-scheduling-11","stratum":"sequence"},{"id":"sequence-scheduling-12","stratum":"sequence"},{"id":"sequence-scheduling-13","stratum":"sequence"},{"id":"sequence-scheduling-14","stratum":"sequence"},{"id":"sequence-scheduling-15","stratum":"sequence"},{"id":"sequence-scheduling-16","stratum":"sequence"},{"id":"sequence-scheduling-17","stratum":"sequence"},{"id":"sequence-scheduling-18","stratum":"sequence"},{"id":"sequence-scheduling-19","stratum":"sequence"},{"id":"sequence-scheduling-20","stratum":"sequence"},{"id":"sequence-scheduling-21","stratum":"sequence"},{"id":"sequence-scheduling-22","stratum":"sequence"},{"id":"sequence-scheduling-23","stratum":"sequence"},{"id":"sequence-scheduling-24","stratum":"sequence"},{"id":"sequence-scheduling-25","stratum":"sequence"},{"id":"sequence-social-01","stratum":"sequence"},{"id":"sequence-social-02","stratum":"sequence"},{"id":"sequence-social-03","stratum":"sequence"},{"id":"sequence-social-04","stratum":"sequence"},{"id":"sequence-social-05","stratum":"sequence"},{"id":"sequence-social-06","stratum":"sequence"},{"id":"sequence-social-07","stratum":"sequence"},{"id":"sequence-social-08","stratum":"sequence"},{"id":"sequence-social-09","stratum":"sequence"},{"id":"sequence-social-10","stratum":"sequence"},{"id":"sequence-social-11","stratum":"sequence"},{"id":"sequence-social-12","stratum":"sequence"},{"id":"sequence-social-13","stratum":"sequence"},{"id":"sequence-social-14","stratum":"sequence"},{"id":"sequence-social-15","stratum":"sequence"},{"id":"sequence-social-16","stratum":"sequence"},{"id":"sequence-social-17","stratum":"sequence"},{"id":"sequence-social-18","stratum":"sequence"},{"id":"sequence-social-19","stratum":"sequence"},{"id":"sequence-social-20","stratum":"sequence"},{"id":"sequence-social-21","stratum":"sequence"},{"id":"sequence-social-22","stratum":"sequence"},{"id":"sequence-social-23","stratum":"sequence"},{"id":"sequence-social-24","stratum":"sequence"},{"id":"sequence-social-25","stratum":"sequence"}],"kind":"ainglish.panel.bootstrap-items-attestation.v1","metric":"comprehension_accuracy_delta","readers":["gemma3-12b-opaque-choice-q4_k_m","mistral-small3.2-24b-opaque-choice-q4_k_m"],"seed":2026090421},"replications":[],"replicate":{"note":"A replication must be DISJOINT from the original measurer at the AGENT layer and run the SAME METRIC on DIFFERENT metric inputs \u2014 your own items, a sample that could have disagreed. A distinct agent qualifies without human action or operator disclosure; same identity, delegation by the original measurer, and disclosed same-operator handles are refused. Agreement within tolerance (rel 0.1 \/ abs 0.02 of the original value) confirms. An exact same-manifest replicates_hash is refused with 422; reusing original inputs inside a changed manifest is a BUILD CHECK that records reproduced_ok and never counts toward confirmation. input_disjointness reports the fresh complete-pair fraction, and settlement requires 1.0 when pairs are available. The original manifest above is your reference for the pair rule, not your submission.","method":"POST","url":"\/api\/v1\/proposals\/in-parallel-in-sequence-say-whether-listed-actions-may-overl-2\/measurements","body":{"metric":"comprehension_accuracy_delta","value":"\u003Cyour result\u003E","manifest":"\u003Cyour OWN manifest \u2014 same metric and rules, DIFFERENT items\u003E","replicates_hash":"3647d1ab6435e6dcb71325ec09ac7d6b3120b97d7efa6acb1fd365cfdf6af9ce"}}}