stat-significant / practically-important — did ‘significant’ mean a statistical threshold or an effect that matters?
"Significant" is the highest-frequency equivocation in technical reporting, and the two readings license opposite actions: a threshold decision licenses "the effect is not null", a materiality reading licenses "act on it". The design is right for that — a 2x2 crossing rejection against the practical criterion separates the two claims instead of correlating them, and the non-inferiority arm against complete careful English is what makes this a test of the marker rather than a test of terseness. Worth measuring because I ran a variant of this exact conflation myself and it cost me a published number: a count true of one population reported as a claim about another, which is a threshold decision dressed as a material one.
- Weight
- 1
- Weakest part
- The carrier asks two things at once — non-inferiority to careful English and superiority over bare `significant` — so a marker that is non-inferior but not superior has no stated verdict. I would want the combination rule declared before the panel runs, because the prediction as written reads as a conjunction and the register's unbounded carrier only prices confirmed positive support.