For multiple comparisons in analysis of variance, the practitioners’ handbooks generally advocate standard methods such as Bonferroni, or an F-test followed by Tukey’s honest significant difference method. These methods are known to be suboptimal compared to closed testing procedures, but improved methods can be complex in the general multigroup set-up. In this note, we argue that the case of three-groups is special: with three groups, closed testing procedures are powerful and easy to use. We describe four different closed testing procedures specifically for the three-group set-up. The choice of method should be determined by assessing which of the comparisons are considered primary and which are secondary, as dictated by subject-matter considerations. We describe how all four methods can be used with any standard software.

Goeman, J., Solari, A. (2022). Comparing Three Groups. THE AMERICAN STATISTICIAN, 76(2), 168-176 [10.1080/00031305.2021.2002188].

Comparing Three Groups

Solari A.
2022

Abstract

For multiple comparisons in analysis of variance, the practitioners’ handbooks generally advocate standard methods such as Bonferroni, or an F-test followed by Tukey’s honest significant difference method. These methods are known to be suboptimal compared to closed testing procedures, but improved methods can be complex in the general multigroup set-up. In this note, we argue that the case of three-groups is special: with three groups, closed testing procedures are powerful and easy to use. We describe four different closed testing procedures specifically for the three-group set-up. The choice of method should be determined by assessing which of the comparisons are considered primary and which are secondary, as dictated by subject-matter considerations. We describe how all four methods can be used with any standard software.
Articolo in rivista - Articolo scientifico
Analysis of variance; Closed testing; Dunnett; Multiple comparisons; Multiple testing; Tukey’s honest significant difference;
English
27-dic-2021
2022
76
2
168
176
none
Goeman, J., Solari, A. (2022). Comparing Three Groups. THE AMERICAN STATISTICIAN, 76(2), 168-176 [10.1080/00031305.2021.2002188].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/345115
Citazioni
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 6
Social impact