## The Annals of Statistics

- Ann. Statist.
- Volume 26, Number 2 (1998), 505-524.

### Asymptotic comparison of step-down and step-up multiple test procedures based on exchangeable test statistics

#### Abstract

In this paper interest is focused on some theoretical investigations concerning the comparison of two popular multiple test procedures, so-called step-down and step-up procedures, in terms of their defining critical values. Such procedures can be applied, for example, to multiple comparisons with a control. In the definition of the critical values for these procedures order statistics play a central role. For $k \epsilon N_0$ fixed we consider the joint cumulative distribution function (cdf) $P(Y_{1:n} \leq c_1,\dots, Y_{n-k:n} \leq c_{n-k})$ of the first $n - k$ order statistics and the cdf$P(Y_{n-k:n} \leq c_{n-k})$ of the ($k + 1$)th largest order statistic $Y_{n-k:n}$ of $n$ random variables $Y_1,\dots, Y_n$ belonging to a sequence of exchangeable real-valued random variables. Our interest is focused on the asymptotic behavior of these cdf's and their interrelation if $n$ tends to $\infty$. It turns out that they sometimes behave completely differently compared with the iid case treated in Finner and Roters so that positive results are only possible under additional assumptions concerning the underlying distribution. We consider different sets of assumptions which then allow analogous results for the exchangeable case. Recently, Dalal and Mallows derived a result concerning the monotonicity of a certain set of critical values in connection with the joint cdf of order statistics in the iid case. We give a counterexample for the exchangeable case underlining the difficulties occurring in this situation. As an application we consider the comparison of certain step-down and step-up procedures in multiple comparisons with a control. The results of this paper yield a more theoretical explanation of the superiority of the step-up procedure which has been observed earlier by comparing tables of critical values. As a by-product we are able to quantify the tightness of the Bonferroni inequality in connection with maximum statistics.

#### Article information

**Source**

Ann. Statist., Volume 26, Number 2 (1998), 505-524.

**Dates**

First available in Project Euclid: 31 July 2002

**Permanent link to this document**

https://projecteuclid.org/euclid.aos/1028144847

**Digital Object Identifier**

doi:10.1214/aos/1028144847

**Mathematical Reviews number (MathSciNet)**

MR1626043

**Zentralblatt MATH identifier**

0934.62073

**Subjects**

Primary: 62G30: Order statistics; empirical distribution functions 62J15: Paired and multiple comparisons

Secondary: 60F99: None of the above, but in this section 62F05: Asymptotic properties of tests

**Keywords**

Bonferroni inequality comparisons with a control exchangeable random variables extreme order statistic familywise error rate joint distribution of order statistics many-one problem maximum statistic multiple comparisons multiple level step-down test step-up test

#### Citation

Finner, H.; Roters, M. Asymptotic comparison of step-down and step-up multiple test procedures based on exchangeable test statistics. Ann. Statist. 26 (1998), no. 2, 505--524. doi:10.1214/aos/1028144847. https://projecteuclid.org/euclid.aos/1028144847