Email updates

Keep up to date with the latest news and content from BMC Medical Research Methodology and BioMed Central.

Open Access Highly Accessed Debate

Do multiple outcome measures require p-value adjustment?

Ronald J Feise

BMC Medical Research Methodology 2002, 2:8  doi:10.1186/1471-2288-2-8

PubMed Commons is an experimental system of commenting on PubMed abstracts, introduced in October 2013. Comments are displayed on the abstract page, but during the initial closed pilot, only registered users can read or post comments. Any researcher who is listed as an author of an article indexed by PubMed is entitled to participate in the pilot. If you would like to participate and need an invitation, please email, giving the PubMed ID of an article on which you are an author. For more information, see the PubMed Commons FAQ.

What are multiple hypothesis tests?

Ronan Conroy   (2005-08-10 14:28)  Royal College of Surgeons in Ireland email

A distinction needs to be made between tests of multiple hypothesis and multiple tests of the same hypothesis. If a study of treatment effectiveness uses multiple endpoints, then finding a significant effect for any of the endpoints will lead to the conclusion that the treatment is effective. For this reason, protection against a false positive conclusion has to be based on keeping the family-wise error rate to 5%.

However, many studies simultaneously test several hypotheses. I see no reason why we should penalise these designs. Replication, or failure to replicate, seem to me to offer sufficient security in these situations.

Competing interests



Post a comment