Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Open Badges Research article

Dutch healthcare reform: did it result in better patient experiences in hospitals? a comparison of the consumer quality index over time

David E Ikkersheim* and Xander Koolman

BMC Health Services Research 2012, 12:76  doi:10.1186/1472-6963-12-76

PubMed Commons is an experimental system of commenting on PubMed abstracts, introduced in October 2013. Comments are displayed on the abstract page, but during the initial closed pilot, only registered users can read or post comments. Any researcher who is listed as an author of an article indexed by PubMed is entitled to participate in the pilot. If you would like to participate and need an invitation, please email, giving the PubMed ID of an article on which you are an author. For more information, see the PubMed Commons FAQ.

The conclusion that competition caused improved satisfaction is flawed

Robert Grant   (2012-06-01 12:18)  Kingston University & St George's, University of London

The analyses carried out by Ikkersheim and Koolman are thorough and entirely appropriate, but the conclusion of this paper that competition and publication of satisfaction statistics caused improvements in patient satisfaction is far from justified. The conclusions are subject to four major flaws:

1) post hoc ergo propter hoc - in particular, the latest measurement (2009) has significantly younger participants

2) the improvement is tiny and probably meaningless: the time effect is about 1% of the scale, the publishing of stats effect slightly less and the "competition" effect is 0.1%. Because the numbers of patients involved is large, everything is statistically significant

3) The definition of the CQI scale changed during the period being analysed. Table 4 reveals that this reversed some of the results, which suggest great caution is required when interpreting the results

4) Competition is defined based on the division of 'market share' among geographically nearby hospitals. This is therefore an inadvertent proxy for urban / rural location rather than competition. It seems likely that networks linking healthcare providers to the public will be more complex than simple geographical distance, particularly in a small and highly urbanised country such as the Netherlands.

These are typical of the difficulties in analysing natural experiments, which is why statisticians never tire of reminding colleagues that "correlation is not causation".

Competing interests

No competing interests


Post a comment