Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Research article

Dutch healthcare reform: did it result in better patient experiences in hospitals? a comparison of the consumer quality index over time

David E Ikkersheim12* and Xander Koolman2

Author affiliations

1 KPMG Plexus, Breukelen, The Netherlands

2 FALW, VU University, Amsterdam, The Netherlands

For all author emails, please log on.

Citation and License

BMC Health Services Research 2012, 12:76  doi:10.1186/1472-6963-12-76


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/12/76


Received:10 May 2011
Accepted:25 March 2012
Published:25 March 2012

© 2012 Ikkersheim and Koolman; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

In 2006, the Dutch hospital market was reformed to create a more efficient delivery system through managed competition. To allow competition on quality, patient experiences were measured using the Consumer Quality index (CQI). We study whether public reporting and competition had an effect on the CQI between 2006 and 2009.

Methods

We analyzed 8,311 respondents covering 31 hospitals in 2006, 22,333 respondents covering 78 hospitals in 2007 and 24,246 respondents covering 94 hospitals in 2009. We describe CQI trends over the period 2006-2009. In addition we compare hospitals that varied in the level of competition they faced and hospitals that were forced to publish CQI results publicly and those that were not. We corrected for observable covariates between hospital respondents using a multi level linear regression. We used the Herfindahl Hirschman Index to indicate the level of competition.

Results

Between 2006 and 2009 hospitals showed a CQI improvement of 0.034 (p < 0.05) to 0.060 (p < 0.01) points on a scale between one and four. Hospitals that were forced to publish their scores showed a further improvement of 0.027 (p < 0.01) to 0.030 (p < 0.05). Furthermore, hospitals that faced more competition from geographically close competitors showed a more pronounced improvement of CQI-scores 0.004 to 0.05 than other hospitals (p < 0.001).

Conclusion

Our results show that patients reported improved experiences measured by the CQI between 2006 and 2009. CQI levels improve at a faster rate in areas with higher levels of competition. Hospitals confronted with forced public publication of their CQI responded by enhancing the experiences of their patients.

Background

In the last two decades, several Western countries introduced some form of managed competition in their health care system [1,2]. Common goal of these reforms is creating a demand driven system that provides more patient centered care [3]. To achieve this goal the quality of health care providers needs to be assessed and publicly reported [4,5]. Patients and health plans may then use quality information to make informed choices between health care providers.

The public reporting of provider quality can stimulate quality improvement through informed patient choice, quality contracting of providers by health plans and/or by intrinsic motivation of health care providers [6]. Previous studies have shown that public reporting of quality information does stimulate hospitals to initiate quality improvement projects. It remains unclear if--and to what extent--the introduction of managed competition combined with public quality reporting may affect quality [7-9].

We set out to answer this question in the context of the Dutch 2006 Health Insurance Act (HIA) reform. It was enacted to stimulate managed competition in the hospital market. Before the reforms all hospitals were financed through 'input' reimbursement. Hence hospital budget did not directly depend on production, but rather on historic agreements with the insurer regarding their budget. The after reform characteristics of the Dutch health can be summarized as followed: [2,10]

• There is a mandatory basic health insurance for everyone, purchased through private insurers (both profit and not-for-profit are possible);

• There is annual consumer choice of insurer and insurer products and choice between in kind and restitution policy;

• Insurers are obliged to have a system of open enrollment and are compensated via a risk-equalization system;

• There is a mandatory deductible of € 150 and avoluntary deductible up to € 650 per person per year;

• Insurers are expected to contract selectively with competing health care providers;

• The government requires health care providers to release quality information.

To enable provider competition, products were defined in terms of Diagnosis Treatment Combinations (DTCs), which are to some extent comparable to diagnosis related groups [11]. A number of initiatives were aimed at making provider quality transparent. These include widespread measurement of medical quality indicators that aim to indicate outcome utility and the measurement of the Consumer Quality Index (CQI) that aims to measure process utility. It is partly based on the Consumer Assessment of Healthcare Providers and Systems [12]. The CQI therefore is a partial measure of healthcare quality based on more objective consumer experiences rather than a more subjective satisfaction [13].

From 2006 onwards health plans were increasingly stimulated to negotiate with hospitals on price, quantity and quality of care. While in 2006 negotiations were restricted to products accounting for 7% of the total hospital budget, this was increased to 34% in 2009, and is expected to further increase to 70% in the near future. Consequently, hospitals are increasingly exposed to competition [14]. However, the bargaining power of health plans remains limited due to a limited use of selective hospital contracting by health plans. In addition health plans are currently reluctant with proactive member channeling toward preferred hospitals [15]. While this may have reduced competition during 2006-2009, the threat of significant competition in the future may have sparked hospital policy changes.

We examined whether the patient experiences of hospital care improved in the period 2006-2009. In addition we investigated whether forced public reporting of hospitals and higher levels of competition--in line with previous studies and policy objectives--were associated with better patient experiences [7,9,16,17].

Methods

Available data

Hospital care experiences of patients were measured in 2006, 2007 and 2009. Each year the questionnaire was sent to a random sample of patients who stayed at the hospital during the respective year. In 2006 31 hospitals out of total 94 Dutch hospitals participated in the measurement. This number increased to 78 in 2007 and 93 in 2009 [13].

Under Dutch law no specific ethical approval was required for our research as the respondents were informed during filling in the questionnaire that their answers may be used for research purposes.

The CQI consisted of seven quality aspects (Physician communication, Nurses communication, Pain treatment, New medication communication, Accommodation, Discharge information and Nurse services) in 2006. In 2007 eight quality aspects were added and one was deleted (see Table 1). In 2009 one quality aspect was deleted (see Table 1). All quality aspects were rated based on multiple answers which were scored at a four point scale. This scale varies between one for the lowest possible score and four indicating the highest possible score [13].

Table 1. number of questions per quality aspect

Not all quality aspects were suitable for our analysis. The scale of the quality aspect 'information after discharge' was adjusted in 2007 and therefore lacks comparability between the years 2006 and later years. In the quality aspects New medication communication, Accommodation and Intake conversation, questions were deleted after analyses showed they did not discriminate between respondents. Consequently trends over time may be biased and these quality aspects were (partly) excluded from further analyses (see Table 1) [13].

Primary analyses and publication

Each year the results for the individual hospitals were case mix corrected using multilevel linear regression analyses (consumer experiences were nested within hospitals) [18]. Means with comparison intervals (1.39 standard error) were calculated per quality aspect and per hospital adjusted for age, education and reported physical health, sex and reported mental wellbeing [19]. Next, hospitals were divided in three groups and given a 'star rating': one star if their interval was completely below the average across all providers, two stars if their interval overlaps with the average across all providers and three stars if their interval was completely above the average across all providers, so that the public could easily interpret the results of the individual hospitals.

Depending on the dominant health plan in the catchment area of the hospital, 16 out of 31 hospitals were confronted with forced publication their 2006 results. This decision was made by the health plan without consultation of hospitals. In 2007 none of the results were publicly reported. All 2009 results will be published at the health care portal http://www.kiesbeter.nl webcite and some results are already publicly reported at health plans' websites. All hospitals have received their CQI results for each of the years [20].

Secondary statistical analyses

We combined the data of the three years and conducted a multilevel linear regression analyses per quality aspect for the relevant years (2006/2007/2009 or 2007/2009). In addition we ran multilevel linear regressions for the combined quality aspects 1-3 (2006/2007/2009) and 4-12 (2007/2009), with quality aspects nested in individual respondents. In the regressions we corrected for the relevant case mix variables: age, education and reported physical health, sex and reported mental wellbeing.

We added dummies for groups of hospitals with different participation patterns to correct for different CQI scores between these groups of hospitals. To assess if hospitals which were confronted with published CQI results by health plans in 2006 outperformed hospitals which were not, we included a dummy variable for those hospitals which we included in our multi level linear regression model. In order to identify hospitals that faced more competition from neighboring hospital we used the Herfindahl Hirschman Index (HHI) of hospitals. This HHI was used as an explanatory variable in an ordinary least square (OLS) regression, while correcting for time effects and case mix variables [21]. All analyses were conducted in Stata/IC version 11.0.

Results

Respondents

In 2006 8,311 respondents filled out the questionnaire. The number of respondents per hospital varied from 177 to 365 (mean = 268.10; SD = 34.06). In 2007, 22,333 respondents (response = 61%) filled out the questionnaire and the numbers per hospital varied from 190 to 358 (mean = 286.32; SD = 36.61). In 2009, 24,246 respondents filled out the questionnaire (response = 57%) and the numbers per hospitals varied from 128 to 458 (mean = 257.93; SD = 56.30). Table 2 shows the non-response analyses, in 2009 respondents were significantly younger than non-respondents.

Table 2. Non-response analyses

Change in performance over time

Table 3 displays the uncorrected mean and standard deviation per included quality aspect per included year. Both means and standard deviation seem fairly constant throughout the period 2006-2009.

Table 3. mean and standard deviation per quality aspect in 2006, 2007 and 2009

In Table 4 the result of the multi level linear regression per separate quality aspect is presented. For the first three quality aspects (Physician communication, Nurses communication, Pain treatment) the regression spans the years 2006, 2007 and 2009. The time effects of the years 2007 and 2009 for the first three quality aspects are mixed with significant positive and negative coefficients. The latter nine quality aspects (New medication communication, Accommodation, Treatment explanation, Feeling safe, Respect for autonomy, Contradictive information, Discharge information, Ward intake experience, Hospital accessibility) show more consistent results: seven quality aspects show significant improvement in 2009 compared to 2007.

Table 4. Multi level linear regression: coefficients and significance per quality aspect with relevant years 2006/2007/2009(#) or 2007/2009

Publication of results consequently has a non-significant consistent positive relationship with higher performance for 10 quality aspects. The quality aspects show significant improvement 'Physician communication' and 'Accommodation' at the p < 0.05 and P < 0.01 level.

Table 5 shows that the combined analyses of quality aspects yields consistent results: in 2009 hospitals improved their performance with 0.034 (p < 0.05) to 0.060 (p < 0.01) points compared to 2006 and 2009. Publication of results is associated with an improved the performance of hospitals of 0.027 (p < 0.01) to 0.030 (p < 0.05) points.

Table 5. Multi level linear regression; coefficients and significance of combined quality aspects

Performance and level of competition

The aggregated analyses of quality aspects 1-3 and 4-12 shows that the HHI is inversely significantly related to the performance of hospitals at the p < 0.001 level, meaning that hospitals who face a higher level of competition outperform hospitals who face a lower level of competition, as shown in Table 6.

Table 6. OLS with HHI per quality aspect with relevant years 2006/2007/2009(#) or 2007/2009

The coefficient is small, but this is largely caused by the scale of the HHI, which theoretically ranges from 1 to 10,000, but in our dataset ranges from 807 to 9,133. If one multiplies coefficients by these differences, the potential impact of the HHI is equal to a coefficient of approximately 0.004 to 0.05 points on the CQI which varies in our dataset between 2.97 and 3.88. Thereby this effect is in the same order of magnitude as the found time effects in Table 5.

Discussion

We have examined the effects of the introduced transparency and competition between providers on patient experiences within the Dutch hospital market. This study is the first which systematically evaluates these effects within the Dutch setting. In addition we were able to use a dataset which enabled us to compare hospitals which were confronted with transparency early on with hospitals which were not. Our findings are as follows: First, we observe that patient experiences measured with the CQI improve over the course of years. Secondly, hospitals which are confronted with forced transparency early on are improving faster than hospitals which were not. This is evidence that the introduced transparency under the HIA may have improved quality of care, especially because patients' trust in hospitals shows the opposite trend, this declined over the same period from 68% to 66% [22]. Thirdly, we find that higher levels of competition adjusted for case mix differences and time effects are related with better patient experiences,.

Although the findings in our study are in line with previous studies our study may have suffered from possible limitations [8,23]. First, in this study we show that Dutch hospitals are improving their performance, but they found improvements are fairly small. It is well documented that CQI differences between good and bad performing providers are in the same orders of magnitude as we have found [24,25]. Therefore we believe that the differences in patient experiences between providers are meaningful and relevant for policy makers, health plans and hospitals. Moreover, we believe that current levels of competition are weak and our effects are likely to become stronger as competition increases. Secondly, and in line with our hypotheses and previous studies, our study indicates that a higher level of competition is related to better performance of hospitals. The effect of a higher level of competition on patient experiences is in the same order of magnitude as the found time effects [8,16]. We use the HHI to indicate the level of competition that is calculated in 2004. Although some mergers took place within the Dutch hospital market since 2004, changes in market share over time are fairly modest [26]. In addition, most mergers took place on a board level, while merging the enterprises of the medical specialists on the multiple locations often lags several years behind. This maintains the same pre-merger level of competition between medical specialists. Therefore we believe that adjusting the HHI over the course of years would not have altered our conclusions.

Conclusions

In conclusion, our results show that patients reported improved experiences measured by the CQI between 2006 and 2009. CQI levels improve at a faster rate in areas with higher levels of competition. Hospitals confronted with forced public publication of their CQI responded by enhancing the experiences of their patients.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

DI drafted the manuscript and contributed to all other quality aspects of the study. XK was involved in the data analyses and performed critical revision of the manuscript. All authors read and approved the final manuscript.

Additional file 1. Supplementary data.

Format: DOC Size: 117KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Acknowledgements

The health plans financed collection of the data. We wish to thank them and Stichting Miletus for making the data available to us. Also we would like to thank Dolf de Boer for his useful comments.

References

  1. Saltman RB, Figueras J: Analyzing the evidence on European health care reforms.

    Health Aff (Millwood) 1998, 17(2):85-108. Publisher Full Text OpenURL

  2. Enthoven AC, van de Ven WP: Going Dutch-managed-competition health insurance in the Netherlands.

    N Engl J Med 2007, 357(24):2421-2423. PubMed Abstract | Publisher Full Text OpenURL

  3. Enthoven AC: The history and principles of managed competition.

    Health Aff (Millwood) 1993, 12(Suppl):24-48. Publisher Full Text OpenURL

  4. Fung CH, Lim YW, Mattke S, Damberg C, Shekelle PG: Systematic review: the evidence that publishing patient care performance data improves quality of care.

    Ann Intern Med 2008, 148(2):111-123. PubMed Abstract OpenURL

  5. Porter ME, Teisberg EO: Redefining Competition in Health Care.

    Harvard Business Review 2004, 82(6):64-76. PubMed Abstract OpenURL

  6. Berwick DM, James B, Coye MJ: Connections between quality measurement and improvement.

    Med Care 2003, 41(1 Suppl):I30-I38. PubMed Abstract | Publisher Full Text OpenURL

  7. Hibbard JH, Stockard J, Tusler M: It isn't just about choice: the potential of a public performance report to affect the public image of hospitals.

    Med Care Res Rev 2005, 62(3):358-371. PubMed Abstract | Publisher Full Text OpenURL

  8. Hibbard JH, Stockard J, Tusler M: Hospital performance reports: impact on quality, market share, and reputation.

    Health Aff 2005, 24(4):1150-1160. Publisher Full Text OpenURL

  9. Hibbard JH, Stockard J, Tusler M: Does publicizing hospital performance stimulate quality improvement efforts?

    Health Aff (Millwood) 2003, 22(2):84-94. Publisher Full Text OpenURL

  10. Hendriks M, Spreeuwenberg P, Rademakers J, Delnoij DMJ: Dutch healthcare reform: did it result in performance improvement of health plans? A comparison of consumer experiences over time.

    BMC Health Serv Res 2009, 9(1):167. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  11. The Content of DTCs [http://www.dbconderhoud.nl/Over-de-DBC-systematiek/Wat-is-de-DBC-systematiek] webcite

  12. Delnoij D, Ten Asbroek G, Arah O, De Koning J, Stam P, Poll A, NS K: Made in the USA: The import of American Consumer Assessment of Health Plan Surveys (CAHPS) into the Dutch social insurance system.

    Eur J Public Health 2006, 16(6):652-665. PubMed Abstract | Publisher Full Text OpenURL

  13. NIVEL: Vragenlijst CQI ziekenhuiszorg 2006, 2007, 2009 [Questionnaire CQI hospital care 2006, 2007, 2009]. Utrecht: NIVEL; 2009. OpenURL

  14. Plexus: Werken aan de Zorg - Kosten & Kwaliteit [Working on health care - Costs & Quality]. Breukelen: Plexus; 2010. OpenURL

  15. Boonen LH, Schut FT, Donkers B, Koolman X: Which preferred providers are really preferred? Effectiveness of insurers' channeling incentives on pharmacy choice.

    Int J Health Care Finance Econ 2009, 9:347-366. Publisher Full Text OpenURL

  16. Berwick DM, James B, Coye MJ: Connections between quality measurement and improvement.

    Medical Care 2003, 41(1 Suppl):I30-I38. PubMed Abstract | Publisher Full Text OpenURL

  17. VWS: Vraag aan Bod [Demand in charge]. The Hague: VWS - Ministry of Health, Welfare and Sport; 2000. OpenURL

  18. Damman OC, Stubbe JH, Hendriks M, Arah OA, Spreeuwenberg P, Delnoij DM, Groenewegen PP: Using multilevel modeling to assess case-mix adjusters in consumer experience surveys in health care.

    Med Care 2009, 47(4):496-503. PubMed Abstract | Publisher Full Text OpenURL

  19. Goldstein H, Healy MJR: The graphical presentation of a collection of means.

    J R Stat Soc 1995, 581(Part 1):175-177. OpenURL

  20. Guidelines for data acquisition, data analyses and reporting of customer quality indexes in the Netherlands [http://www.centrumklantervaringenzorg.nl] webcite

  21. The Herfindahl-Hirschman Index is a commonly accepted measure of market concentration. It is calculated by squaring the market share of each firm competing in the market and then summing the resulting numbers. For example, for a market consisting of four firms with shares of thirty, thirty, twenty and twenty percent, the HHI is 2600 ((30*30) + (30*30) + (20*20) + (20*20) = 2600)

  22. NIVEL: Consumenten panel zorg [Consumers panel health care]. Utrecht: NIVEL; 2009. OpenURL

  23. Gaynor MS, Propper C: Death by Market Power: Reform, Competition and Patient Outcomes in the National Health Service.

    NBER Working Paper 2010. OpenURL

  24. Stubbe JH, Brouwer W, Delnoij DM: Patients' experiences with quality of hospital care: the Consumer Quality Index Cataract Questionnaire.

    BMC Ophthalmol 2007, 7:14. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  25. Stubbe JH, Gelsema T, Delnoij DM: The Consumer Quality Index Hip Knee Questionnaire measuring patients' experiences with quality of care after a total hip or knee arthroplasty.

    BMC Health Serv Res 2007, 7:60. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  26. NVZ: NVZ Brancherapport 2009 [Dutch Association of Hospitals - year report 2009]. Utrecht: NVZ; 2009. OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/12/76/prepub