Open Access Research article

Are concomitant treatments confounding factors in randomized controlled trials on intensive blood-glucose control in type 2 diabetes? a systematic review

Rémy Boussageon1, Irène Supper1, Sylvie Erpeldinger1, Michel Cucherat2, Theodora Bejan-Angoulvant34, Behrouz Kassai256, Catherine Cornu256 and François Gueyffier26*

Author Affiliations

1 Département de Médecine Générale, Université Claude Bernard Lyon 1, Lyon F-69008, France

2 UMR 5558, Laboratoire de Biométrie et Biologie Evolutive, CNRS, Université Claude Bernard Lyon 1, Villeurbanne F-69100, France

3 Service de Pharmacologie Clinique, Centre Hospitalier Régional et Universitaire de Tours, Tours, France

4 UMR 7292, CNRS, Université François Rabelais, Tours, France

5 Clinical Investigation Centre, INSERM CIC201, Louis Pradel Hospital, Bron 69500, France

6 Hospices Civils de Lyon, Service de Pharmacologie Clinique, Hôpital Louis Pradel, Bron 69500, France

For all author emails, please log on.

BMC Medical Research Methodology 2013, 13:107  doi:10.1186/1471-2288-13-107

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2288/13/107


Received:18 October 2012
Accepted:19 August 2013
Published:30 August 2013

© 2013 Boussageon et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Open-label, randomized controlled trials (RCTs) are subject to observer bias. If patient management is conducted without blinding, a difference between groups may be explained by other factors than study treatment. One factor may come from taking concomitant treatments with an efficacy on the studied outcomes. In type 2 diabetes, some antihypertensive or lipid-lowering drugs are effective against diabetic complications. We wanted to determine if these concomitant treatments were correctly reported in articles of RCTs on type 2 diabetes and if they might have influenced the outcome.

Methods

We performed a systematic review using Medline, Embase, and the Cochrane Library (from January 1950 to July 2010). Open-label RCTs assessing the effectiveness of intensive blood-glucose control in type 2 diabetes were included. We chose five therapeutic classes with proven efficacy against diabetes complications: angiotensin-converting enzyme inhibitors (ACEIs), angiotensin II receptor antagonists (AIIRAs), fibrates, statins, and aspirin. Differences between concomitant treatments were considered statistically significant when p < 0.05.

Results

A total of eight open-label RCTs were included, but only three (37.5%) of them published concomitant treatments. In two studies (ACCORD and ADVANCE), a statistically significant difference was observed between the two groups for aspirin (p = 0.02) and ACEIs (p = 0.02).

Conclusions

Few concomitant treatments were published in this sample of open-label RCTs. We cannot completely eliminate an observer bias for these studies. This bias probably influenced the results to an extent that has yet to be determined.

Keywords:
Blood glucose; Concomitant treatment; Observer bias; Randomized controlled trial; Type 2 diabetes mellitus

Background

In patients with type 2 diabetes (T2D), the efficacy of blood-glucose control is generally based on the UKPDS study [1]. The main results of this randomized study were published in 1998 and led to international guidelines on the treatment of type 2 diabetes [2]. It showed the efficacy of intensive blood-glucose control on the onset of microvascular complications. And also showed that metformin was efficacious against macrovascular complications and overall mortality in overweight patients [3]. However, even though UKPDS was randomized, this study is controversial because of its methodology and the publication of its results [4-6]. There was a risk of observer bias because the open-label study did not have any placebo group. The first potential problem lies in differences in the care management between the two groups throughout the study, combined with an imbalance in the prescription of concomitant treatments that may have influenced outcome measures [7]. This risk of bias, which is particularly high in open-label studies, can also occur in placebo-controlled, double-blind RCTs. For example in the FIELD study [8], the intake of statins is much bigger in the placebo group (36% vs 19%, p < 0.0001), which could partly explain why there is no significant difference for the primary endpoint. The consequences of such an imbalance in concomitant treatments between study groups may be particularly important since the studied outcomes are influenced by these treatments. In T2D, some antihypertensive and cholesterol-lowering drugs are effective against microvascular complications [9,10] and/or cardiovascular mortality [11,12]. Similarly, aspirin has a proven efficacy against the risk of having a coronary event in high-risk cardiovascular patients [13]. Because of this, we wondered how these concomitant treatments were reported in clinical trials on intensive blood-glucose control treatments in T2D. Our objective was also to compare concomitant treatments prescribed in each group in order to assess the possible confounding effect they may have had.

Methods

We previously performed a systematic review using Medline, Embase, and the Cochrane Library (from January 1950 to July 2010). RCTs which were randomized, assessing the efficacy of intensive glucose lowering treatment (oral or insulin) versus a standard treatment (standard care), less intensive glycaemic lowering treatment, or placebo (intensive glycaemic treatment could be defined either by a specified HbA1c target or by treatment intensification); trials using clinically relevant outcomes; and participants aged 18 or older with type 2 diabetes were included [14]. We analyzed the articles and supplemental documents (web appendices) of RCTs included in our meta-analysis that evaluated the efficacy of intensive blood-glucose control [14]. We especially looked for the intake of ACEIs, AIIRAs, fibrates, statins, and aspirin which have a proven efficacy on diabetic complications [9-13]. When the p-value for concomitant treatments was not specified in the publications, it was directly calculated and a statistical significance of 0.05 was determined. Authors were contacted for additional data when necessary.

Results

A total of eight open-label RCTs were found with the systematic review [1,3,15-20]. Only two publications specified concomitant treatments received by patients during the study. However, they did not publish data about all five therapeutic classes of interest (see the ACCORD and ADVANCE studies in Table 1) [18,19]. We contacted the authors of all trials, and received additional data from one study [16] (see Table 2). In total, only three studies (37,5%) reported data about concomitant treatments. In the ADVANCE study, data is only available on 86% of included patients [18]. There is a statistically significant difference (p = 0.02) in taking aspirin, which was more prescribed in the intensively treated group (Table 3). In the ACCORD study, data is available for 96% of included patients [19]. The intake of ACEIs is significantly more frequent in the conventional treatment group (p = 0.02) (Table 3). In the Kumamoto study, there was no statistically significant difference between groups (Table 3) [21].

Table 1. Concomitant treatments published in study reports

Table 2. Concomitant treatments in the Kumamoto study

Table 3. Differences in concomitant treatments between groups

Discussion

Our study highlights the lack of publications on concomitant treatments in trials assessing intensive blood-glucose control treatments in T2D. Only three out of eight RCTs (37.5, the ACCORD, ADVANCE, and Kumamoto (after direct contact with authors) studies reported the intake of these treatments without specifying the drugs, even though their efficacy on outcome measures had been proven. In two studies (ACCORD and AVANCE), statistically significant differences at 5% were seen in both groups treated with specific medications without controlling to what extent they influence study results. This lack of data is harmful, because the interpretation of study results may be distorted and lead to incorrect recommendations for clinical practice. Pooling proportions of cointerventions and looking for an interaction between differences in cointerventions and the effect of glycemic control on outcomes is feasible using meta-analysis and meta-regression techniques. This would help us reach our second objective, "if concomitant treatments are reported in clinical trials, to assess their possible confounding effect on outcome." However, this would require a minimum of 5 trials for each covariate. We were only able to retrieve data on concomitant treatments for three trials (two published and one obtained from the authors). Therefore, we felt that meta-regression would not be appropriate and would give unrobust results [22].

The example of UKPDS 33 [1] is a prime example of this. When it was published in The Lancet in 1998, it showed that intensive blood-glucose control was effective against the onset of microvascular complications and long-term macrovascular complications. Yet, the only outcome with a statistically significant change was the “retinal photocoagulation” outcome: RR = 0.71; CI 95% [0.53-0.96]. This outcome was added during the study and let the authors conclude that the treatment was effective against all diabetic complications: “any diabetes-related endpoints” (RR = 0.88 ; CI 95% [0.79-0.99]). There was also a difference in blood pressure (BP) between some groups: at six-year follow-up, the chlorpropamide-treated group showed a mean BP that was much higher than other groups (143/82 mmHg vs 138/80 mmHg, p < 0.001). UKPDS authors emphasized that the proportion of patients treated with an antihypertensive drug was different (p = 0.022) depending on the group: 43% for the chlorpropamide-treated group compared to 34%, 36% and 38% in other groups (respectively due to lifestyle and diet guidelines, glibenclamide, and insulin). Yet, UKPDS 38 [8] showed that treating BP could help reduce the risk of developing diabetic retinopathy. The double-blind, placebo-controlled DIRECT-2 RCT also showed that candesartan increases the rate of retinopathy regression in T2D by 34% (RR = 1.34; CI 95% (1.08-1.68)) [23]. In insulin-dependent (ID) diabetes, enalapril and losartan also proved to be effective on diabetic retinopathy regardless of BP (OR = 0.35 : CI 95% [0.14-0.85], OR = 0.30 ; [0.12-0.73] respectively) [24]. The FIELD [9] and ACCORD-Lipid [25] studies (two double-blind placebo-controlled RCTs) showed that fenofibrate was effective on retinopathy in T2D, regardless of the decrease in serum lipids. The efficacy of fenofibrate on this outcome measure seemed even higher than for blood-glucose control. Since UKPDS 34 was published, metformin has been considered to be the most effective treatment for overweight patients with T2D [3]. For overall mortality, the risk ratio of metformin compared to lifestyle and diet guidelines was 0.64, CI 95% [0.45-0.91]. However, a recent meta-analysis showed that metformin was not necessarily more effective than other treatments [26]. So, the positive result observed in UKPDS 34 may just be artificial, especially since in the same study, only the combination of metformin and sulfonamides was deleterious compared to sulfonamides alone (for overall mortality: RR = 1.6, CI 95% [1.02-2.52]). It would have been essential to know which concomitant treatments were present in this study. In a letter to the authors of UKPDS after the 10-year follow-up publication, the question of concomitant treatments came up: “Information on accompanying treatment during the study is necessary in order to interpret the mortality data.” [27] Surprisingly, UKPDS authors did not respond to this [28].

A lack of blinding may overestimate the effect studied from 17% to 34% [29-31]. However, not blinding can also lead to a lack of difference because the control group does not “stay constant.” For instance, the MRFIT study observed the effect of the multifactorial care management of cardiovascular risk on 12,000 patients compared to usual care. After seven years of follow-up, no difference between patient groups was observed for overall mortality or coronary events. One of the authors’ hypotheses was that the control group (usual care) had changed its health habits. Smoking had dropped from 59% to 46%, diastolic BP from 91 to 84 mmHg, and antihypertensive drug intake had increased from 19% to 47%. Because the cardiovascular risk of this control group decreased, the study had insufficient statistical power and could not demonstrate a statistically significant difference [32]. Yudkin [33] and Gale [34] call this phenomenon the “Hawthorne effect”: the study itself may change patients’ and doctors’ behavior. This is more of a problem in open-label studies where patients and doctors know what the study drug is. So it is appropriate that CONSORT 2010 recommends in Section 11b (on the blinding of RCTs) that co-intervention similarities [35] must be described and verified, which was not required in 2001 [36]. Concerning T2D treatment, the demonstration of blood-glucose control efficacy seems to be affected by the lack of publications on concomitant treatments whose effect on diabetic complications is already proven. However, it remains to be determined to what extent the results are affected by this bias.

Conclusions

Few concomitant treatments were published in this sample. There is a potential risk of observer bias in studies assessing the efficacy of blood-glucose control in T2D.

Competing interests

The authors do not have any competing interests to declare.

Authors’ contributions

RB, CC, and FG conceived the study. RB, IS, and SE extracted the data and reviewed the selected papers. RB and CC performed the statistical analysis. RB, IS, SE, CC, FG, and TBA drafted the manuscript. MC, BK, CC, TBA, and FG helped interpret the results. All authors read and approved the final manuscript.

Authors’ information

RB: general practitioner and lecturer

IS: general practitioner and lecturer

SE: general practitioner and lecturer

MC: consultant

TBA: cardiologist, pharmacologist, and lecturer

BK: pediatric pharmacologist and professor

CC: endocrinologist, pharmacologist, and lecturer

FG: cardiologist and professor

Acknowledgements

The authors would like to thank Cléa Foret for translating the manuscript and Kent Neal (supported by the French Cochrane Center) for proofreading the English.

References

  1. UK Prospective Diabetes Study (UKPDS) Group: Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33).

    Lancet 1998, 352:837-853. PubMed Abstract | Publisher Full Text OpenURL

  2. Nathan DM, Buse JB, Davidson MB, Ferrannini E, Holman RR, Sherwin R, Zinman B, American Diabetes Association: Medical management of hyperglycemia in type 2 diabetes: a consensus algorithm for the initiation and adjustment of therapy.

    Diabetes Care 2009, 32:193-203. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. UK Prospective Diabetes Study (UKPDS) Group: Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes (UKPDS 34).

    Lancet 1998, 352:854-865. PubMed Abstract | Publisher Full Text OpenURL

  4. Nathan DM: Some answers, more controversy, from UKPDS.

    Lancet 1998, 352:832-833. PubMed Abstract | Publisher Full Text OpenURL

  5. Ewart RM: The case against agressive treatment of type 2 diabetes: critique of the UK prospective diabetes study.

    BMJ 2001, 323:854-858. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  6. McCormack J, Greenlahg T: Seeing what you want to see in randomised controlled trials : versions and perversions of UKPDS data.

    BMJ 2000, 320:1720-1723. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  7. Schulz KF, Grimes DA: Blinding in randomised trials: hiding who got what.

    Lancet 2002, 359:696-700. PubMed Abstract | Publisher Full Text OpenURL

  8. Keech A, Simes RJ, Barter P, Best J, Scott R, Taskinen MR, Forder P, Pillai A, Davis T, Glasziou P, Drury P, Kesäniemi YA, Sullivan D, Hunt D, Colman P, d’Emden M, Whiting M, Ehnholm C, Laakso M, FIELD study investigators: Effects of long-term fenofibrate therapy on cardiovascular events in 9795 people with type 2 diabetes mellitus (the FIELD study): randomised controlled trial.

    Lancet 2005, 366:1849-1861. PubMed Abstract | Publisher Full Text OpenURL

  9. Keech AC, Mitchell P, Summanen PA, O'Day J, Davis TM, Moffitt MS, Taskinen MR, Simes RJ, Tse D, Williamson E, Merrifield A, Laatikainen LT, D’Emden MC, Crimet DC, O’Connell RL, Colman PG, FIELD study investigators: Effect of fenofibrate on the need for laser treatment for diabetic retinopathy (FIELD study): a randomised controlled trial.

    Lancet 2007, 370:1687-1697. PubMed Abstract | Publisher Full Text OpenURL

  10. UK Prospective Diabetes Study Group: Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38.

    BMJ 1998, 317:703-713. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Heart Outcomes Prevention Evaluation Study Investigators: Effects of ramipril on cardiovascular and microvascular outcomes in people with diabetes mellitus: results of the HOPE study and MICRO-HOPE substudy.

    Lancet 2000, 355:253-259. PubMed Abstract | Publisher Full Text OpenURL

  12. Collins R, Armitage J, Parish S, Sleight P, Peto R, Heart Protection Study Collaborative Group: Effects of cholesterol-lowering with simvastatin on stroke and other major vascular events in 20536 people with cerebrovascular disease or other high-risk conditions.

    Lancet 2004, 363:757-767. PubMed Abstract | Publisher Full Text OpenURL

  13. Pignone M, Alberts MJ, Colwell JA, Cushman M, Inzucchi SE, Mukherjee D, Rosenson RS, Williams CD, Wilson PW, Kirkman MS, American Diabetes Association: Aspirin for primary prevention of cardiovascular events in people with diabetes: a position statement of the American diabetes association, a scientific statement of the American heart association, and an expert consensus document of the American college of cardiology foundation.

    Diabetes Care 2010, 33:1395-1402. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  14. Boussageon R, Bejan-Angoulvant T, Saadatian-Elahi M, Lafont S, Bergeonneau C, Kassaï B, Erpeldinger S, Wright JM, Gueyffier F, Cornu C: Effect of intensive glucose-lowering treatment on all cause mortality, cardiovascular death, and microvascular events in type 2 diabetes mellitus: a meta-analysis of randomised controlled trials.

    BMJ 2011, 343:d4169. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. UGDP: Effects of hypoglycemic agents on vascular complications in patients with adult-onset diabetes. VIII. Evaluation of insulin therapy: final report.

    Diabetes 1982, 31:1-81. PubMed Abstract | Publisher Full Text OpenURL

  16. Ohkubo Y, Kishikawa H, Araki E, Miyata T, Isami S, Motoyoshi S, Kojima Y, Furuyoshi N, Shichiri M: Intensive insulin therapy prevents the progression of diabetic microvascular complications in Japanese patients with non-insulin dependent diabetes mellitus: a randomized prospective 6 year study.

    Diab Res Clin Pract 1995, 28:103-117. Publisher Full Text OpenURL

  17. Abraira C, Colwell J, Nuttall F, Sawin CT, Henderson W, Comstock JP, Emanuele NV, Levin SR, Pacold I, Lee HS: Cardiovascular events and correlates in veterans affairs diabetes feasibility trial. Veterans affairs cooperative study on glycemic control and complications in type II diabetes.

    Arch Intern Med 1997, 157:181-188. PubMed Abstract | Publisher Full Text OpenURL

  18. The ADVANCE Collaborative Group: Intensive blood glucose control and vascular outcomes in patients with type 2 diabetes.

    N Engl J Med 2008, 358:2560-2572. PubMed Abstract | Publisher Full Text OpenURL

  19. The ACCORD study group: Effects of intensive glucose lowering in type 2 diabetes.

    N Engl J Med 2008, 358:2545-2559. PubMed Abstract | Publisher Full Text OpenURL

  20. Duckworth W, Abraira C, Moritz T, Reda D, Emanuele N, Reaven PD, Zieve FJ, Marks J, Davis SN, Hayward R, Warren SR, Goldman S, McCarren M, Vitek ME, Henderson WG, Huang GD, VADT Investigators: Glucose control and vascular complications in veterans with type 2 diabetes.

    N Engl J Med 2009, 360:129-139. PubMed Abstract | Publisher Full Text OpenURL

  21. Shichiri M, Kishikawa H, Ohkubo Y, Wake N: Long-term results of the Kumamoto study on optimal diabetes control in type 2 diabetic patients.

    Diabetes Care 2000, 23:B21-B29. PubMed Abstract OpenURL

  22. Thompson SG, Higgins JP: How should Meta-regression analyses be undertaken and interpreted?

    Stat Med 2002, 21:1559-1573. PubMed Abstract | Publisher Full Text OpenURL

  23. Sjølie AK, Klein R, Porta M, Orchard T, Fuller J, Parving HH, Bilous R, Chaturvedi N, DIRECT Programme Study Group: Effect of candesartan on progression and regression of retinopathy in type 2 diabetes (DIRECT-protect 2): a randomised placebo-controlled trial.

    Lancet 2008, 372:1385-1393. PubMed Abstract | Publisher Full Text OpenURL

  24. Mauer M, Zinman B, Gardiner R, Suissa S, Sinaiko A, Strand T, Drummond K, Donnelly S, Goodyer P, Gubler MC, Klein R: Renal and retinal effects of enalapril and losartan in type 1 diabetes.

    N Engl J Med 2009, 361:40-51. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  25. Chew EY, Ambrosius WT, Davis MD, Danis RP, Gangaputra S, Greven CM, Hubbard L, Esser BA, Lovato JF, Perdue LH, Goff DC Jr, Cushman WC, Ginsberg HN, Elam MB, Genuth S, Gerstein HC, Schubart U, Fine LJ, ACCORD Study Group: Effects of medical therapies on retinopathy progression in type 2 diabetes.

    N Engl J Med 2010, 363:233-244.

    Erratum in: N Engl J Med 2011, 364:190

    PubMed Abstract | Publisher Full Text OpenURL

  26. Lamanna C, Monami M, Marchionni N, Mannucci E: Effect of metformin on cardiovascular events and mortality: a meta-analysis of randomized clinical trials.

    Diabetes Obes Metab 2011, 13:221-228. PubMed Abstract | Publisher Full Text OpenURL

  27. Mühlhauser I: Follow-up of intensive glucose control in type 2 diabetes.

    N Engl J Med 2009, 360:417. PubMed Abstract OpenURL

  28. Holman RR, Matthews DR, Neil HA: Follow-up of intensive glucose control in type 2 diabetes. The authors reply.

    N Engl J Med 2009, 360:418. PubMed Abstract | Publisher Full Text OpenURL

  29. Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials.

    JAMA 1995, 273:408-412. PubMed Abstract | Publisher Full Text OpenURL

  30. Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP: Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?

    Lancet 1998, 352:609-613. PubMed Abstract | Publisher Full Text OpenURL

  31. Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, Gluud C, Martin RM, Wood AJ, Sterne JA: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study.

    BMJ 2008, 336:601-605.

    Epub 2008 Mar 3

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  32. Multiple Risk Factor Trial Research Group: Multiple risk factor intervention trial. Risk factor changes and mortality results.

    JAMA 1982, 248:1465-1477. PubMed Abstract | Publisher Full Text OpenURL

  33. Yudkin J: Hyperglycaemia as a cardiovascular risk factor in diabetes.

    BMJ 2008, 372:1036-1037. OpenURL

  34. Gale EAM: The Hawthorne studies – a fable for our time?

    QJM 2004, 97:439-449. PubMed Abstract | Publisher Full Text OpenURL

  35. Schulz KF, Altman DG, Moher D, CONSORT Group: CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials.

    BMJ 2010, 340:c332. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  36. Moher D, Schulz KF, Altman DG: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials.

    Lancet 2001, 357:1191-1194. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2288/13/107/prepub