Skip to main content

Assessing health centre systems for guiding improvement in diabetes care

Abstract

Background

Aboriginal people in Australia experience the highest prevalence of diabetes in the country, an excess of preventable complications and early death. There is increasing evidence demonstrating the importance of healthcare systems for improvement of chronic illness care. The aims of this study were to assess the status of systems for chronic illness care in Aboriginal community health centres, and to explore whether more developed systems were associated with better quality of diabetes care.

Methods

This cross-sectional study was conducted in 12 Aboriginal community health centres in the Northern Territory of Australia. Assessment of Chronic Illness Care scale was adapted to measure system development in health centres, and administered by interview with health centre staff and managers. Based on a random sample of 295 clinical records from attending clients with diagnosed type 2 diabetes, processes of diabetes care were measured by rating of health service delivery against best-practice guidelines. Intermediate outcomes included the control of HbA1c, blood pressure, and total cholesterol.

Results

Health centre systems were in the low to mid-range of development and had distinct areas of strength and weakness. Four of the six system components were independently associated with quality of diabetes care: an increase of 1 unit of score for organisational influence, community linkages, and clinical information systems, respectively, was associated with 4.3%, 3.8%, and 4.5% improvement in adherence to process standards; likewise, organisational influence, delivery system design and clinical information systems were related to control of HbA1c, blood pressure, and total cholesterol.

Conclusion

The state of development of health centre systems is reflected in quality of care outcome measures for patients. The health centre systems assessment tool should be useful in assessing and guiding development of systems for improvement of diabetes care in similar settings in Australia and internationally.

Peer Review reports

Background

Indigenous Australians experience the highest prevalence of diabetes in the country, an excess of preventable complications and early death [1]. Published studies have demonstrated that effective diabetes management in Indigenous primary care can improve the process and outcomes of care [2–4]. Reported approaches to improving quality of care include use of recall and reminder systems, audit and feedback of clinical performance, structured clinical care, and specialist involvement in primary care. This evidence on the effectiveness of approaches to care in the Indigenous Australian population is consistent with the approach reflected in the Chronic Care Model developed in the USA [5, 6]. The Chronic Care Model is comprised of six major components that have been shown to be important internationally to chronic illness care: 1) health care organisation, 2) community linkages, 3) self-management support, 4) decision support, 5) delivery system design, and 6) clinical information systems. This model has been extensively implemented in community health centres and hospitals in the USA to assess system support for chronic care and to identify areas for further improvement [7].

In the context of Australia's Northern Territory (NT) health service providers' collaborative efforts to improve prevention and management of chronic disease in primary health care [8], the Audit and Best practice for Chronic Disease (ABCD) project was implemented on the expectation that community health centre staff and managers would benefit from an improved understanding of the status of health centre systems in order to appropriately plan for improvement. A central component of the ABCD project was therefore an assessment of health centre systems as outlined in the Chronic Care Model. This paper reports on the association of the systems assessment with the quality of diabetes care for ABCD participating centres at baseline.

Methods

Study design, setting and selection of participating health centres

This cross-sectional study was conducted in the Top End, an area covering one-third of NT. Of 60 Aboriginal communities with a population of 50 or more that are located in this area, 45 have a health centre within the community [9]. The selection of 12 health centres for participation in the study aimed to reflect the range in size, geographic location and governance arrangements existing in Top End communities (Figure 1). Community populations ranged from 180 to 1500. Five community health centres were managed by the NT Department of Health and Community Services, four by Aboriginal Health Boards, and three by Aboriginal Medical Services.

Figure 1
figure 1

Distribution of 12 participating communities in the Top End of the Northern Territory, Australia.

Community members who met all of the following criteria were included in the study: 1) a definite diagnosis of type 2 diabetes according to health centre records; 2) identified as Aboriginal; 3) aged 16 years or older; and 4) lived in the community for 6 months or more during the previous 12 months. A random sample of 30 records was drawn from four of the twelve community health centres where more than 30 eligible people were identified. In the other eight centres the records of all eligible people were included.

Measurement and data collection

System mapping

The Assessment of Chronic Illness Care (ACIC, Version 3.5) scale [10], a practical tool based on the Chronic Care Model [11], was used to evaluate the status of health centre systems to support chronic illness care. A minor adaptation was made to facilitate its use in the local setting. The adapted scale consists of 34 items covering the six components of the Chronic Care Model and an additional domain which denotes the level of integration of the six components: health care organisation (3 items), community linkages (4 items), self-management (4 items), clinical decision support (3 items), clinical delivery system (9 items), clinical information system (6 items), and integration (5 items). Compared with the original ACIC scale, this adapted version included three additional items (cultural competence, pathology management, and pharmacy management) in the clinical delivery system domain, to reflect specific features of interest in NT centres.

A group of health centre staff (manager, doctor, nurse, and/or Aboriginal Health Worker when available) was guided by researchers on how to complete the scale. The answer to each item in the adapted scale requires recording of a score in the range of 0–11. The scale includes a set of prompts (see Additional file 1) to increase standardisation and reproducibility in scoring and staff are requested to provide a qualitative justification for their score in relation to these prompts (see example in Additional file 2). The scores are categorised as: 0–2 (limited support); 3–5 (basic support); 6–8 (good support); and 9–11 (fully developed support). The score and justification for each item were obtained by arriving at a consensus among participating staff members. The mean was calculated from individual item scores to create a component score, and the mean of 6 component and integration scores formed the overall system score for the community health centre. The average time to complete the scale was 2 hours.

Quality of diabetes care

Quality of diabetes care was measured in terms of care processes and intermediate outcomes through auditing of medical records. The audit tool lists 28 services which the clinical guidelines in current use across the NT recommend for delivery at regular intervals for all people with diabetes (Table 1) [12]. A service was assessed as delivered if there was a record of delivery within the appropriate period preceding the audit. The overall adherence to delivery of scheduled services for each patient was calculated by dividing the sum of services delivered by 28 (the total number of scheduled services), and expressing this as a percentage.

Table 1 Adherence to delivery of scheduled services for study participants (N = 295)

Intermediate outcomes of diabetes care include three measures: the values of the most recent HbA1c, blood pressure, and total cholesterol within 12 months prior to the audit. Control of these 3 measures is essential in preventing or delaying the onset of macro- and micro-vascular complications [13].

Statistical analysis

Means and proportions were used to summarise normally distributed continuous and binomial data respectively, and 95% confidence intervals were calculated after adjustment for clustering by heath centre. As the ACIC result represented a score ranking from 0 to 11, nonparametric measures were used to describe ACIC results in terms of median, interquartile range, and range.

Multiple linear regression analysis was used to determine the independent association of each health system component with the overall adherence to delivery of scheduled services, with patient level variables (age and sex) treated as covariates.

The associations between system components and intermediate outcomes of diabetes care were assessed using multivariate probit regression [14]. This statistical procedure allows three dependent variables Y1(HbA1c control), Y2 (blood pressure control) and Y3 (total cholesterol control) to be jointly regressed on the same independent variables (6 system components and participants' age and sex) in one model. The dependent variables are dichotomous and defined as follows: Y1 = 1 if HbA1c level < 8.0%, and Y1 = 0 if HbA1c = 8.0% or no HbA1c tested within the past 12 months; Y2 = 1 if blood pressure < 140/90 mmHg, and Y2 = 0 if blood pressure ≥ 140/90 mmHg or no blood pressure checked within the past 12 months; Y3 = 1 if total cholesterol < 5.5 mmol/L, and Y3 = 0 if total cholesterol ≥ 5.5 mmol/L or no total cholesterol tested within the past 12 months. The associations with a single intermediate outcome, and the three as a group, were separately tested. All analyses were performed using Stata version 8.2 [15].

Ethics approval for the study was obtained from the Top End Health Research Ethics Committee, including the Indigenous sub-committee.

Results

The records of 295 people with diabetes (116 males and 179 females) were included in the study. The average age of participants was 49 years (range 16–87). Diabetes duration averaged 6.5 years. Seventy-seven percent (95%CI: 71%–81%) of participants had attended their community health centres within the previous 3 months.

ACIC scores for community health centre systems

The overall ACIC score ranged from 2.6 to 5.3 with a median of 4.3 (Figure 2). The median ACIC scores for system components ranged from 2.5 (component integration) to 5.4 (clinical information system). Community health centres had distinct areas of strengths and weakness as reflected in the qualitative justification in each system component and summarised below.

Figure 2
figure 2

Assessment of Chronic Illness Care (ACIC) component scores for participating community health centres (N = 12).

Organisational influence

five of twelve health centres included chronic disease care goals in their business plan and had one or more chronic disease coordinators in place. One health centre had an established continuous improvement program. Public health nurse positions, recently developed by the Department of Health and Community Services, were perceived by health service staff as an improvement strategy for chronic illness care. Six health centres reported use of Enhanced Primary Care Medicare claims as incentives for chronic care planning.

Community linkages

All participating health centres reported going out into the community to 'collect' people for specialist visits as a common activity. Some health centres worked together with other organisations and ran community-based programs such as 'school nutrition programs', 'healthy lifestyle promotional days' at the local store, 'healthy kids week', or 'tobacco prevention week'. However, all health service staff reported that acute care demands often prevented the development of community relationships that may have improved chronic care.

Self-management support

There was limited uptake and documentation of self-management activities in health centres, such as goal setting with clients and patient education. One-to-one education was the most commonly mentioned approach for the delivery of patient education. Peer or group education was seldom used.

Clinical decision support

Clinical guidelines (e.g. CARPA standard treatment manual) [12] were universally distributed to centres to facilitate clinical decision-making, and most health centres reported integration of these guidelines into routine care. Involvement of specialists in primary care was mainly through conventional referrals, and visiting specialist services to health centres were perceived generally as not frequent enough to meet needs.

Clinical delivery system

Most health centres suffered from a shortage of staff, and only six communities had a resident doctor. Few centres adopted planned visits for delivering multiple services to clients. All centres reported that systems for collecting and reporting of pathology specimens and for dispensing medication were in place. Most respondents perceived their centres to be delivering culturally safe and appropriate services.

Clinical information systems

Computerised information systems were installed in 11 health centres, with four different clinical information software systems. The remaining centre used a paper-based information system only. Recall systems were operational for eight health centres (6 computerised, 1 paper-based, and 1 with both). Most centres had organised and easily accessible patient records. Most information systems lacked the capacity (or were not used) to supply staff with population-based information on quality of chronic illness care.

Integration of system components

The integration of system components was the least developed area. For example, the existing information system was not integrated with patient self-management in terms of documenting goals and activities; and there was limited sharing of information between out-of-clinic community programs and clinical services.

Quality of diabetes care

Adherence to delivery of scheduled services varied across different categories of services (Table 1). Adherence was relatively higher for immunisation and laboratory investigations, followed by eye checks and basic measurement. Least attention was paid to feet checks and counselling services. The overall adherence to delivery of scheduled services for individuals averaged 31% (range 0–93%).

For intermediate outcomes (Table 2), the most recent value of HbA1c was below 8% for only about a quarter of participants, and most recent value of BP was less than 140/90 for about half of the participants.

Table 2 Intermediate outcomes of diabetes care for study participants (N = 295)

Associations between system ACIC scores and quality of diabetes care

Analysed by the linear regression modelling, each ACIC component was statistically associated with overall adherence to delivery of diabetes services (Table 3). After adjustment for other system components and individual variables, organisational influence, community linkages, and information system were identified as having independent associations with adherence to delivery of diabetes services. For example, an increase of 1 unit in the information system ACIC score was associated with an improvement of 4.5% in overall adherence to delivery of services.

Table 3 Association of health centre system components with overall adherence to delivery of scheduled services§

The likelihood of each of HbA1c, blood pressure, and total cholesterol being below the specified cut point rose significantly with an increase in the organisational influence score (Table 4). Higher delivery system design and information system scores were associated with better blood pressure control and total cholesterol control respectively. Organisational influence, delivery system design and information system scores were also significantly associated with higher combined intermediate outcome scores.

Table 4 Association between scores for health centre system components and measures of intermediate outcomes of diabetes care

Discussion

This study shows that participating Aboriginal community health centres in Australia had implemented basic systems to support chronic illness care, but there was considerable room for improvement in all system components. Stronger organisational influence and information system components were associated both with better performance in process of diabetes care and in intermediate outcomes. Additionally, community linkages were specifically related to better performance in process of care, and delivery system design was associated with better intermediate outcomes.

When compared with data from the USA [16], health centres had similar ACIC scores for community linkages, decision support, delivery system, and clinical information system, but lower scores for organisational influence and self-management support. In many respects the quality of diabetes care in participating health centres is also comparable with national and international data [17–19] For example, 70% of patients in our study had HbA1c tested in the past year and 26% had values less than 8% – almost identical to experience reported from the USA [19].

To our knowledge, this is the first study to demonstrate quantitative evidence regarding the importance of organisational influence (including goals for chronic care, improvement strategies, and incentives for care) on diabetes care. Wagner and colleagues reported their experience in the chronic condition Breakthrough Series, suggesting the removal of disincentives in practice encourages providers' in delivery of effective chronic illness care [7]. Financial incentives for diabetes care have been introduced to Australian general practice through Enhanced Primary Care (EPC) and Practice Incentive Program (PIP) [20, 21]. However, only half of participating centres reported claiming for Medicare rebate using EPC items.

Our study shows better implementation of clinical information systems to be associated with both increased adherence to guideline-recommended processes of diabetes care and improved intermediate outcomes. An ideal information system has three important roles: 1) as a registry for a target population; 2) to provide reminders to primary care teams to comply with guidelines for care; and 3) to provide feedback measures relevant to quality of care [22]. Our data show the third role to be the least-developed area for current information systems in this study setting, and support the appropriateness of external clinical audit as a useful approach to address such system deficiencies [23, 24]

The positive relation between delivery system design and intermediate outcomes of diabetes care is consistent with several previous studies [25, 26] It is likely that health centres characterised by availability of resident doctors, active specialist outreach, and appropriate client follow-up offer more opportunity for intensive management that might contribute to better diabetes control. Given that many remote community health centres are staffed primarily by nurses and Aboriginal Health Workers (AHWs) and supported by visiting doctors [27], a feasible approach to improve delivery system design is to assign and strengthen nurses' and AHWs' roles in delivering routine care, and to ensure referral to medical practitioners for consultation and medication adjustment where appropriate [28]. Features of delivery system design may also be amenable to improving the relative under-utilisation of primary care services by Aboriginal men – a widely recognised phenomenon that is reflected in the study sample.

The apparent poor integration of system components in participating health centres also needs to be addressed in future system development, as isolated upgrading in one component without integrating with another may lead to an increase in costs but not in effectiveness. For example, computerised information systems can generate "pop-up" reminders for healthcare providers, but poor delivery system design characterised by unclear roles among health staff may result in no appropriate action being taken.

The cross-sectional study design limits the confidence with which the observed associations between health centre systems and processes and outcomes of diabetes care can be defined as causal. However, the findings suggest that the Chronic Care Model and the associated ACIC scale will be valuable in assessing and guiding the development of health centre systems in Aboriginal community settings. More research is needed to formally examine the reproducibility of the methods of assessing systems development, and to define the cause-effect relationship between healthcare systems and quality of diabetes care using longitudinal study designs. Such studies may also help clarify resource and management requirements for sustaining improvements in chronic illness care.

Conclusion

The state of development of health centre systems is reflected in quality of care outcome measures for patients. The health centre systems assessment tool proves to be useful in describing the quality of clinical systems for the prevention and management of diabetes in Australian Aboriginal communities, and providing a guide for development of systems for improving diabetes care.

References

  1. National Centre for Monitoring Diabetes: Diabetes: Australian Facts. 2002, Canberra: AIHW

    Google Scholar 

  2. McDermott R, Tulip F, Schmidt B, Sinha A: Sustaining better diabetes care in remote indigenous Australian communities. BMJ. 2003, 327: 428-430. 10.1136/bmj.327.7412.428.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Simmons D: Impact of an integrated approach to diabetes care at the Rumbalara Aboriginal Health Service. Intern Med J. 2003, 33: 581-585. 10.1111/j.1445-5994.2003.00491.x.

    Article  CAS  PubMed  Google Scholar 

  4. Bailie RS, Si D, Robinson GW, Togni SJ, D'Abbs PH: A multifaceted health-service intervention in remote Aboriginal communities: 3-year follow-up of the impact on diabetes care. Med J Aust. 2004, 181: 195-200.

    PubMed  Google Scholar 

  5. Wagner EH: Chronic disease management: what will it take to improve care for chronic illness?. Eff Clin Pract. 1998, 1: 2-4.

    CAS  PubMed  Google Scholar 

  6. Bodenheimer T: Interventions to improve chronic illness care: evaluating their effectiveness. Dis Manag. 2003, 6: 63-71. 10.1089/109350703321908441.

    Article  PubMed  Google Scholar 

  7. Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A: Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001, 20: 64-78. 10.1377/hlthaff.20.6.64.

    Article  CAS  Google Scholar 

  8. Weeramanthri T, Hendy S, Connors C, Ashbridge D, Rae C, Dunn M, Fittock M, Cleary J, O'Donohoe L, Morton S, Swanson N: The Northern Territory preventable chronic disease strategy – promoting an integrated and life course approach to chronic disease in Australia. Aust Health Rev. 2003, 26: 31-42.

    Article  PubMed  Google Scholar 

  9. Hoffmann B, Bailie R: Health-related housing and infrastructure in the Northern Territory Aboriginal Communities: 2001 data. 2003, Darwin: Cooperative Research Centre for Aboriginal and Tropical Health

    Google Scholar 

  10. Improving Chronic Illness Care: Assessment of Chronic Illness Care (version 3.5). [http://www.improvingchroniccare.org/ACIC%20docs/ACIC_V3.5.pdf]

  11. Bonomi AE, Wagner EH, Glasgow RE, VonKorff M: Assessment of chronic illness care (ACIC): a practical tool to measure quality improvement. Health Serv Res. 2002, 37: 791-820. 10.1111/1475-6773.00049.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Central Australian Rural Practitioner Association: CARPA standard treatment manual: a clinic manual for primary health care practitioners in remote and rural communities in Central and Northern Australia. 2003, Alice Springs: Central Australian Rural Practitioner Association, 4

    Google Scholar 

  13. Williams R, Herman W, Kinmonth AL, Wareham NJ: The evidence base for diabetes care. 2002, Chichester: John Wiley & Sons, Ltd

    Book  Google Scholar 

  14. Cappellari L, Jenkins S: Multivariate probit regression using simulated maximum likelihood. Stata Journal. 2003, 3: 278-294.

    Google Scholar 

  15. StataCorp: Stata Statistical Software: release 8.2. 2003, College Station, TX: Stata Corporation

    Google Scholar 

  16. Wagner EH, Glasgow RE, Davis C, Bonomi AE, Provost L, McCulloch D, Carver P, Sixta C: Quality improvement in chronic illness care: a collaborative approach. Jt Comm J Qual Improv. 2001, 27: 63-80.

    CAS  PubMed  Google Scholar 

  17. Georgiou A, Burns J, Wan Q, Flack J, Penn D, Powell DG: Analysis of Division-based diabetes register data (2000–2002). 2005, Sydney: National Divisions Diabetes Program, University of New South Wales, [http://www.commed.unsw.edu.au/cgpis/public/diab/Analysis%20of%20Div%20Based%20Diab%20Reg%20Data.pdf]

    Google Scholar 

  18. Tapp RJ, Zimmet PZ, Harper CA, de Court, Balkau B, McCarty DJ, Taylor HR, Welborn TA, Shaw JE: Diabetes care in an Australian population: frequency of screening examinations for eye and foot complications of diabetes. Diabetes Care. 2004, 27: 688-693.

    Article  PubMed  Google Scholar 

  19. Chin MH, Auerbach SB, Cook S, Harrison JF, Koppert J, Jin L, Thiel F, Karrison TG, Harrand AG, Schaefer CT, Takashima HT, Egbert N, Chiu SC, McNabb WL: Quality of diabetes care in community health centers. Am J Public Health. 2000, 90: 431-434.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Parsons J: Diabetes. Can systems change improve outcomes?. Aust Fam Physician. 2001, 30: 1116.

    CAS  PubMed  Google Scholar 

  21. Harris M, Blakeman T: Enhanced Primary Care items. Their use in diabetes management. Aust Fam Physician. 2001, 30: 1134-1140.

    CAS  PubMed  Google Scholar 

  22. Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness. JAMA. 2002, 288: 1775-1779. 10.1001/jama.288.14.1775.

    Article  PubMed  Google Scholar 

  23. Chaves N, Weeramanthri T, Mak D, Bunn L, Lines D, Morgan S, Girrabul J, Allen O: Diabetes audit can aid practice development in a range of Indigenous health care settings. Aust J Rural Health. 2001, 9: 251-253. 10.1046/j.1440-1584.2001.00397.x.

    Article  CAS  PubMed  Google Scholar 

  24. Fitzsimons B, Wilton L, Lamont T, McCulloch L, Boyce J: The Audit Commission review of diabetes services in England and Wales, 1998–2001. Diabet Med. 2002, 19 (Suppl 4): 73-78. 10.1046/j.1464-5491.19.s4.13.x.

    Article  PubMed  Google Scholar 

  25. Feifer C, Ornstein SM, Nietert PJ, Jenkins RG: System supports for chronic illness care and their relationship to clinical outcomes. Top Health Inf Manage. 2001, 22: 65-72.

    CAS  PubMed  Google Scholar 

  26. Sperl-Hillen JM, Solberg LI, Hroscikoski MC, Crain AL, Engebretson KI, O'Connor PJ: Do all components of the chronic care model contribute equally to quality improvement?. Jt Comm J Qual Saf. 2004, 30: 303-309.

    PubMed  Google Scholar 

  27. Elliott R: Regional statistics, Northern Territory 2004. 2004, Canberra: ABS

    Google Scholar 

  28. McDermott RA, Schmidt BA, Sinha A, Mills P: Improving diabetes care in the primary healthcare setting: a randomised cluster trial in remote Indigenous communities. Med J Aust. 2001, 174: 497-502.

    CAS  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

This project would not have been possible without the support of staff and management of the participating community health centres. We also gratefully acknowledge the advice of members of the project reference group and management committee. This project was supported by a grant from the Australian Health Minister's Advisory Council (AHMAC) through the States and Commonwealth Research Issues Forum (SCRIF), Grant number AHMAC PDR 2001/06, and by a grant from the CRC for Aboriginal Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Damin Si.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

DS participated in developing the study design, performed the statistical analyses, and drafted the manuscript. RB conceived and designed the study, supervised the data collection and analyses, provided a major role in revising the manuscript. CC participated in the study design and assisted in interpretation of findings. MD and AS developed questionnaires and performed the data collection. GR, JC, and TW participated in the development of study design, editing and revising the manuscript. All authors contributed to, have read and approved the final manuscript.

Electronic supplementary material

Additional File 1: Assessment of Chronic Illness Care (ACIC scale) (DOC 328 KB)

12913_2005_155_MOESM2_ESM.doc

Additional File 2: Example: the score and justification for an item in the ACIC scale, which were made by health centre staff consensus (DOC 29 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Si, D., Bailie, R., Connors, C. et al. Assessing health centre systems for guiding improvement in diabetes care. BMC Health Serv Res 5, 56 (2005). https://doi.org/10.1186/1472-6963-5-56

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6963-5-56

Keywords