Older people usually prefer staying at home rather than going into residential care. The Belgian National Institute for Health and Disability Insurance wishes to invest in home care by financing innovative projects that effectively help older people to stay at home longer. In this study protocol we describe the evaluation of 34 home care projects. These projects are clustered according to the type of their main intervention such as case management, night care, occupational therapy at home and psychological/psychosocial support. The main goal of this study is to identify which types of projects have the most effect in delaying institutionalization of frail older persons.
This is a longitudinal intervention study based on a quasi-experimental design. Researchers use three comparison strategies to evaluate intervention - comparison among different types of projects, comparisons between older persons in the projects and older persons not benefiting from a project but who are still at home and between older persons in the projects and older persons who are already institutionalized. Projects are asked to include clients who are frail and at risk of institutionalization. In the study we use internationally validated instruments such as the interRAI Home Care instrument, the WHO-QOL-8 and the Zarit Burden Interview-12. These instruments are filled out at baseline, at exit from the project and 6 months after baseline. Additionally, caregivers have to do a follow-up every 6 months until exit from the project. Criteria to exit the cohort will be institutionalization longer than 3 months and death. The main analysis in the study consists of the calculation of incidence rates, cumulative incidence rates and hazard rates of definitive institutionalization through survival analyses for each type of project.
This research will provide knowledge on the functional status of frail older persons who are still living at home. This is important information to identify determinants of risk for institutionalization. The identification of effective home care projects in delaying institutionalization will be useful to inform and empower home care providers, policy and related decision makers to manage and improve home care services.
Keywords:Innovative home care; Project evaluation; Frail older persons; Delay of institutionalization
Older people usually prefer staying at home rather than going into residential care [1-3]. Several organizations and professionals provide care for older people at home. In 1994, the World Health Organization defined home care as “an array of health and social support services provided to clients in their own residence. The assumption is that these co-ordinated services may prevent, delay or be a substitute for temporary or long-term institutional care” . A more recent definition of home care defines it as “a phenomenon in which care is provided by professionals to people in their own homes with the ultimate goal of not only contributing to their life quality and functional health status, but also to replace hospital care with care in the home for societal reasons”. In this definition, home care covers a wide range of activities, from preventive visits to end-of-life care . According to the 2009 WHO-report, an appropriate balance between care settings for elderly care is necessary, including supported self-care and home-based service. The report emphasizes the need for interventions to help maintain older people at home and to prevent long-term institutional care .
In the literature, several studies about predictors for home care use can be found. The most predominant ones are age, living arrangement, number of informal caregivers, income, medical diagnosis and functional status [1,7]. Moreover, randomized controlled trials have shown that targeted home care can contribute significantly to reduce hospital admission, to delay institutionalization and to improve quality of life [8-10].
In Belgium, 125.000 older people received home care services in 2010 and by 2025 this number will have increased up to 149.000, according to population prognoses . The Belgian National Institute for Health and Disability Insurance (NIHDI)a wishes to invest in home care by financing innovative projects that effectively help older people to stay at home longer. In this study, the effects of these innovative projects are examined as to whether they do keep frail older people longer at home, whether they maintain or improve their quality of life and whether they preserve their autonomy [12-15].
Data from 34 innovative projects will be analyzed. Due to the fact that the projects vary in the scope of the intervention they provide, projects are clustered according to the type of their main intervention such as case management, night care, occupational therapy at home and psychological/psychosocial support. These projects might not be considered to be innovative in other countries. The term ‘innovative’ in the context of this research is defined as interventions which are not yet reimbursed by the Belgian NIHDI. These interventions can be seen as alternatives or add-ons to the standard home care services which are already funded (respite care, nursing care at home, physiotherapy, etc.).
The main goal of this study is to identify which types of projects have the most effect in delaying institutionalization of frail older persons.
This is a longitudinal intervention study based on a quasi-experimental design . Due to some constraints, a randomized controlled trial is impossible to realize. The constraints are mostly practical and ethical since all frail older people who wish to benefit from an innovative project cannot be denied access to it. In addition, researchers cannot have total control on the intervention since projects are delivering the services in the ‘real world’. Projects may organize their intervention according to specific types of services. Non randomization and variety of projects impose a thorough description and follow up of beneficiary population and intervention content. The Researchers use three comparison strategies to evaluate intervention – comparison of the arm benefiting from the intervention with older people benefitting from a different type of project, older people who are not benefiting from a project and are still living at home and older people who are already institutionalized.
Typology of projects
Projects are clustered according to the type of intervention they perform (see Table 1). The typology definition is based on a previous study on the expressed intention and the perspective of actors involved in the project implementation .
Table 1. Typology of the projects according to main intervention
Sample size considerations
Beneficiaries will be grouped by type of projects as shown in Table 1 in order to get a reasonable sample size for each side of the comparison. Using an effect size of 0.50, a two-sided significance level of 0.05 and a power of 85%, 75 participants are needed in each group. We expect each project to include at least 45 participants per year because this is the minimum size of case load projects reported at the beginning of their activities. The clusters of projects will have then a larger sample size than indicated by the sample size calculation.
The study will include older people receiving home care services who are at least 65 years old. Projects are asked to include only clients who are frail and at risk of institutionalization. Due to practical reasons, frailty is measured in the study with two different scales and caregivers are allowed to choose between them. One of these scales is the Edmonton Frail Scale [17,18] with a cutoff point of 6. Another scale is an adapted version of the Katz scale for Belgian home care and residential care . Older people with a Katz score equal to A, B or C will be included . Clients who have been diagnosed with dementia by a geriatrician, neurologist or psychiatrist may also be included in the study.
Each project has to collect data on at least 75% of their total client population in order to ensure representativeness. This means that caregivers have to complete questionnaires for at least 75% of clients benefiting from their projects.
Ethical approval and informed consent
This observational study was approved by the Belgian Privacy Commission and by the Ethics committee of the Belgian Universities - Université Catholique de Louvain and Katholieke Universiteit Leuven with dossier number B40320108337. A formal procedure was implemented so that caregivers could fill out the questionnaires on a secured website.
For this study, older persons are asked to sign an informed consent agreement. In case they are not capable of signing this document, a family member or another legal representative will sign it on their behalf, as stipulated by Belgian law . Clients do not undergo the intervention because of the research. The research however evaluates the effects of the intervention. Clients have the right not to participate in the research and they may withdraw their consent at any time. In that case, all data for this person is removed. Their consent or refusal to consent does not affect their participation in the intervention.
All data are anonymized and analyzed according to the rules of the Belgian Privacy Commission .
The aim of the study is to answer the following research questions:
1. Do characteristics of populations differ between projects?
2. Which types of projects are associated with less decrease of the functional and cognitive performance of frail older persons?
3. Which types of projects contribute to a better quality of life of frail older persons?
4. Which types of projects are associated with a decreased risk of institutionalization of frail older persons?
5. Is the interRAI Maple scale a good predictor of institutionalization in our study?
Selection of Variables
A previous systematic review identified the variables most frequently used in the evaluation of interventions aiming at maintaining frail older persons at home . In our study, variables from the interRAI Home Care instrument which correspond to these identified variables will be used in the evaluation of interventions .
For data without any correspondence with the InterRAI instruments, other tools have been selected by a consensus amongst experts and according to their international validity. These complementary tools are the WHOQoL-8 and Zarit Burden scale (12-item) [24-26].
interRAI HC instrument
The interRAI HC instrument is an internationally validated instrument consisting of several domains such as cognitive functioning, ADL, social and psychological wellbeing, health status, environmental characteristics, etc. The use of a comprehensive geriatric assessment such as the interRAI HC is essential for this study in order to have an in-depth view of the client’s health and functional status [27-29]. The follow up of these characteristics will give insight in the evolution of the client’s situation and will enable researchers to show the effect of innovation projects. In the study we use the validated Belgian version of this instrument named BelRAI HC.
The WHO defines Quality of Life as “individuals’ perception of their position in life in the context of the culture and value systems in which they live and in relation to their goals, expectations, standards and concerns” (24). The WHO-QOL-8 scale measures the perceived overall quality of life of the clients. It is derived from the WHO-QOL-Bref and contains each of the domains: physical and psychological health, social relations and environment [30,31]. It is currently used as an instrument in the WHO’s SAGE Survey . This scale was designed for use where researchers need a short and concise instrument to measure quality of life. It is a self report instrument, so it has to be filled out by the clients themselves.
Zarit Burden Interview 12 (ZBI-12)
In the international literature caregiver burden is perceived as a multidimensional response to stressors associated with care giving. These stressors may be physical, psychological, emotional, social and financial [33-35]. In this research we use a shorter version of the original 22-item scale Zarit Burden Interview. This scale contains 12 items with a score from 0 to 4. The total score can vary from 0 to 48 and the higher the total score, the higher the caregiver burden. The short form was chosen, in order not to put a heavier weight on the burden of the caregiver and to increase the response rate.
Professional caregivers are asked to fill out the interRAI Home Care instrument. Clients fill out the WHO-QOL-8 and the main informal caregivers complete the ZBI-12. These questionnaires are filled out at inclusion of the frail older person in the project (baseline), at exit from the project and 6 months after baseline. Additionally, if clients stay longer than 6 months in the project, caregivers have to do a follow-up every 6 months until the moment clients leave the project. Follow-up of clients happens from March 2011 until July 2013. A client follow-up period will vary between 6 to 36 months. Criteria to exit the cohort will be institutionalization longer than 3 months and death. Follow up will also end for clients who leave the projects.
Professional caregivers are instructed on how to fill out the questionnaires during a 2-day training and a follow up training of 1 day. They fill out the interRAI HC based on observation and on interview of the older person and of the main informal caregiver.
The interRAI-data will be linked with data from the national database IMA (Inter-mutuality Agency). This database contains data on national health service consumption reimbursed by NIHDI such as medication use, hospital days, medical, nursing and physical therapy use, etc. This data will be added to the analysis for the clients in the projects.
The “permanent sample” of people over 65 extracted from IMA database will also serve as a control group for our study population. By using this database we will be able to compare older persons who are benefiting from the innovative projects with older persons who are not benefiting from these projects (control group). In this control group we will have two major groups – clients who are still living at home and clients who are institutionalized. All clients who are in the projects and have not given their informed consent will be excluded from this database.
– Research question 1 - Do characteristics of populations differ across projects?
In order to answer this first research question comparisons will be made between the populations in the different types of projects to explore whether they present particular characteristics. In these comparisons we will use the variables shown in Table 2 Frequencies will be calculated for categorical variables and means and medians with confidence intervals for continuous variables. Other possible comparison will be done by analysis of variance. All the statistical analysis in the study will be performed with the software Stata 11.1.
– Research question 2 - Which types of projects are associated with less decline of the functional and cognitive performance of frail older persons?
– Research question 3 - Which types of projects contribute to a better quality of life of frail older persons?
Table 2. Variables to characterize the population of the study
Longitudinal analyses will be performed to answer the second and third research questions. Outcome variables will be the interRAI ADL hierarchy scale, the interRAI CPS2 scale and the WHOQOL scale. Mean will be compared between arms of the study and covariate analysis (ANCOVA) will be done to control results for potentially confounding variables.
The ADL hierarchy scale is a measure of a person’s functional performance. It is based on the concept of early, middle and late loss of ADLs and consists of 4 items from the interRAI instruments: personal hygiene, toilet use, locomotion and eating. The scores vary from 0 to 6 and the higher the score, the greater the dependency [36,37].
The cognitive performance scale (CPS2) is an internationally validated scale that describes a person’s cognitive status. The scores vary from 0 to 6 and the scale consists of 5 items from the interRAI HC instrument: skills for daily decision-making, making oneself understood, short-term memory recall, procedural memory and eating impairment. Higher scores indicate a greater degree of cognitive impairment. Several studies have shown a significant correlation between the CPS scale and the Mini-Mental State Examination (MMSE) [38-41].
– Research question 4 - Which types of projects are associated with a decreased risk of institutionalization of frail older persons?
In order to answer the fourth research question, the definitive institutionalization (more than 90 consecutive days in residential care) will be used as event. The analysis consists of the calculation of incidence rates, cumulative incidence and hazard rates of definitive institutionalization through survival analyses for each type of project. Survival analysis measures the time to a certain event or change of state, in this case, institutionalization. The multivariate Cox model which will be calculated from this analysis will allow us to isolate the effects of the intervention from the effects of confounding variables. These variables are extraneous variables which correlate (positively or negatively) with both the dependent variable and the independent variable. In this analysis we will use the variables of Table 2 as confounding variables. The use of a Cox model may improve the estimate of the intervention effect by narrowing the confidence interval. Another important advantage of this analysis is that it takes into account the variability of covariates across time which makes it very appropriate for longitudinal studies [42-44].
– Research question 5 - Is the interRAI Maple scale a good predictor of institutionalization in our study?
The fifth research question will be approached by using a multiple logistic regression model with the Methods for Assigning Priority Levels scale (Maple) as one of the independent variables. This interRAI scale is known to be a predictor for institutionalization and can be used as an indicator for allocation of home care resources and prioritization of clients needing community or residential care. MAPLe is an internationally validated predictor of nursing home placements, caregiver distress and ratings that the client would be better off elsewhere .
This paper describes the study protocol of a longitudinal quasi-experimental research to evaluate the effect of innovative projects in delaying institutionalization of frail older persons.
A major strength of the study is the follow up period of 3 years, which allows researchers to obtain a large sample size and several measurement points for a number of clients. Most clients will have at least 3 measurements. Another major strength is the availability of the national database IMA to enable researchers to have a large control group and to have data on health services and medication consumption of the study population. In addition, the use of international validated instruments such as the ZB-12 item, the WHOQOL 8 and the interRAI HC will also make further cross-national comparisons possible.
Some limitations of the study are due to the lack of randomization in the allocation between projects and due to the fact that not all variables collected in the population of the projects will be found in the control group of older persons not benefiting from the projects.
The research will provide knowledge on the functional situation of frail older persons who are still living at home and will allow researchers to make comparisons with older persons who are already institutionalized. This is important information to identify determinants of risk for institutionalization. The identification of effective projects in delaying institutionalization will be useful to inform and empower home care providers, policy and related decision makers to manage and improve home care services.
aThe NIHDI is a Belgian federal institution which manages and supervises the correct application of the health insurance in Belgium.
WHO: World Health Organization; NIHDI: National Institute for Health and Disability Insurance; WHO-QOL-8: World Health Organization Quality of Life instrument 8; ZBI 12: Zarit Burden Interview - 12 items; interRAI HC: interRAI Home Care instrument; IMA: Inter-Mutuality Agency; ADL: Activities of Daily Living; CPS2: InterRAI Cognitive Performance scale 2; IADL: Instrumental Activities of Daily Living; MMSE: Mini-Mental State Examination; sDRS: interRAI Depression Rating Scale.
The authors declare that they have no competing interests.
dAMJ, VDT, MJ and DA are involved in the study design and critically reviewed and approved the final manuscript. dAMJ drafted the manuscript. All authors read and approved the final manuscript.
The study is being funded by the Belgian National Institute for Health and Disability Insurance (NIHDI). Funding of the research is external and non-commercial. The NIHDI is a federal institution that organizes, manages and supervises the correct application of the health compulsory insurance in Belgium. This institution is supervised by the Belgian Ministry of Social affairs.
We would like to thank all researchers from the Consortium Protocol 3 who work on the database and on the analysis of implementation of projects. We would like to thank Jean-Christophe Chiem for his extensive work on the raw data. Special thanks to Dirk Vanneste and Pyxima for the work on the technical part of Protocol 3 and BelRAI website and on the testing and implementation of the output algorithms. Their work enabled caregivers to fill out the questionnaires online and empowered the calculation of outcome measures.
J Aging Health 1999, 11(Supplem 3):445-468.
Aug.PubMed Abstract | Publisher Full Text
Rechel B, Doyle Y, Grundy E, McKee M: How can health systems respond to population ageing?. WHO Regional Office for Europe on behalf of the European Observatory on Health Systems and Policies: Copenhagen; 2009.
(Health Systems and Policy Analysis Brief No. 10).
Top of Form 1.
Br Med J 1984, 289:1522-1524. Publisher Full Text
Br Med J 1998, 316:1348-1351. Publisher Full Text
Van den Bosch K, Willemé P, Geerts J, Breda J, Peeters S, Van De Sande S, Vrijens F, Van de Voorde C, Stordeur S: Toekomstige behoefte aan residentiële ouderenzorg in België: Projecties 2011–2025. Brussel: Federaal Kenniscentrum voor de Gezondheidszorg (KCE): Health Services Research (HSR); 2011.
KCE Reports 167A./2011/10.273/63.
IRSS - Université catholique de Louvain, LUCAS - Katholieke Universiteit Leuven, Université de Liège, PICA - Universiteit Antwerpen: Protocol for the scientific evaluation of alternative projects of care and support of care for frail elderly (adaptation of the initial protocol). Belgium: National Institute of Health Disability Insurance; 2011:99.
Conférence interministérielle: Avenant n°3 au Protocole d'accord n°3 du 13 June 2005, conclu entre l'Autorité fédérale et les Autorités visées aux articles 128, 130, 135 et 138 de la Constitution, concernant la politique de santé à mener à l'égard des personnes âgées et qui concerne les formes alternatives de soins et de soutien aux soins. Moniteur Belge: Services Public Fédéral Santé Publique, Sécurité de la Chaine Alimentaire et Environnement; 2008:41009-41018.
unpublished.PubMed Abstract | Publisher Full Text
K.B. 2-7-2009: tot vaststelling van de voorwaarden waaronder het Verzekeringscomité met toepassing van artikel 56, par. 2, eerste lid, 3°, van de wet betreffende de verplichte verzekering voor geneeskundige verzorging en uitkeringen, gecoördineerd op 14 juli 1994, overeenkomsten kan sluiten voor de financiering van alternatieve en ondersteunende zorg voor kwetsbare ouderen, unpublished.
Protocol 3 consortium of researchers; Implementation Analysis - Intermediate Report. 2011.
Belgische Burgerlijk Wetboek - Art.487-488.
Beraadslaging nr. 10/028 van 20 April 2010 met betrekking tot de verwerking van persoonsgegevens die de gezondheid betreffen voor de evaluatie van projecten in het kader van het Protocolakkoord nr. 3.
Psychol Med 1998, 28:551-558. PubMed Abstract
Gerontologist 2001, 41(Supplem 5):652-657.
J Am Geriatr Soc 1999, 47:1430-1434. PubMed Abstract
Bernabei R, Landi F, Gambassi G, Sgadari A, Zuccala G, Mor V, Rubenstein L, Carbonin PU: Randomized trial of impact of model of integrated care and case management for older people living in the community.
BMJ 1998, 316(7141):1348-1351.
Clinical Research Ed.PubMed Abstract | Publisher Full Text | PubMed Central Full Text
SAGE Survey Programme. 2010.
Available from: http://www.who.int/healthinfo/systems/sage/en/index1.html webcite.
J Adv Nurs 2007, 2007(58):446-457. Publisher Full Text
Can J Aging 2000, 19(2):87-105. Publisher Full Text
J Gerontol 1994, 49:4.
Journal of Gerontology: Medical Sciences 1995, 50A(2):M128-M133. Publisher Full Text
J Am Geriatr Soc 1996, 44(3):305-309. PubMed Abstract
J Am Geriatr Soc 2000, 48:1601-1606. PubMed Abstract
An R and S-PLUS companion to applied regression 2002., 2002:
The pre-publication history for this paper can be accessed here: