Research article

A systematic evaluation of payback of publicly funded health and health services research in Hong Kong

Patrick Kwan^1,2 , Janice Johnston^1,3 , Anne YK Fung¹ , Doris SY Chong¹ , Richard A Collins¹ and Su V Lo¹

¹  Research Office, Health, Welfare and Food Bureau, Government of the Hong Kong Special Administrative Region, Hong Kong, China

²  Department of Medicine & Therapeutics, The Chinese University of Hong Kong, Prince of Wales Hospital, Hong Kong, China

³  Department of Community Medicine, School of Public Health, The University of Hong Kong, Hong Kong, China

author email corresponding author email

BMC Health Services Research 2007, 7:121doi:10.1186/1472-6963-7-121

Published:	30 July 2007

Abstract

Background

The Health and Health Services Research Fund (HHSRF) is dedicated to support research related to all aspects of health and health services in Hong Kong. We evaluated the fund's outcomes and explored factors associated with the translation of research findings to changes in health policy and provider behaviour.

Methods

A locally suitable questionnaire was developed based on the "payback" evaluation framework and was sent to principal investigators of the completed research projects supported by the fund since 1993. Research "payback" in six outcome areas was surveyed, namely knowledge production, use of research in the research system, use of research project findings in health system policy/decision making, application of the research findings through changed behaviour, factors influencing the utilization of research, and health/health service/economic benefits.

Results

Principal investigators of 178 of 205 (87%) completed research projects returned the questionnaire. Investigators reported research publications in 86.5% (mean = 5.4 publications per project), career advancement 34.3%, acquisition of higher qualifications 38.2%, use of results in policy making 35.4%, changed behaviour in light of findings 49.4%, evidence of health service benefit 42.1% and generated subsequent research in 44.9% of the projects. Payback outcomes were positively associated with the amount of funding awarded. Multivariate analysis found participation of investigators in policy committees and liaison with potential users were significantly associated with reported health service benefit (odds ratio [OR]_{participation} = 2.86, 95% confidence interval [CI] 1.28–6.40; OR_liaison = 2.03, 95% CI 1.05–3.91), policy and decision-making (OR_{participation} = 10.53, 95% CI 4.13–26.81; OR_liaison = 2.52, 95% CI 1.20–5.28), and change in behavior (OR_{participation} = 3.67, 95% CI 1.53–8.81).

Conclusion

The HHSRF has produced substantial outcomes and compared favourably with similar health research funds in other developed economies. Further studies are needed to better understand the factors and pathways associated with the translation of research findings into practice.