Open Access Research article

Are family practice trainers and their host practices any better? comparing practice trainers and non-trainers and their practices

Pieter van den Hombergh1, Saskia Schalk-Soekar2, Anneke Kramer3, Ben Bottema3, Stephen Campbell4 and Jozé Braspenning1*

Author Affiliations

1 IQ healthcare (114), Radboud University Nijmegen Medical Centre, PO Box 9101, 6500, HB, Nijmegen, the Netherlands

2 Department of Psychology, Tilburg University, PO Box 90153, 5000, LE, Tilburg, the Netherlands

3 Department of Primary and Community Care (117), Radboud University Nijmegen Medical Centre, PO Box 9101, 6500, HB, Nijmegen, the Netherlands

4 Health Sciences Research Group – Primary Care, University of Manchester, Williamson Building, Oxford Road, Manchester, M13 9, PL, UK

For all author emails, please log on.

BMC Family Practice 2013, 14:23  doi:10.1186/1471-2296-14-23

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2296/14/23


Received:5 June 2012
Accepted:14 February 2013
Published:21 February 2013

© 2013 van den Hombergh et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Family Physician (FP) trainees are expected to be provided with high quality training in well organized practice settings. This study examines differences between FP trainers and non-trainers and their practices to see whether there are differences in trainers and non-trainers and in how their practices are organized and their services are delivered.

Method

203 practices (88 non-training and 115 training) with 512 FPs (335 non-trainers and 177 trainers) were assessed using the “Visit Instrument Practice organization (VIP)” on 369 items (142 FP-level; 227 Practice level). Analyses (ANOVA, ANCOVA) were conducted for each level by calculating differences between FP trainees and non-trainees and their host practices.

Results

Trainers scored higher on all but one of the items, and significantly higher on 47 items, of which 13 remained significant after correcting for covariates. Training practices scored higher on all items and significantly higher on 61 items, of which 23 remained significant after correcting for covariates. Trainers (and training practices) provided more diagnostic and therapeutic services, made better use of team skills and scored higher on practice organization, chronic care services and quality management than non-training practices. Trainers reported more job satisfaction and commitment and less job stress than non-trainers.

Discussion

There are positive differences between FP trainers and non-trainers in both the level and the quality of services provided by their host practices. Training institutions can use this information to promote the advantages of becoming a FP trainer and training practice as well as to improve the quality of training settings for FPs.

Keywords:
Primary care; Family practice; Quality of healthcare; Teaching; Workload

Background

Family physician (FP) trainers and their host practices are expected to be places of excellence in order to provide a predetermined standard of medical education. Some evidence for this hypothesis is already available, which shows differences between FP trainers and non-trainers and their practices, although the data are mainly from the 1990s [1-4]. Three of these studies found FP trainers to be better qualified than non-trainers for some organizational competencies like equipment and delegation [1,3,4]. Many Colleges, such as the College of Family Physicians of Canada or the Royal College of General Practitioners in the UK, have a responsibility in setting the standards for the training, in certification and lifelong education of FPs. Vocational training has become compulsory in the European Union, requiring a high-standard of training and methods to assess the quality of the training [5,6]. FP training institutes are obliged to provide trainees with professional FP trainers working in excellent practice settings [7,8]. We need therefore information on the quality and added value of training practices and FP trainers [9]. Providing excellence in training requires more than the definition of standards for FP trainers and their practices alone [10]. In the Netherlands FP trainers receive instruction and training to become a teacher and clinical supervisor, [8] and training practices are stimulated to participate in a practice accreditation program providing detailed feedback to the FP and the practice (Appendix 1) [11-13]. The feedback offers trainers, training practices, and institutions detailed information that could help to show where improvement in organization is needed [14]. Moreover, it makes explicit what the added value and advantages are of being a trainer for both the training practice and the FP.

The aim of this study was to explore differences in the structure and process measures between FP trainers and non-trainers and their practices, to see whether there is added value in terms of the quality of services provided to patients and in the quality of the practice organization of training practices as a host organization for trainees.

Methods

Setting and design

335 FP non-trainers and 177 FP trainers voluntarily participated in the practice accreditation program in 2006–2007. A practice is denoted as a training practice when at least one FP trainer for postgraduate training is employed in that practice; a training practice can have therefore both FP trainers and non-trainers. There were 88 non-training practices (34.9% single-handed) with a total of 164 FPs, and 115 training practices (16.5% single-handed) with a total of 348 FPs. Sixty-two practices (30.5%) were practices with two FPs (32 non-training and 30 training practices). Seventy-six practices (37.4%) were group practices comprising 1 to 6 FP trainers, and 1 to 8 FP non-trainers. The practices were spread all over the Netherlands. All practices agreed on the use of the data at an aggregated level. Having this kind of informed consent a separate ethical approval is not required under Dutch law.

Instrument and procedure

The Visitation Instrument to assess Practice organization [11] (VIP) was used to collect the data, which contains 369 items; 227 items at the practice level and 142 at the FP level. The VIP-tool includes all items of the international validated European Practice Assessment indicators (EPA) [15]. It uses a combination of questionnaires that are completed by FPs and staff members, patient questionnaires and observational checklists completed by trained independent observers. These trained observers collected and processes the data from the questionnaires and the observation in the practice in a database for analysis. For a full description of the method and the process of data collection we refer to a previous publication [11]. Over the years some items have been changed to adjust the instrument to the permanent changes in GP-care.

The questionnaires focused on infrastructure (premises and equipment, practice management), the team (delegation to staff, cooperation with other care providers, service and organization, administration, workload (hours per week), job stress (scales), information (record keeping, patient information) and quality management (CME, QI), see Table 1 and 2. All items were answered on a ‘yes’ or ‘no’ basis (except for workload and job stress that used Likert scales). We also collected data on FP and the practice characteristics, see Table 3.

Table 1. Differences between FP trainers and non-trainers in organization of care, (FP-level, n=512)

Table 2. Differences between FP training & non-training practices in organization of care (practice level, n=203)

Table 3. Characteristics of family physicians and their practices

Analyses

The differences between FP trainers and non-trainers were calculated for each of the 142 FP-level items with a one-way analysis of variance (ANOVA). Cohen’s d has been used to estimate effect sizes from the quantitative and dimensional measures. Because of the large number of multiple comparisons involved, the effect sizes (Cohen’s d ) were only calculated for the significant differences (p<0.05). Cohen suggested effect sizes in terms of: d=0.2 is small, 0.5 moderate and 0.8 large [16]. When the covariates (gender, age, years of practice experience, weekly hours worked, and number of patients) were significantly different for the two groups, an analysis of covariance was used (ANCOVA). We considered the significant differences between the two groups only for those items for which an effect size was calculated. We will present effect sizes only for those items that differed significantly (p<0.05) after the covariate analysis. The differences between the 227 practice level items for training and non-training practices were analyzed in the same way. The covariates to be corrected for were: type of practice (single handed, two FPs, more than two FPs, health care centre), practice location (next to FP’s house or not), urbanization level (small village, medium to large town, medium size city, or large city), number of patients, weekly hours worked (fte) per 1,000 patients for the nurse, weekly hours worked (fte) per 1,000 patients for management support, and the number of years the FP has worked in the current practice.

Results

The characteristics of the participating FPs and practices are shown in Table 3. FP trainers were more often male, older, had more experience as a FP, worked longer hours, and had more patients. FP training practices were more often suburban practices with more partners, more patients, more assistance and more management support. The 177 FP trainers scored higher on all except one (UV-lamp for eye diagnostics) of the 142 FP-level items and significantly higher on 47 of the 142 items (Table 1). Training practices scored higher on all 227 practice level items and significantly higher on 61 of the 227 items (Table 2). Most of the differences were found in ‘medical equipment’. The differences between FP trainers and non-trainers that were significant after correction for covariates are described below in more detail for FP and practice level respectively.

FP level

After correction for covariates, FP trainers reported carrying out diagnostic activities more often than non-trainers; such as audiometry, Doppler for detecting peripheral arterial obstruction, EKG, spirometry, Sims Hühner test for infertility and eye-diagnostics (using a stenopeic aperture, 0.5 D lenses for testing refraction testing, UV-penlight, fundoscopy) and lab (KOH microscopic examination of fluor vaginalis and fungi) ( Table 1). They also reported carrying out more therapeutic activities, such as minor surgery, etching epistaxis, use of the hyfrecator, applying pessaries and treatment of chalazion (Table 1). FP trainers spent more time directly with their patients in the surgery and on the telephone and experienced more pleasure and commitment, more job satisfaction and less job stress than non-trainers. FP trainers also reported more quality improvement activities, such as the video-recording of consultations.

Practice level

After correction for covariates, training practices offered a significantly wider range of diagnostic and therapeutic services than non-training practices, such as audiometry, hyfrecator, spirometry, EKG, Doppler and lab service (ESR, urine sediment & culture, Haemoglobin). Diagnostic tasks were more often delegated to the practice nurse, such as spirometry and EKG as well as therapeutic tasks like Nitrogen application, compression therapy for leg ulcer, removal sutures, and wound gluing and taping sprains. Training practices also scored higher on disease management for Diabetes and CVD (Table 2). The quality system of training practices was also well developed, as there was a procedure for calibration and maintenance of equipment as well as Dutch College of GPs approved patient information, annual reports, appraisal of staff, and policy for CME of staff and other protocols for lab and treatment room. Overall, FP trainers and their practices were better organized and offer more services than non-trainers and non-training practices, although the differences are small (effect sizes are between .19 and .53 after correcting for the covariates, except for the item “ (video) recording consultation” d = 1.57). The differences at the practice level are somewhat larger than the FP level before and after correcting for covariates.

Discussion

Our findings show that FP trainers offer more services and work in better organized practices than non-trainers, but the differences were small for FP trainers and small-moderate for training practices. FP trainers reported providing a wider range of services, including chronic care management, delegating more tasks and having better quality management. FP trainers enjoyed their job more, had more commitment, more job satisfaction and less job stress than their non-trainer counterparts, in spite of having more patients listed at their practice and providing a wider range of services. Overall, our findings provide evidence of the benefits and improved outcomes of FP trainers and training practices. The benchmarks set by the FP-trainers and training practices reported here could be used as the basis for Continuous Quality Improvement in the profession within both training and non-training practices.

Explanation and comparison with other studies

The results of our study are in line with the few previous studies on some of the differences between FPs and practices in training and non-training settings [1-4]. It confirms that FP trainers and their practices are better equipped, offer more services and more quality assurance than non-trainers and their practices, and they offer more chronic disease programs and prevention. However, ours is the first study to examine such differences in detail and across so many items of service delivery/quality of care. Moreover, our findings show that FP trainers report experiencing less job stress than non-trainers, even though they report having more listed patients to whom they offer more services (than non-trainers). A possible explanation is that FPs with less job stress are more interested in becoming a trainer or that being a trainer has a stimulating and positive effect on morale and work satisfaction. It is quite likely that the presence of a trainee, while necessitating training related activities, relieves the trainers of some of their workload.

Implications for education, policy and research

Professionally each FP and even more so each trainer needs to be informed about the quality of care of their practice. Having multiple sources of information helps facilitate comprehensive assessment, and a valid and acceptable accreditation visit method, as used in the Dutch national accreditation program, helps to provide reliable information, follow up over time and background data for all sorts of research. The FP training institutes in the Netherlands are now asking all training practices to participate in the accreditation program and variation between FP trainers on patient experiences and clinical performance can be studied using such data. It also fits into the concern of the FP training institutes to warrant that trainees get the necessary diagnostic and therapeutic skills and see the right patient mix. Giving trainers feedback on the gap in what can be learned in their practice compared to other training practices would benefit the quality of the training [17]. However, FP trainers and training practices also need to look beyond accreditation to provide a high-standard of training and use additional methods to assess the quality of the training and its impact [13,14]. More comparisons between training and non training practices and between FP trainers and non-trainers need to be made across a spectrum of other quality assessments such as pay-for-performance [18] or patient evaluations [19,20] or continuous professional development.

Limitations

The sample included and compared FPs and practices that were all equally motivated to participate in the Dutch practice accreditation program, reducing possible bias in comparing the two groups. The analyses included a large number of variables and almost half of the differences found were significant and a third of those remained significant after correction for covariates. However, the results show comprehensively that FP trainers and their practices are better organized than non-trainers and their practices. Another limitation of the study was that we only looked at structure and processes, clinical patient outcomes were not included. We hope to present these results, when data on the treatment of chronic diseases become are available from the Dutch FP accreditation program.

Conclusion and future directions

Our findings show that FP trainers and their host practices offer a wider range of services with more teamwork, more quality management, and the trainers report experiencing less job stress than non-trainer FPs. Moreover, hosting a FP trainer in a practice may have positive spin offs on and for other colleagues. All this may encourage more individual FPs and their host practice to become trainer and training practice respectively, as our study confirms that there are intrinsic benefits to FPs and practices to training status. However, for training and non-training settings alike, multiple quality assessments within continuous quality systems such as ongoing accreditation, provide detailed feedback on practice organization and care and highlights quality deficits that need to be addressed. There is a need for multiple sources of data showing variation between FPs and practices that offers an extra opportunity for quality improvement for those undertaking the training of FP trainees.

Appendix 1. The Dutch FP accreditation program

Since 2005, FPs had the opportunity to voluntarily participate in the Dutch FP accreditation program. They receive information about the accreditation program including a questionnaire on expectations. Preparing for the first visit may take about one year.FPs gather data about their practice management and patient care followed by a pre-audit of a trained observer. Comparison with benchmarks of other FPs and practices helps to identify substandard performance stimulating FPs to make improvement plans.The first audit is carried out after delivering these plans to confirm adequate participation and to grant accreditation. It is the start of a three-year accreditation program and an assessor does the follow-up of the plans. The prolongation of the accreditation depends on having met the objectives of the improvement plans.The measurement in the accreditation program uses previously validated instruments such as VIP [11] , clinical performance [12] , and Europep [13]. The measures have been based on questionnaires for FPs and practice nurses, on structured observation by trained observers and on patient questionnaires as well as on patient data from electronic medical records.

Competing interests

The authors declare that they have no competing interests.

Authors' contribution

PvdH, SS-S, the main investigators analyzed the questionnaires and drafted this manuscript. JB, the project leader, was involved in all aspects of the study. AK, BB and SC participated in discussions about the reporting. All authors read and approved the final version of the manuscript.

Acknowledgements

This study was supported by SBOH, the employer of GP trainers in the Netherlands.

References

  1. Baker R: Comparison of standards in training and non-training practices.

    J R Coll Gen Pract 1985, 35:330-2. PubMed Abstract | PubMed Central Full Text OpenURL

  2. Bates CM, Agass M, Tulloch AJ: General practice workload during normal working hours in training and non-training practices.

    Br J Gen Pract 1993, 43:413-6. PubMed Abstract | PubMed Central Full Text OpenURL

  3. Baker R, Thompson J: Innovation in general practice: is the gap between training and non-training practices getting wider?

    Br J Gen Pract 1995, 45:297-300. PubMed Abstract | PubMed Central Full Text OpenURL

  4. Elwyn G, Rhydderch M, Edwards A, Hutchings H, Marshall M, Myres P, Grol R: Assessing organisational development in primary medical care using a group based assessment: the Maturity MatrixTM.

    Qual Saf Health Care 2004, 13:287-94. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  5. Godlee F: European countries need to work together.

    BMJ 2010, 341:c5395. Publisher Full Text OpenURL

  6. Sandars J: Continuing medical education across Europe.

    BMJ 2010, 341:c5214. PubMed Abstract | Publisher Full Text OpenURL

  7. Prideax D, Alexander H, Bower A, Dacre J, Hasit S, Jolly B, Norcini J, Roberts T, Rothman A, Rowe R, Tallet S: Clinical teaching: maintaining an educational role for doctors in the new health care environment.

    Med Educ 2000, 34:820-6. PubMed Abstract | Publisher Full Text OpenURL

  8. Boendermaker PM, Conradi MH, Schuling J, Meyboom-de Jong B, Zwierstra RP, Metz JC: Core characteristics of the competent general practice trainer, a Delphi study.

    Adv Health Sci Educ Theory Pract 2003, 8(2):111-6. PubMed Abstract | Publisher Full Text OpenURL

  9. Kramer AW, Zuithoff P, Jansen JJ, Tan LH, Grol RP, van der Vleuten C: Growth of self-perceived clinical competence in postgraduate training for general practice and its relation to potentially influencing factors.

    Adv Health Sci Educ Theory Pract 2007, 12(2):135-145. PubMed Abstract | Publisher Full Text OpenURL

  10. World Federation for Medical Education. Postgraduate Medical Education WFME Global Standards for Quality Improvement. WFME, Denmark

    2003.

  11. van den Hombergh P, Grol R, Van den Bosch WJHM, van den Hoogen HJM: Assessment of management in General Practice: Validation of a practice visit method.

    Br J Gen Pract 1998, 48:1743-50. PubMed Abstract | PubMed Central Full Text OpenURL

  12. Van Doorn A, Kirschner K, Bouma M, Burgers J, Braspenning J, Grol R: Evaluation of clinical performance measurement in Dutch accreditation program for general practice (in Dutch).

    Huisarts Wet 2010, 53(3):141-6. OpenURL

  13. Wensing M, Mainz J, Grol R: A standardised instrument for patient evaluations of general practice care in Europe.

    Eur J Gen Pract 2000, 6:82-7. Publisher Full Text OpenURL

  14. Overeem K, Faber M, Arah OA, Elwyn G, Lombarts KM, Wollersheim HC, Grol RP: Doctor performance assessment in daily practice: does it help doctors or not? A systematic review.

    Med Educ 2007, 41:1039-49. PubMed Abstract | Publisher Full Text OpenURL

  15. Engels Y, Campbell S, Dautzenberg M, van den Hombergh P, Brinkmann H, Szécsényi J, Falcoff H, Seuntjens L, Kuenzi B, Grol R: Developing a framework of, and quality indicators for, general practice management in Europe.

    Fam Pract 2005, 22:215-22. PubMed Abstract | Publisher Full Text OpenURL

  16. Cohen J: Statistical Power Analysis for the Behavioral Sciences. 2nd edition. Lawrence Erlbaum, Hillsdale NJ; 1988. OpenURL

  17. de Jong J, Visser MRM, Mohrs J, Wieringa-de Waard M: Opening the black box: the patient mix of GP trainees.

    Br J Gen Pract 2011, 61(591):e650-e657. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  18. Doran T, Fullwood C, Gravelle H, Reeves D, Kontopantelis E, Hiroeh U, Roland M: Pay-for -Performance programs in family practices in the UK.

    N Engl J Med 2006, 27:375-84. OpenURL

  19. Vingerhoets E, Wensing M, Grol R: Feedback of patients’ evaluations of general practice care: a randomised trial.

    Qual Health Care 2001, 10:224-8. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  20. Petek D, Künzi B, Kersnik J, Szecsenyi J, Wensing M: Patients' evaluations of European general practice–revisited after 11 years.

    Int J Qual Health Care 2011, 23(6):621-8. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2296/14/23/prepub