<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>1471-2296-3-15</ui>
   <ji>1471-2296</ji>
   <fm>
      <dochead>Research article</dochead>
      <bibl>
         <title>
            <p>Increasing the satisfaction of general practitioners with continuing medical education programs: A method for quality improvement through increasing teacher-learner interaction</p>
         </title>
         <aug>
            <au id="A1">
               <snm>Gercenshtein</snm>
               <fnm>Leonid</fnm>
               <insr iid="I3"/>
               <email>leonidw@zahav.net.il</email>
            </au>
            <au id="A2" ca="yes">
               <snm>Fogelman</snm>
               <fnm>Yacov</fnm>
               <insr iid="I1"/>
               <insr iid="I2"/>
               <email>fogelman@netvision.net.il</email>
            </au>
            <au id="A3">
               <snm>Yaphe</snm>
               <fnm>John</fnm>
               <insr iid="I3"/>
               <email>yonahyaphe@hotmail.com</email>
            </au>
         </aug>
         <insg>
            <ins id="I1">
               <p>Department of Family Medicine, Haemek Medical Center, Afula, Israel and Leumit Health Services, Israel</p>
            </ins>
            <ins id="I2">
               <p>Rappaport Faculty of Medicine, Technion-Israel Institute of Technology, Haifa, Israel</p>
            </ins>
            <ins id="I3">
               <p>Department of Family Medicine, Rabin Medical Centre and Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel</p>
            </ins>
         </insg>
         <source>BMC Family Practice</source>
         <issn>1471-2296</issn>
         <pubdate>2002</pubdate>
         <volume>3</volume>
         <issue>1</issue>
         <fpage>15</fpage>
         <url>http://www.biomedcentral.com/1471-2296/3/15</url>
         <xrefbib>
            <pubidlist>
               <pubid idtype="doi">10.1186/1471-2296-3-15</pubid>
               <pubid idtype="pmpid">12186658</pubid>
            </pubidlist>
         </xrefbib>
      </bibl>
      <history>
         <rec>
            <date>
               <day>28</day>
               <month>5</month>
               <year>2002</year>
            </date>
         </rec>
         <acc>
            <date>
               <day>20</day>
               <month>8</month>
               <year>2002</year>
            </date>
         </acc>
         <pub>
            <date>
               <day>20</day>
               <month>8</month>
               <year>2002</year>
            </date>
         </pub>
      </history>
      <cpyrt>
         <year>2002</year>
         <collab>Gercenshtein et al; licensee BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.</collab>
      </cpyrt>
      <kwdg>
         <kwd>continuing medical education</kwd>
         <kwd>family medicine</kwd>
         <kwd>general practitioners</kwd>
         <kwd>lectures</kwd>
         <kwd>quality improvement</kwd>
      </kwdg>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <sec>
               <st>
                  <p>Background</p>
               </st>
               <p>Continuing medical education (CME) for general practitioners relies on specialist-based teaching methods in many settings. Formal lectures by specialists may not meet the learning needs of practitioners and may cause dissatisfaction with traditional CME. Increasing learner involvement in teaching programs may improve learner satisfaction.</p>
            </sec>
            <sec>
               <st>
                  <p>Methods</p>
               </st>
               <p>A quality improvement program for CME for 18 general practitioners in the Tel Aviv region was designed as a result of dissatisfaction with traditional CME activities. A two-step strategy for change was developed. The CME participants first selected the study topics relevant to them from a needs assessment and prepared background material on the topics. In the second step, specialist teachers were invited to answer questions arising from the preparation of selected topics. Satisfaction with the traditional lecture program and the new participatory program were assessed by a questionnaire. The quality criteria included the relevance, importance and applicability of the CME topic chosen to the participant's practice, the clarity of the presentation and the effective use of teaching aids by the lecturer and the potential of the lecturer to serve as a consultant to the participant.</p>
            </sec>
            <sec>
               <st>
                  <p>Results</p>
               </st>
               <p>The participatory model of CME significantly increased satisfaction with relevance, applicability and interest in CME topics compared to the traditional lecture format.</p>
            </sec>
            <sec>
               <st>
                  <p>Conclusions</p>
               </st>
               <p>Increased learner participation in the selection and preparation of CME topics, and increased interaction between CME teachers and learners results in increased satisfaction with teaching programs. Future study of the effect of this model on physician performance is required.</p>
            </sec>
         </sec>
      </abs>
   </fm>
   <bdy>
      <sec>
         <st>
            <p>Background</p>
         </st>
         <p>General practitioners in many settings rely heavily on specialist-based continuing medical education (CME) methods. These include direct consultation with experts, reviews in journal and textbooks, and formal continuing education activities. <abbrgrp><abbr bid="B1">1</abbr><abbr bid="B2">2</abbr><abbr bid="B3">3</abbr></abbrgrp> A traditional hierarchical relationship results in a one-way transfer of knowledge from specialists to general practitioners <abbrgrp><abbr bid="B4">4</abbr></abbrgrp>. However general practitioners may wish to control their own educational agenda and to inform specialists of their learning needs. Learning centered on clinical cases is likely to be of greater use to family physicians than formal lectures <abbrgrp><abbr bid="B5">5</abbr></abbrgrp>. Some specialists may regard lectures as the principal method of transferring information and few may have given any serious consideration to alternative teaching methods. The disparity between what general practitioners want to learn from specialists and what specialists think they need can be a barrier to effective educational interaction if there is no negotiation between teachers and learners <abbrgrp><abbr bid="B6">6</abbr></abbrgrp>. This paper describes a quality improvement program which introduced a new method of CME with the objective of increasing satisfaction with CME in a group of board certified general practitioners in Israel, in order to try to bridge the needs/wants gap.</p>
         <sec>
            <st>
               <p>Context of the problem</p>
            </st>
            <p>A group of 18 board-certified family physicians have been participating in a continuing medical education course in pediatric medicine in Tel Aviv, Israel for several years. The physicians had a mean seniority of 8.3 years in practice (s.d. 6.8 years). In the initial phase of the course, board certified specialists in pediatrics were invited to give weekly lectures to the course. The course began with three traditional lectures on various pediatric topics followed by questions from the audience.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Method</p>
         </st>
         <sec>
            <st>
               <p>Outline of problem</p>
            </st>
            <p>A high degree of dissatisfaction was noted among participants in the traditional CME program based on responses to open questions on a feedback sheet collected at the end of each weekly session. As a result a decision was made to modify the teaching program.</p>
         </sec>
         <sec>
            <st>
               <p>Key measures for improvement</p>
            </st>
            <p>The course participants set the objectives for quality improvement in the teaching program after the start of the course. They chose to assess the relevance, importance and applicability of the CME topic chosen to the participant's practice, the clarity of the presentation and the effective use of teaching aids by the lecturer and the potential of the lecturer to serve as a consultant to the participant.</p>
         </sec>
         <sec>
            <st>
               <p>Strategy for change</p>
            </st>
            <p>As a first step in modifying the CME program, the participants listed the pediatric topics that were most important to them (needs assessment). Three participants were selected to prepare the topic for presentation and to lead group discussion on the topic. One physician was designated to present theoretical material from the pediatric literature, the second was required to present the evidence base for the topic and the third was to present a relevant case from their clinical practice. Important questions and unanswered questions from the discussion were recorded.</p>
            <p>In a second step, the specialist who was to lecture to the group on a selected topic received the questions of the participants that arose in the group discussion of the topic. The lecturer was free to construct the presentation as they chose but was expected to relate to the questions of the participants that were provided in advance. The lecture was divided into short segments to allow for several periods of free discussion and questions.</p>
         </sec>
         <sec>
            <st>
               <p>Process of gathering information</p>
            </st>
            <p>The interactive lectures were evaluated by completion of a feedback questionnaire examining the quality criteria described above. The questionnaire consisted of 6 questions relating to the ideal performance of a specialist lecturing to family physicians. Responses were given on a six-point Likert-type scale with a score of six denoting strongest agreement with the item. Space was provided for additional free-text comments at the end of the questionnaire. The results of the feedback from the two course periods (3 frontal lectures and 7 interactive lectures) were compared. Data from the questionnaires were entered and analysed using Epi-Info software. Mean scores for each question were compared using t-tests with significance set at the 0.05 level.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Results</p>
         </st>
         <sec>
            <st>
               <p>Effects of change</p>
            </st>
            <p>The results of the feedback questionnaire for the two periods of the program ("frontal" and "interactive" lectures) are listed in Table <tblr tid="T1">1</tblr>.</p>
            <tbl id="T1">
               <title>
                  <p>Table 1</p>
               </title>
               <caption>
                  <p>Means scores of items on satisfaction with CME scale (n = 18)</p>
               </caption>
               <tblbdy cols="5">
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c ca="center">
                        <p>interactive</p>
                     </c>
                     <c ca="center">
                        <p>frontal</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c cspan="5">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>1</p>
                     </c>
                     <c ca="left">
                        <p>The topic of the lecture was relevant to my practice.</p>
                     </c>
                     <c ca="right">
                        <p>3.78</p>
                     </c>
                     <c ca="right">
                        <p>2.52</p>
                     </c>
                     <c ca="right">
                        <p>P &lt; 0.005</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>2</p>
                     </c>
                     <c ca="left">
                        <p>I would consult the lecturer regarding one of my patients.</p>
                     </c>
                     <c ca="right">
                        <p>3.93</p>
                     </c>
                     <c ca="right">
                        <p>2.88</p>
                     </c>
                     <c ca="right">
                        <p>P &lt; 0.005</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>3</p>
                     </c>
                     <c ca="left">
                        <p>I learned theoretical material on an important topic.</p>
                     </c>
                     <c ca="right">
                        <p>4.68</p>
                     </c>
                     <c ca="right">
                        <p>3.94</p>
                     </c>
                     <c ca="right">
                        <p>P &lt; 0.05</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>4</p>
                     </c>
                     <c ca="left">
                        <p>I learned new things that I can apply in my practice.</p>
                     </c>
                     <c ca="right">
                        <p>4.5</p>
                     </c>
                     <c ca="right">
                        <p>3.44</p>
                     </c>
                     <c ca="right">
                        <p>P &lt; 0.005</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>5</p>
                     </c>
                     <c ca="left">
                        <p>The lecturer presented the material in an interesting way.</p>
                     </c>
                     <c ca="right">
                        <p>3.82</p>
                     </c>
                     <c ca="right">
                        <p>2.41</p>
                     </c>
                     <c ca="right">
                        <p>P &lt; 0.005</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>6</p>
                     </c>
                     <c ca="left">
                        <p>The lecturer used audiovisual aids in an effective way.</p>
                     </c>
                     <c ca="right">
                        <p>4.05</p>
                     </c>
                     <c ca="right">
                        <p>2.58</p>
                     </c>
                     <c ca="right">
                        <p>P &lt; 0.05</p>
                     </c>
                  </r>
               </tblbdy>
            </tbl>
         </sec>
         <sec>
            <st>
               <p>Analysis and interpretation</p>
            </st>
            <p>The results show significantly higher satisfaction for interactive lectures compared to frontal lectures in all categories. Although the involvement of the course participants in setting the objectives for the intervention and the construction of the intervention after the start of the course may be considered sources of bias in a classical research design, they are inherent in a quality improvement program. The disadvantages of the new method were described in the free-text comments included in the participants' feedback. The new method required considerable time for preparation of the teaching sessions and discussions. The method required the goodwill and cooperation of both the participants and the lecturers. Some of the family physicians did not participate actively in the discussions but claimed that they contributed more than in the old method. Occasionally the discussion focused on trivial issues or issues that seemed less relevant to the majority of the group, yet they occupied the group's time.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Discussion</p>
         </st>
         <p>Adult learning theory and theories of how professionals maintain and develop competence emphasize the importance of self-directed learning and point to clinical practice and problem solving as key areas of interest <abbrgrp><abbr bid="B9">9</abbr></abbrgrp>. Many studies have shown that patient care provokes frequent information needs <abbrgrp><abbr bid="B10">10</abbr></abbrgrp>. General practitioners often rely on specialist-based CME because textbooks, journals, and other existing information tools are not adequate for answering clinical questions that arise in practice. Textbooks may become outdated quickly, journals are often not useful in daily practice and both methods are time-consuming and expensive. <abbrgrp><abbr bid="B10">10</abbr><abbr bid="B13">13</abbr></abbrgrp> Computer systems that have been developed to help doctors are not widely used <abbrgrp><abbr bid="B10">10</abbr><abbr bid="B11">11</abbr><abbr bid="B12">12</abbr></abbrgrp>. General practitioners have clear views of the content and style of teaching they wish to receive from their specialist colleagues <abbrgrp><abbr bid="B14">14</abbr></abbrgrp>. The satisfaction questionnaire developed by the family physicians in this program reflected a wish that teaching be directly related to theirclinical work.</p>
         <p>In this quality improvement program, the family physicians' desire for two-way interaction and for effective mutual education was achieved by family physicians expressing clearly what they wanted from their specialist colleagues and by specialists developing greater educational expertise. Prior needs assessment is important for informing and directing the educational process. <abbrgrp><abbr bid="B14">14</abbr></abbrgrp></p>
         <p>Two models of educational interaction between family physicians and specialists are described here <abbrgrp><abbr bid="B2">2</abbr></abbrgrp>. The first model presented is based on traditional didactic lectures given by specialists to general practitioners. General practitioners may dislike didactic lectures but specialists often prefer this method. The second model consists of interactive sessions centred on clinical cases. This model was popular with both family physicians and specialists. Heale et al found that traditional lectures and large group lectures were the least preferred method of CME. <abbrgrp><abbr bid="B15">15</abbr></abbrgrp> A transition from passive to interactive learning groups was also recommended in another study <abbrgrp><abbr bid="B16">16</abbr></abbrgrp>.</p>
         <p>Systematic reviews <abbrgrp><abbr bid="B17">17</abbr><abbr bid="B18">18</abbr><abbr bid="B19">19</abbr><abbr bid="B20">20</abbr><abbr bid="B21">21</abbr></abbrgrp> of educational interventions have shown that continuing medical education can improve clinical performance and patient outcomes by changing doctors' behavior. The most effective methods described in these reviews include learning linked to clinical practice, interactive educational meetings, outreach events, and strategies that involve multiple educational interventions (for example, outreach plus reminders). The least effective methods are those most commonly used in general practice continuing medical education, namely, lecture-format teaching and unsolicited printed material (including clinical guidelines).</p>
      </sec>
      <sec>
         <st>
            <p>Conclusions</p>
         </st>
         <p>This report has described one method of increasing satisfaction with CME by increasing interaction between teachers and learners. Further study is required to test the association between the increase in satisfaction and changes in physician knowledge, competence and performance in this population.</p>
      </sec>
      <sec>
         <st>
            <p>Competing Interests</p>
         </st>
         <p>None declared</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>LG and YF initiated the study and collected the data. LG wrote the original draft of the paper. JY conducted the statistical analysis of the data and wrote subsequent drafts of the paper. All authors read and approved the final manuscript.</p>
      </sec>
   </bdy>
   <bm>
      <refgrp>
         <bibl id="B1">
            <title>
               <p>Obtaining useful information from expert based sources.</p>
            </title>
            <aug>
               <au>
                  <snm>Slawson</snm>
                  <fnm>DC</fnm>
               </au>
               <au>
                  <snm>Shaughnessy</snm>
                  <fnm>AF</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1997</pubdate>
            <volume>314</volume>
            <fpage>947</fpage>
            <lpage>949</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">9099121</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B2">
            <title>
               <p>Analysis of questions asked by family doctors regarding patient care.</p>
            </title>
            <aug>
               <au>
                  <snm>Ely</snm>
                  <fnm>JW</fnm>
               </au>
               <au>
                  <snm>Osheroff</snm>
                  <fnm>JA</fnm>
               </au>
               <au>
                  <snm>Ebell</snm>
                  <fnm>MH</fnm>
               </au>
               <au>
                  <snm>Bergus</snm>
                  <fnm>GR</fnm>
               </au>
               <au>
                  <snm>Levy</snm>
                  <fnm>BT</fnm>
               </au>
               <au>
                  <snm>Chambliss</snm>
                  <fnm>ML</fnm>
               </au>
               <au>
                  <snm>Evans</snm>
                  <fnm>ER</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1999</pubdate>
            <volume>319</volume>
            <fpage>358</fpage>
            <lpage>361</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">28191</pubid>
                  <pubid idtype="pmpid" link="fulltext">10435959</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B3">
            <title>
               <p>Does continuing medical education in general practice make a difference?</p>
            </title>
            <aug>
               <au>
                  <snm>Cantillon</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Jones</snm>
                  <fnm>R</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1999</pubdate>
            <volume>318</volume>
            <fpage>1276</fpage>
            <lpage>1279</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">10231265</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B4">
            <title>
               <p>What do Wessex general practitioners think about the structure of hospital vocational training?</p>
            </title>
            <aug>
               <au>
                  <snm>Little</snm>
                  <fnm>P</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1994</pubdate>
            <volume>308</volume>
            <fpage>1337</fpage>
            <lpage>1339</lpage>
            <xrefbib>
               <pubid idtype="pmpid">8019223</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B5">
            <title>
               <p>Qualitative study of educational interaction between general practitioners and specialists.</p>
            </title>
            <aug>
               <au>
                  <snm>Marshall</snm>
                  <fnm>MN</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1998</pubdate>
            <volume>316</volume>
            <fpage>442</fpage>
            <lpage>445</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">9492673</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B6">
            <title>
               <p>The hospital component of vocational training for general practice.</p>
            </title>
            <aug>
               <au>
                  <snm>Bayley</snm>
                  <fnm>TJ</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1994</pubdate>
            <volume>308</volume>
            <fpage>1339</fpage>
            <lpage>1340</lpage>
            <xrefbib>
               <pubid idtype="pmpid">8019224</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B7">
            <title>
               <p>How well do general practitioners and hospital consultants work together? A qualitative study of cooperation and conflict within the medical profession.</p>
            </title>
            <aug>
               <au>
                  <snm>Marshall</snm>
                  <fnm>MN</fnm>
               </au>
            </aug>
            <source>Br J Gen Pract</source>
            <pubdate>1998</pubdate>
            <volume>48</volume>
            <fpage>1379</fpage>
            <lpage>1382</lpage>
            <xrefbib>
               <pubid idtype="pmpid">9800393</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B8">
            <title>
               <p>How well do GPs and hospital consultants work together? A survey of the professional relationship.</p>
            </title>
            <aug>
               <au>
                  <snm>Marshall</snm>
                  <fnm>MN</fnm>
               </au>
            </aug>
            <source>Fam Pract</source>
            <pubdate>1999</pubdate>
            <volume>16</volume>
            <fpage>33</fpage>
            <lpage>38</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1093/fampra/16.1.33</pubid>
                  <pubid idtype="pmpid" link="fulltext">10321393</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B9">
            <title>
               <p>Quality issues in continuing medical education.</p>
            </title>
            <aug>
               <au>
                  <snm>Holm</snm>
                  <fnm>HA</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1999</pubdate>
            <volume>318</volume>
            <fpage>1276</fpage>
            <lpage>1279</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">10231265</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B10">
            <title>
               <p>What clinical information do doctors need?</p>
            </title>
            <aug>
               <au>
                  <snm>Smith</snm>
                  <fnm>R</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1996</pubdate>
            <volume>313</volume>
            <fpage>1062</fpage>
            <lpage>1068</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">8898602</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B11">
            <title>
               <p>A clinical informaticist to support primary care decision making.</p>
            </title>
            <aug>
               <au>
                  <snm>Swinglehurst</snm>
                  <fnm>DA</fnm>
               </au>
               <au>
                  <snm>Pierce</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Fuller</snm>
                  <fnm>JC</fnm>
               </au>
            </aug>
            <source>Qual Health Care</source>
            <pubdate>2001</pubdate>
            <volume>10</volume>
            <fpage>245</fpage>
            <lpage>249</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1136/qhc.0100245..</pubid>
                  <pubid idtype="pmpid" link="fulltext">11743154</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B12">
            <title>
               <p>Obstacles to answering doctors' questions about patient care with evidence: qualitative study.</p>
            </title>
            <aug>
               <au>
                  <snm>Ely</snm>
                  <fnm>JW</fnm>
               </au>
               <au>
                  <snm>Osheroff</snm>
                  <fnm>JA</fnm>
               </au>
               <au>
                  <snm>Ebell</snm>
                  <fnm>MH</fnm>
               </au>
               <au>
                  <snm>Chambliss</snm>
                  <fnm>ML</fnm>
               </au>
               <au>
                  <snm>Vinson</snm>
                  <fnm>DC</fnm>
               </au>
               <au>
                  <snm>Stevermer</snm>
                  <fnm>JJ</fnm>
               </au>
               <au>
                  <snm>Pifer</snm>
                  <fnm>EA</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>2002</pubdate>
            <volume>324</volume>
            <fpage>710</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">99056</pubid>
                  <pubid idtype="pmpid" link="fulltext">11909789</pubid>
                  <pubid idtype="doi">10.1136/bmj.324.7339.710</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B13">
            <title>
               <p>Answering clinical questions.</p>
            </title>
            <aug>
               <au>
                  <snm>Chambliss</snm>
                  <fnm>ML</fnm>
               </au>
               <au>
                  <snm>Conley</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>J Fam Pract</source>
            <pubdate>1996</pubdate>
            <volume>43</volume>
            <fpage>140</fpage>
            <lpage>144</lpage>
            <xrefbib>
               <pubid idtype="pmpid">8708623</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B14">
            <title>
               <p>Use of focus groups for identifying specialty needs of primary care physicians.</p>
            </title>
            <aug>
               <au>
                  <snm>Gelula</snm>
                  <fnm>MH</fnm>
               </au>
               <au>
                  <snm>Sandlow</snm>
                  <fnm>LJ</fnm>
               </au>
            </aug>
            <source>J Contin Educ Health Prof</source>
            <pubdate>1998</pubdate>
            <volume>18</volume>
            <fpage>224</fpage>
            <lpage>226</lpage>
         </bibl>
         <bibl id="B15">
            <title>
               <p>A randomized controlled trial assessing the impact of problem-based versus didactic teaching methods in CME.</p>
            </title>
            <aug>
               <au>
                  <snm>Heale</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Davis</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Norman</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Woodward</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Neufeld</snm>
                  <fnm>V</fnm>
               </au>
               <au>
                  <snm>Dodd</snm>
                  <fnm>P</fnm>
               </au>
            </aug>
            <source>Proc Annu Conf Res Med Educ</source>
            <pubdate>1988</pubdate>
            <volume>27</volume>
            <fpage>72</fpage>
            <lpage>77</lpage>
            <xrefbib>
               <pubid idtype="pmpid">3218878</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B16">
            <title>
               <p>From teaching to learning. Experiences of small CME group work in general practice in Sweden.</p>
            </title>
            <aug>
               <au>
                  <snm>Eliasson</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Mattsson</snm>
                  <fnm>B</fnm>
               </au>
            </aug>
            <source>Scand J Prim Health Care</source>
            <pubdate>1999</pubdate>
            <volume>17</volume>
            <fpage>196</fpage>
            <lpage>200</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1080/028134399750002403</pubid>
                  <pubid idtype="pmpid">10674295</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B17">
            <title>
               <p>Evidence for the effectiveness of CME. A review of fifty randomised controlled trials.</p>
            </title>
            <aug>
               <au>
                  <snm>Davis</snm>
                  <fnm>DA</fnm>
               </au>
               <au>
                  <snm>Thomson</snm>
                  <fnm>MA</fnm>
               </au>
               <au>
                  <snm>Oxman</snm>
                  <fnm>AD</fnm>
               </au>
               <au>
                  <snm>Haynes</snm>
                  <fnm>RB</fnm>
               </au>
            </aug>
            <source>JAMA</source>
            <pubdate>1992</pubdate>
            <volume>268</volume>
            <fpage>1111</fpage>
            <lpage>1117</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1001/jama.268.9.1111</pubid>
                  <pubid idtype="pmpid">1501333</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B18">
            <title>
               <p>Does CME work? An analysis of the effect of educational activities on physician performance or health care outcomes.</p>
            </title>
            <aug>
               <au>
                  <snm>Davis</snm>
                  <fnm>D</fnm>
               </au>
            </aug>
            <source>Int J Psychiatry Med</source>
            <pubdate>1998</pubdate>
            <volume>28</volume>
            <fpage>21</fpage>
            <lpage>39</lpage>
            <xrefbib>
               <pubid idtype="pmpid">9617647</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B19">
            <title>
               <p>No magic bullets: a systematic review of 102 trials of interventions.</p>
            </title>
            <aug>
               <au>
                  <snm>Oxman</snm>
                  <fnm>AD</fnm>
               </au>
               <au>
                  <snm>Thomson</snm>
                  <fnm>MA</fnm>
               </au>
               <au>
                  <snm>Davis</snm>
                  <fnm>DA</fnm>
               </au>
               <au>
                  <snm>Haynes</snm>
                  <fnm>RB</fnm>
               </au>
            </aug>
            <source>Can Med Assoc J</source>
            <pubdate>1995</pubdate>
            <volume>153</volume>
            <fpage>1423</fpage>
            <lpage>1427</lpage>
         </bibl>
         <bibl id="B20">
            <title>
               <p>Changing physician performance: a systematic review of continuing medical education strategies.</p>
            </title>
            <aug>
               <au>
                  <snm>Davis</snm>
                  <fnm>DA</fnm>
               </au>
               <au>
                  <snm>Thomson</snm>
                  <fnm>MA</fnm>
               </au>
               <au>
                  <snm>Oxman</snm>
                  <fnm>AD</fnm>
               </au>
               <au>
                  <snm>Haynes</snm>
                  <fnm>RB</fnm>
               </au>
            </aug>
            <source>JAMA</source>
            <pubdate>1995</pubdate>
            <volume>274</volume>
            <fpage>700</fpage>
            <lpage>705</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1001/jama.274.9.700</pubid>
                  <pubid idtype="pmpid">7650822</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B21">
            <title>
               <p>Educational interventions in primary care psychiatry: a review.</p>
            </title>
            <aug>
               <au>
                  <snm>Kerwick</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Jones</snm>
                  <fnm>RH</fnm>
               </au>
            </aug>
            <source>Primary Care Psychiatry</source>
            <pubdate>1996</pubdate>
            <volume>2</volume>
            <fpage>107</fpage>
            <lpage>117</lpage>
         </bibl>
      </refgrp>
      <sec>
         <st>
            <p>Pre-publication history</p>
         </st>
         <p>The pre-publication history for this paper can be accessed here:</p>
         <p>
            <url>http://www.biomedcentral.com/1471-2296/3/15/prepub</url>
         </p>
      </sec>
   </bm>
</art>
