<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>1471-244X-8-90</ui>
   <ji>1471-244X</ji>
   <fm>
      <dochead>Research article</dochead>
      <bibl>
         <title>
            <p>Prompt letters to reduce non-attendance: applying evidence based practice</p>
         </title>
         <aug>
            <au ce="yes" id="A1">
               <snm>Jayaram</snm>
               <fnm>Mahesh</fnm>
               <insr iid="I1"/>
               <email>Mahesh.Jayaram@leedspft.nhs.uk</email>
            </au>
            <au ca="yes" ce="yes" id="A2">
               <snm>Rattehalli</snm>
               <mi>D</mi>
               <fnm>Ranganath</fnm>
               <insr iid="I2"/>
               <email>rdrattehalli@hotmail.com</email>
            </au>
            <au ce="yes" id="A3">
               <snm>Kader</snm>
               <fnm>Ihsan</fnm>
               <insr iid="I3"/>
               <email>Ihsan.Kader@leedspft.nhs.uk</email>
            </au>
         </aug>
         <insg>
            <ins id="I1">
               <p>Consultant Psychiatrist, Leeds Partnerships NHS Foundation Trust, Bridge House, Balm Road, Leeds LS10 2TP, UK</p>
            </ins>
            <ins id="I2">
               <p>Specialist Registrar, Leeds Partnerships NHS Foundation Trust, Millfield House, Kirk Lane, Leeds LS19 7LX, UK</p>
            </ins>
            <ins id="I3">
               <p>Consultant Psychiatrist, Leeds Partnerships NHS Foundation Trust, Bridge House, Balm Road, Leeds LS10 2TP, UK</p>
            </ins>
         </insg>
         <source>BMC Psychiatry</source>
         <issn>1471-244X</issn>
         <pubdate>2008</pubdate>
         <volume>8</volume>
         <issue>1</issue>
         <fpage>90</fpage>
         <url>http://www.biomedcentral.com/1471-244X/8/90</url>
         <xrefbib>
            <pubidlist>
               <pubid idtype="pmpid">19014606</pubid>
               <pubid idtype="doi">10.1186/1471-244X-8-90</pubid>
            </pubidlist>
         </xrefbib>
      </bibl>
      <history>
         <rec>
            <date>
               <day>06</day>
               <month>3</month>
               <year>2008</year>
            </date>
         </rec>
         <acc>
            <date>
               <day>16</day>
               <month>11</month>
               <year>2008</year>
            </date>
         </acc>
         <pub>
            <date>
               <day>16</day>
               <month>11</month>
               <year>2008</year>
            </date>
         </pub>
      </history>
      <cpyrt>
         <year>2008</year>
         <collab>Jayaram et al; licensee BioMed Central Ltd.</collab>
         <note>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note>
      </cpyrt>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <sec>
               <st>
                  <p>Background</p>
               </st>
               <p>Non-attendance rates in psychiatric outpatient clinics have been a topic of considerable interest. It is measured as an indicator of quality of service provision. Failed attendances add to the cost of care as well as having an adverse impact on patients leading to missing medications, delay in identifying relapses and increasing waiting list time. Recent trials have demonstrated that prompting letters sent to patients led to a decrease in non-attendance rates. We applied this evidence based practice in our community mental health setting to evaluate its impact.</p>
            </sec>
            <sec>
               <st>
                  <p>Methods</p>
               </st>
               <p>Using a before and after study design, we sent prompting letters to all patients due to attend outpatient clinic appointments for a period of six months in 2007. Non-attendance rates were compared with the corresponding period in 2006. We also looked at trends of non-attendance prior to this intervention and compared results with other parts of our service where this intervention had not been applied.</p>
            </sec>
            <sec>
               <st>
                  <p>Results</p>
               </st>
               <p>1433 prompting letters were sent out to all out-patient appointments made from June to November 2007. This resulted in an average non-attendance rate of 17% which was significantly less compared to 27% between June and November 2006 (RR 0.65, 95% CI 0.56 to 0.76, NNT 11). No downward trend in non-attendance rate was identified either prior to the intervention or when compared with similar teams across the city.</p>
            </sec>
            <sec>
               <st>
                  <p>Conclusion</p>
               </st>
               <p>Prompt letters have been shown to reduce non-attendance rates in previous RCTs and systematic reviews. Our findings demonstrate a reduction in non-attendance rates with prompting letters even under non-trial conditions. Majority of the patients were constant during the two periods compared although there were some changes in medical personnel. This makes it difficult to attribute all the change, solely to the intervention alone. Perhaps our work shows that the results of pragmatic randomised trials are easily applicable and produce similar results in non-randomised settings. We found that prompting letters are a useful and easy to apply evidence based intervention to reduce non-attendance rates with a potential to achieve significant cost savings.</p>
            </sec>
         </sec>
      </abs>
   </fm>
   <meta>
      <classifications>
         <classification id="endnote" subtype="user_supplied_xml" type="bmc"/>
      </classifications>
   </meta>
   <bdy>
      <sec>
         <st>
            <p>Background</p>
         </st>
         <p>Outpatient clinic visits are an important point of contact between healthcare professionals and recipients of care. Attendance rates across specialties in the UK have been looked at closely as a measure of quality of care, to identify bottlenecks in the referral pathway between primary and secondary care and to reduce waiting list times <abbrgrp><abbr bid="B1">1</abbr></abbrgrp>. Research in other medical specialities has shown that non-attendance is unrelated to the seriousness of the illness <abbrgrp><abbr bid="B2">2</abbr></abbrgrp> and patients who do not attend may have treatable morbidity <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>. Some patients may make a conscious decision to miss appointments, balancing their decision on the perceived benefits and costs <abbrgrp><abbr bid="B4">4</abbr></abbrgrp>. The commonest reason for non-attendance is forgetting about the appointment and this is particularly linked to non-adherence with medications <abbrgrp><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr></abbrgrp>. In mental health, the duration of new appointments is usually longer than follow up appointments <abbrgrp><abbr bid="B7">7</abbr></abbrgrp> and this makes non-attendance for new appointments an even greater waste of already stretched resources and delaying contact with services <abbrgrp><abbr bid="B6">6</abbr></abbrgrp>. For patients with a severe mental illness who are more likely to miss appointments <abbrgrp><abbr bid="B8">8</abbr></abbrgrp>, missed appointments equate to missing medications or delays in identifying early warning signs of a relapse and disengagement from services <abbrgrp><abbr bid="B9">9</abbr></abbrgrp>.</p>
         <p>Combined new and follow-up appointment non-attendance rate is around 12% nationally across all specialities <abbrgrp><abbr bid="B10">10</abbr></abbrgrp>. The cost per lost NHS appointment during 1984 ranged from &#163;20 to &#163;50 <abbrgrp><abbr bid="B11">11</abbr></abbrgrp> which had risen to &#163;65 in 1997 <abbrgrp><abbr bid="B12">12</abbr></abbrgrp> with an estimated total cost of around &#163;300 to &#163;360 million annually <abbrgrp><abbr bid="B10">10</abbr><abbr bid="B12">12</abbr></abbrgrp> and this figure may have increased recently. Failed appointments cost each NHS Trust around &#163;1 million per year <abbrgrp><abbr bid="B13">13</abbr></abbrgrp>. More recently, with the emphasis shifting towards reference costs, it is difficult to estimate costs across the country however, in Leeds we estimate that on average a follow up psychiatric outpatient appointment costs around &#163;70 to &#163;80. The Health Care Commission which rates the performance of Trusts report that high non-attendance rates lead to patients missing out on care and those services need to be patient centred. Non-attendance rates are banded on a scale of 1 to 5 (higher the banding = better the performance) and a non-attendance target of &#8804; 11.3% is considered acceptable <abbrgrp><abbr bid="B14">14</abbr></abbrgrp>.</p>
         <p>A systematic review in this area showed that a simple orientation-type letter, sent 24 hours before clinic appointment may encourage attendance <abbrgrp><abbr bid="B15">15</abbr></abbrgrp>. Pooled data from the recent Leeds PROMPTS trial and the existing systematic review demonstrated that prompting letters significantly reduced the non-attendance rates (5RCTs, N = 1184, RR 0.72 95% CI 0.59 to 0.89, NNT 6, CI 4 to 14) and that it was possible to apply this intervention in a busy clinical setting with the use of minimal additional resources <abbrgrp><abbr bid="B16">16</abbr></abbrgrp>. We decided to implement this evidence based intervention of sending prompt letters in our outpatient clinics to see if it would make a difference to non-attendance rates in a pragmatic real world, non-randomised setting.</p>
      </sec>
      <sec>
         <st>
            <p>Methods</p>
         </st>
         <p>There are two community mental health teams based at Bridge House, South Leeds working in General Psychiatry catering to age groups between 18 and 65, comprising of a mixture of socio economic states, but predominantly economically deprived background <abbrgrp><abbr bid="B17">17</abbr></abbrgrp> and covering a population of about 64,000. Both these teams decided to implement the use of prompt letters. We designed a short letter (see appendix 1) reminding patients of the appointment which took around 30 seconds to read. This was printed on headed paper, explained the time of appointment, and gave the name of doctor, short description of the clinic and its routine, a map and finally a request to bring medication and a friend or family member. The letter was designed in line with the one used in the Leeds PROMPTS randomised study <abbrgrp><abbr bid="B16">16</abbr></abbrgrp>. This letter was individualised to the patient and sent out by the team secretary a week before the scheduled appointment by Royal Mail First Class Post. It is standard practice within our organisation to send out patient appointment letters by post and sending of reminder letters was approved by our organisation. As we were evaluating the effects of a practice that was being implemented, we did not require an ethics committee approval or informed consent. All our letters complied with the Data Protection Act 1998 <abbrgrp><abbr bid="B18">18</abbr></abbrgrp>.</p>
         <p>The prompt letters began to be rolled out in the last week of May 2007 so that patients due for their appointments from the first week of June 2007 onwards received these letters. This is an ongoing practice now. We compared the non-attendance or DNA (Did Not Attend) rates before and after the implementation of this intervention. If a patient failed to attend the outpatient clinic and no message had been received that this person was not going to attend, the patient was deemed to be a non-attendee or 'DNA'. We compared non-attendance (DNA) rates in the year 2007 against the same months for year 2006 to eliminate any possible seasonal variations in non-attendance rates. We also looked at non-attendance trends across the whole year as well as compared it with another part of Leeds with a similar community mental health team set up and population demographics <abbrgrp><abbr bid="B19">19</abbr></abbrgrp> to see if there was a general tendency of decrease or increase in non-attendance rates. E-care, an outpatient clinic booking tool used by our Trust enabled us to extract the required data.</p>
         <sec>
            <st>
               <p>Setting</p>
            </st>
            <p>In the context of NHS, most patients are managed in primary care and more complex cases get referred to secondary and tertiary care. Our Community mental health teams are part of secondary care services. All new referrals to our teams go through an initial 'gate keeping' multidisciplinary assessment done by a member of community mental health team and sometimes a medical doctor. Following these assessments, some patients are signposted to other appropriate services and the ones that need more in depth medical assessments are booked into regular outpatient clinics. These clinics constituted our patient sample. The treating teams comprised of junior doctors, educational staff grades and consultants amongst other disciplines. Junior trainees and staff grades change posts once every 6 to 12 months depending on their training requirements and there was one change of consultant in March 2007.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Results</p>
         </st>
         <p>A total of 1433 out-patient appointments were made at Bridge House from the months of June 2007 to November 2007. In total 1433 prompt letters were sent out in order to reach patients the week before their scheduled appointment. Figure <figr fid="F1">1</figr> shows the number and percentage of non-attendances in this period. We compared these figures with the figures from June 2006 to November 2006 when no prompt letters were sent. The average non-attendance rate during June 2006 to Nov 2006 was 26% and this had dropped to 17% for the time period June 2007 to November 2007 following the introduction of prompt letters. The reduction in the non-attendance rate was statistically significant (RR 0.65, 95% CI 0.56 to 0.76, NNT 11) and is depicted in Figure <figr fid="F2">2</figr>. The average non-attendance rate during the same year from January 2007 to May 2007 was 27% (Figure <figr fid="F1">1</figr>). The non-attendance rates across the city in a similar community mental health team setting in the same period (June to November) had gone up from 22% in 2006 to 23% in 2007 and was not statistically significant (P = 0.45).</p>
         <fig id="F1">
            <title>
               <p>Figure 1</p>
            </title>
            <caption>
               <p>Non-attendance rates before and after prompt letters</p>
            </caption>
            <text>
               <p>
                  <b>Non-attendance rates before and after prompt letters.</b>
               </p>
            </text>
            <graphic file="1471-244X-8-90-1"/>
         </fig>
         <fig id="F2">
            <title>
               <p>Figure 2</p>
            </title>
            <caption>
               <p>Relative risk of non-attendance in the prompt group compared to the control group</p>
            </caption>
            <text>
               <p>
                  <b>Relative risk of non-attendance in the prompt group compared to the control group.</b>
               </p>
            </text>
            <graphic file="1471-244X-8-90-2"/>
         </fig>
      </sec>
      <sec>
         <st>
            <p>Discussion</p>
         </st>
         <p>None of the patients seen in these outpatient clinics were what would be traditionally called 'new patients' as they had already been seen by the team and in effect they were follow up appointments. The prompting letters were only sent to patients who were booked into this model of 'outpatient clinics' and not to the ones who received an initial 'gate keeping appointment'. Therefore all patients in our sample had already engaged with secondary care mental health service which makes our sample different from that of previous studies. It is also likely that this model of care is not uniform across NHS Trusts. Previous studies have shown that prompts and information leaflets are helpful in reducing non-attendance for new rather than follow-up patients <abbrgrp><abbr bid="B15">15</abbr></abbrgrp>, however our study results suggest that prompt letters may be useful for improving attendance of follow-up patients.</p>
         <p>The combined outpatient case load for both teams is about 575 patients. For the period of June 2006 to November 2006, 1074 appointments were made in the outpatient clinics and 1433 appointments for the corresponding period in 2007. Of these 1433 appointments, 1277 (89%) were for the same patients who were seen in 2006 which makes the two samples comparable with two caveats. Firstly, clinicians in 2007 might have acted differently towards patients compared to clinicians in 2006. These kinds of changes are unfortunately part of 'reality'. Secondly, there is a possibility that the reduction in non-attendance rates could have been due to the improvement in mental health and functioning of the patient population who remained largely constant. Non-attendance rate for patients new to 2007 (i.e. follow up patients seen only in 2007 and not in 2006) was 14.7% compared to 17.3% for patients who had remained constant between 2006 and 2007. This difference was not statistically significant (RR 1.17, 95% CI 0.79 to 1.74). Thus improvement in mental state of patients is less likely to have caused the reduction in non-attendance for 2007.</p>
         <p>Researchers have been interested in finding out why patients miss their appointments rather than ring and cancel beforehand. There is some data to suggest that a third of patients forget or do not consider cancelling as they may be too embarrassed to call on the day and admit this <abbrgrp><abbr bid="B20">20</abbr></abbrgrp>. In our study, if the patient or their carer informed us of their inability to attend, then their appointment was deemed as 'cancelled' and not as 'DNA'. The E-care system we used does not record cancellations and hence we were unable to clarify if some of the 'cancelled' appointments still showed up as DNAs thus underestimating the impact of our intervention. We are hoping that a new software 'Paris' which replaces 'E-care' will solve this problem for similar analysis in future. Cancellations were perceived to be on the rise by clinicians leading us to hypothesise that perhaps receiving a prompt letter made patient's feel more confident to ring and cancel even though it was close to their appointment date. Cancellations enabled us to use available resources more efficiently. Also to reiterate the importance of attending appointments, we have begun to display up to date monthly non-attendance figures in our outpatient waiting areas.</p>
         <p>With each outpatient appointment costing about &#163;70 to &#163;80 in Leeds, this intervention was associated with an estimated savings of about &#163;480 per week. Secondary benefits are yet to be evaluated. Reduction seen in the non-attendance rates could be related to several factors, however majority of our patient population remained constant and there was no major change in the way service was delivered. We compared the non-attendance rates from earlier in the year (January to May 2007) and found that there was no particular trend towards a decline in non-attendance rates prior to this intervention. We also compared the non-attendance rates in other parts of our service where prompting letters had not been introduced which showed that there was no change in their respective non-attendance rates between 2006 and 2007. As in any before and after study design, it is difficult to attribute change observed to the intervention alone due to possibility of various confounding variables or biases, however this intervention has already been evaluated in a pragmatic randomised controlled trial and findings pooled with an existing systematic review to prove its effectiveness <abbrgrp><abbr bid="B16">16</abbr></abbrgrp>. One of the criticisms of randomised trials in the past has been that sample populations are narrowly defined and results are often difficult to generalise <abbrgrp><abbr bid="B21">21</abbr></abbrgrp>. We were able to apply finding from this pragmatic trial <abbrgrp><abbr bid="B16">16</abbr></abbrgrp> without much difficulty in a busy clinical setting and found results similar to conclusions arrived at within a trial setting. Perhaps this demonstrates that well designed pragmatic randomised controlled trials are able to produce results that are clinically relevant and repeatable in clinical settings. These results may only be applicable in similar settings within the UK or elsewhere that operates a similar outpatient system.</p>
      </sec>
      <sec>
         <st>
            <p>Conclusion</p>
         </st>
         <p>Prompt letters have previously demonstrated to be effective in reducing non-attendance rates in RCT settings and this has been confirmed by systematic reviews as well. Our study was able to demonstrate that it could be possible to reduce non-attendance rates in a day to day clinical setting. Majority of the patient population remained constant during the study periods compared although there were changes in medical personnel. This makes it difficult to attribute change solely to the intervention alone. However this study was able to demonstrate that the results of pragmatic randomised trials can be easily applied to day to day clinical practice and it is possible to produce similar results in non-randomised settings. We found that prompting letters are a useful and easy to apply evidence based intervention to reduce non-attendance rates with a potential to achieve significant cost savings in similar mental health settings.</p>
      </sec>
      <sec>
         <st>
            <p>Abbreviations</p>
         </st>
         <p>DNA stand for 'Did not attend' and NHS stands for 'National Health Service'.</p>
      </sec>
      <sec>
         <st>
            <p>Competing interests</p>
         </st>
         <p>All authors are employed by the Leeds Partnerships NHS Foundation Trust. IK was part of the PROMPTS trial.</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>MJ participated in the designing of the study, acquisition of data followed by analysis and interpretation of the data and the writing of the manuscript. RR participated in acquisition, analysis and interpretation of the data including the drafting and revisions of the manuscript. IK participated in the designing of the study and acquisition of data. All authors read and approved the final manuscript.</p>
      </sec>
      <sec>
         <st>
            <p>Appendix 1</p>
         </st>
         <p>
            <it>Example of letter</it>
         </p>
         <p>
            <b>Organisation's Logo</b>
         </p>
         <p>
            <b>PRIVATE &amp; CONFIDENTIAL</b>
         </p>
         <p><b><it>CMHT 10 &amp; 11</it></b>,</p>
         <p><b><it>Bridge House, Balm Road</it></b>,</p>
         <p>
            <b>
               <it>Leeds LS10 2TP</it>
            </b>
         </p>
         <p>
            <b>
               <it>Tel: 0113 xxxxxxx</it>
            </b>
         </p>
         <p>[Patient's name &amp; address]</p>
         <p>[Date]</p>
         <p>Dear [Patient's name].</p>
         <p>
            <b>Re: Your appointment at Bridge House</b>
         </p>
         <p>This is a short reminder of your appointment at <b>Bridge House </b>on the <b>[Date at Time]</b>. Your appointment will be with <b>Dr. XX </b>and will last for xx minutes. This interview will be private and confidential. It is often helpful if you bring a friend or family member and medications along. Our clinic has a reception and once the receptionist knows you have arrived, she will inform the doctor.</p>
         <p>Bridge House is located on Balm Road and a map with directions is enclosed with this letter.</p>
         <p>If you have forgotten about the appointment or made other plans, do not worry. Please let me know at the above telephone number and we will rearrange your appointment at a time which is convenient for you.</p>
         <p>
            <b>[Name of Secretary]</b>
         </p>
         <p>
            <b>Secretary to Dr XX</b>
         </p>
         <p>Encl. [Map]</p>
      </sec>
   </bdy>
   <bm>
      <ack>
         <sec>
            <st>
               <p>Acknowledgements</p>
            </st>
            <p>We wish to thank Jan Bunnell and the administrative team at Bridge House for their help in this study.</p>
         </sec>
      </ack>
      <refgrp>
         <bibl id="B1">
            <title>
               <p>Healthcare Commission- Performance indicators for the performance ratings 2004/2005</p>
            </title>
            <url>http://ratings2005.healthcarecommission.org.uk/Trust/indicator/indicators.asp?trustType=3</url>
         </bibl>
         <bibl id="B2">
            <title>
               <p>Non-attendance at outpatient clinics: is it related to the referral process?</p>
            </title>
            <aug>
               <au>
                  <snm>Lloyd</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Bradford</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Webb</snm>
                  <fnm>S</fnm>
               </au>
            </aug>
            <source>Family practice</source>
            <pubdate>1993</pubdate>
            <volume>10</volume>
            <issue>2</issue>
            <fpage>111</fpage>
            <lpage>117</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1093/fampra/10.2.111</pubid>
                  <pubid idtype="pmpid" link="fulltext">8359599</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B3">
            <title>
               <p>Audit of elderly people's eye problems and non-attendance at hospital eye service</p>
            </title>
            <aug>
               <au>
                  <snm>Hillman</snm>
                  <fnm>JG</fnm>
               </au>
            </aug>
            <source>BMJ</source>
            <pubdate>1994</pubdate>
            <volume>308</volume>
            <issue>6934</issue>
            <fpage>953</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">2539808</pubid>
                  <pubid idtype="pmpid" link="fulltext">8173403</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B4">
            <title>
               <p>Factors influencing non-attendance at child psychiatry out-patient appointments</p>
            </title>
            <aug>
               <au>
                  <snm>Cottrell</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Hill</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Walk</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Dearnaley</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Ierotheou</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>Br J Psychiatry</source>
            <pubdate>1988</pubdate>
            <issue>152</issue>
            <fpage>201</fpage>
            <lpage>204</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1192/bjp.152.2.201</pubid>
                  <pubid idtype="pmpid">3167336</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B5">
            <title>
               <p>Why don't patients take their medicine? Reasons and solutions in psychiatry</p>
            </title>
            <aug>
               <au>
                  <snm>Mitchell</snm>
                  <fnm>AJ</fnm>
               </au>
               <au>
                  <snm>Selmes</snm>
                  <fnm>T</fnm>
               </au>
            </aug>
            <source>Advances in Psychiatric Treatment</source>
            <pubdate>2007</pubdate>
            <volume>13</volume>
            <fpage>336</fpage>
            <lpage>346</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1192/apt.bp.106.003194</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B6">
            <title>
               <p>Are patients' attitudes the cause of long waiting lists?</p>
            </title>
            <aug>
               <au>
                  <snm>Turner</snm>
                  <fnm>AG</fnm>
               </au>
               <au>
                  <snm>Cooke</snm>
                  <fnm>H</fnm>
               </au>
            </aug>
            <source>British journal of clinical practice</source>
            <pubdate>1991</pubdate>
            <volume>45</volume>
            <fpage>97</fpage>
            <lpage>98</lpage>
            <xrefbib>
               <pubid idtype="pmpid">1793715</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B7">
            <title>
               <p>Consultation time, workload, and problems for audit in outpatient clinics</p>
            </title>
            <aug>
               <au>
                  <snm>Partridge</snm>
                  <fnm>JW</fnm>
               </au>
            </aug>
            <source>Archives of disease in childhood</source>
            <pubdate>1992</pubdate>
            <volume>67</volume>
            <issue>2</issue>
            <fpage>206</fpage>
            <lpage>210</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1793413</pubid>
                  <pubid idtype="pmpid">1543380</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B8">
            <title>
               <p>Prospective controlled study of psychiatric out-patient non-attendance. Characteristics and outcome</p>
            </title>
            <aug>
               <au>
                  <snm>Killaspy</snm>
                  <fnm>H</fnm>
               </au>
               <au>
                  <snm>Banerjee</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>King</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Lloyd</snm>
                  <fnm>M</fnm>
               </au>
            </aug>
            <source>Br J Psychiatry</source>
            <pubdate>2000</pubdate>
            <volume>176</volume>
            <fpage>160</fpage>
            <lpage>165</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1192/bjp.176.2.160</pubid>
                  <pubid idtype="pmpid" link="fulltext">10755054</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B9">
            <title>
               <p>Why don't patients attend their appointments? Maintaining engagement with psychiatric services</p>
            </title>
            <aug>
               <au>
                  <snm>Mitchell</snm>
                  <fnm>AJ</fnm>
               </au>
               <au>
                  <snm>Selmes</snm>
                  <fnm>T</fnm>
               </au>
            </aug>
            <source>Advances in Psychiatric Treatment</source>
            <pubdate>2007</pubdate>
            <volume>13</volume>
            <fpage>423</fpage>
            <lpage>434</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1192/apt.bp.106.003202</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B10">
            <title>
               <p>Committee of Public Accounts 42nd Report. National health service outpatients services in England and Wales</p>
            </title>
            <aug>
               <au>
                  <cnm>NHS Audit</cnm>
               </au>
            </aug>
            <publisher>London: Stationery Office</publisher>
            <pubdate>1995</pubdate>
         </bibl>
         <bibl id="B11">
            <title>
               <p>Broken NHS appointments: millions wasted?</p>
            </title>
            <aug>
               <au>
                  <snm>Deitch</snm>
                  <fnm>R</fnm>
               </au>
            </aug>
            <source>Lancet</source>
            <pubdate>1984</pubdate>
            <volume>1</volume>
            <issue>8391</issue>
            <fpage>1419</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0140-6736(84)91924-X</pubid>
                  <pubid idtype="pmpid">6145875</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B12">
            <title>
               <p>Reducing non-attendance at outpatient clinics</p>
            </title>
            <aug>
               <au>
                  <snm>Stone</snm>
                  <fnm>CA</fnm>
               </au>
               <au>
                  <snm>Palmer</snm>
                  <fnm>JH</fnm>
               </au>
               <au>
                  <snm>Saxby</snm>
                  <fnm>PJ</fnm>
               </au>
               <au>
                  <snm>Devaraj</snm>
                  <fnm>VS</fnm>
               </au>
            </aug>
            <source>Journal of the Royal Society of Medicine</source>
            <pubdate>1999</pubdate>
            <volume>92</volume>
            <issue>3</issue>
            <fpage>114</fpage>
            <lpage>118</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1297099</pubid>
                  <pubid idtype="pmpid">10396253</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B13">
            <title>
               <p>Non-attendance in outpatient clinics: guidance for best practice</p>
            </title>
            <aug>
               <au>
                  <cnm>NHS Executive North West</cnm>
               </au>
            </aug>
            <publisher>Department of Health: London</publisher>
            <pubdate>1997</pubdate>
         </bibl>
         <bibl id="B14">
            <title>
               <p>NHS Performance Indicators</p>
            </title>
            <aug>
               <au>
                  <cnm>Department of Health</cnm>
               </au>
            </aug>
            <pubdate>2002</pubdate>
         </bibl>
         <bibl id="B15">
            <title>
               <p>Prompts to encourage appointment attendance for people with serious mental illness</p>
            </title>
            <aug>
               <au>
                  <snm>Reda</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Makhoul</snm>
                  <fnm>S</fnm>
               </au>
            </aug>
            <source>Cochrane Database of Systematic Reviews, Issue 2 Art No: CD002085 DOI: 101002/14651858CD002085</source>
            <pubdate>2001</pubdate>
         </bibl>
         <bibl id="B16">
            <title>
               <p>Does an encouraging letter encourage attendance at psychiatric out-patient clinics? The Leeds PROMPTS randomized study</p>
            </title>
            <aug>
               <au>
                  <snm>Kitcheman</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Adams</snm>
                  <fnm>CE</fnm>
               </au>
               <au>
                  <snm>Pervaiz</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Kader</snm>
                  <fnm>I</fnm>
               </au>
               <au>
                  <snm>Mohandas</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Brookes</snm>
                  <fnm>G</fnm>
               </au>
            </aug>
            <source>Psychol Med</source>
            <pubdate>2008</pubdate>
            <volume>38</volume>
            <issue>5</issue>
            <fpage>717</fpage>
            <lpage>723</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1017/S0033291707001766</pubid>
                  <pubid idtype="pmpid" link="fulltext">17935636</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B17">
            <title>
               <p>Leeds Ahead, South and South East Leeds, Area Background</p>
            </title>
            <url>http://www.leedsahead.com/pages/read/south-leeds</url>
         </bibl>
         <bibl id="B18">
            <title>
               <p>Data Protection Act Section 33(2)</p>
            </title>
            <url>http://www.uk-legislation.hmso.gov.uk/acts/acts1998/19980029.htm</url>
         </bibl>
         <bibl id="B19">
            <title>
               <p>Leeds Ahead, West and North West Leeds, Area Background</p>
            </title>
            <url>http://www.leedsahead.com/pages/read/west-leeds</url>
         </bibl>
         <bibl id="B20">
            <title>
               <p>General Practice Non-Attendance. A Questionnaire Survey</p>
            </title>
            <aug>
               <au>
                  <snm>Hamilton</snm>
                  <fnm>W</fnm>
               </au>
            </aug>
            <publisher>NHS National Research Register</publisher>
            <pubdate>2001</pubdate>
         </bibl>
         <bibl id="B21">
            <title>
               <p>Are randomised controlled trials the only gold that glitters?</p>
            </title>
            <aug>
               <au>
                  <snm>Slade</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Priebe</snm>
                  <fnm>S</fnm>
               </au>
            </aug>
            <source>Br J Psychiatry</source>
            <pubdate>2001</pubdate>
            <volume>179</volume>
            <fpage>286</fpage>
            <lpage>287</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1192/bjp.179.4.286</pubid>
                  <pubid idtype="pmpid" link="fulltext">11581106</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
      </refgrp>
      <sec>
         <st>
            <p>Pre-publication history</p>
         </st>
         <p>The pre-publication history for this paper can be accessed here:</p>
         <p>
            <url>http://www.biomedcentral.com/1471-244X/8/90/prepub</url>
         </p>
      </sec>
   </bm>
</art>
