Skip to main content

Prospective cohort study protocol to evaluate the validity and reliability of the Quality of Trauma Care Patient-Reported Experience Measure (QTAC-PREM)

Abstract

Background

Patient-centeredness is a key component of health care quality. However, patient-centered measures of quality have not been developed in injury care. In response to this challenge, we developed the Quality of Trauma Adult Care Patient-Reported Experience Measure (QTAC-PREM) to measure injured patient experiences with trauma care and pilot-tested the instrument at a single Level 1 trauma centre. The objective of this study is to test the reliability, validity, and feasibility of the QTAC-PREM in multiple Canadian trauma centers and to refine the measure based on the results.

Methods/design

This will be a prospective cohort study of consecutive adult (age ≥ 18 years) patients discharged from three trauma centres in Alberta, Canada with a primary diagnosis of injury. The target sample size is 400 participants to ensure precision for evaluating test-retest reliability. We will assess the psychometric properties of the measure (test-retest reliability, construct validity, internal consistency) and whether these properties vary by patient characteristics. We will also evaluate the predictive validity, convergent validity, and discriminant validity of the measure against other established tools (HCAHPS).

Discussion

A reliable and valid measure of patient reported experiences with injury care may be a valuable tool to evaluate quality of care and guide improvement efforts.

Peer Review reports

Background

The problem: burden of injury and the quality of care

Globally, injuries affect 700 million people each year, including 30 million North Americans [1, 2]. Although healthcare systems provide patients with vital treatment for this major cause of morbidity and death, assessments of the quality of injury care demonstrate that care often fails to meet established standards [3]. Studies show up to half of all critically injured patients do not receive recommended care [4], adverse events are common [5], and injury care may not meet the needs of certain patients. For example, patients with traumatic brain injuries, as well as their families, report deficits in information provided by health care professionals [6].

Measurement is necessary for improvement

In order to improve care, valid and reliable information on the quality of care is necessary. Healthcare professionals and organizations can use quality measurement tools to identify discrete problem areas, to aid in tailoring interventions to correct care issues, and to track subsequent improvements. Healthcare regulators may use quality information to develop quality-monitoring processes, to target inspections, and to document gaps in optimal care.

Measuring patient experiences: a key element to improving care

To date, quality measurement and improvement efforts in injury care have primarily focused on clinical processes and outcomes of care such as risk-adjusted mortality [7]. However, ‘quality’ in healthcare is composed of more than clinical processes and outcomes. Quality of care has been defined by The Institute of Medicine (IOM) as “the degree to which health services for individuals and populations increase the likelihood of desired health outcomes and are consistent with current professional knowledge” [8]. The IOM emphasizes that ‘desired outcomes’ are a composite of patient and clinical goals such that care is patient-centered: respectful of and responsive to individual patient preferences, needs, and values. Therefore, measuring patient care experiences is a central element for assessing and improving the quality of injury care.

Capturing patient perspectives is often achieved with self-administered survey based measures. This approach allows patients to complete the measure when it is convenient for them to do so, and provides respondents time to think about the questions they are asked. Survey based measures are also relatively easy to administer; data can be obtained from large samples relatively quickly, and can be inexpensive.

Survey items measuring patient experiences or satisfaction with care usually consist of a patient-defined expectation or standard of care and an evaluation of the degree to which the expectation or standard was met in the patient’s experience [9]. A key challenge to developing a valid instrument is to identify aspects of care that are relevant to patients’ perceptions of the quality of care. Quality is not composed of a single aspect of care. Valid measures contain multiple care domains that serve as constructs in the patients’ conception of quality. These components of care have been shown to vary across different patient populations [10].

A gap in trauma quality of care measurement and improvement

Patient-centered measures have been developed in select areas of healthcare. For example, the Consumer Assessment of Healthcare Providers and Systems (CAHPS) program (of the U.S. Agency for Healthcare Research and Quality) has developed valid and reliable measures of patient experiences with ambulatory (primary care, home care) and in-hospital medical-surgical (excluding trauma) care [11]. These consumer-assessments of care measures have been used extensively in the United States and have been successfully used to identify deficits in care delivery and support quality improvement [1215]. For example, a study of eight collaborative medical groups focused on patient-centered care in Minnesota successfully used a modified CAHPS survey measure to identify opportunities for care improvement, develop quality improvement interventions, and produce measurable improvements in patient experience [12].

Despite the central importance of patient perspectives of care and the demonstrable value of patient-centered measures, to date there has been limited progress in incorporating patient perspectives into quality measurement in injury care. Only a few instruments have been developed for assessing patients’ experiences or satisfaction with injury services. Many of the studies measuring patient perspectives of quality in injury care have used non-validated measures to assess patient perspectives of specific interventions or injury treatments [1618]. A small number of reliable and valid measures exist, but were developed for specific patient populations (e.g. head injured patients) or specific injury care services (e.g. rehabilitation services) [1719]. For example, surveys of traumatic brain injured patients and their families have highlighted deficits in care related to information and follow-up [6, 20]. While this is an important start to measuring patient experiences with injury care, assessments of the broader population of injured patients are needed. Currently, there are no published measures designed to capture the overall healthcare experiences of patients with major injuries and as a result, it is not possible to comprehensively evaluate the quality of care provided to injured patients they receive.

Measure development

To address this gap in trauma quality improvement we developed the Quality of Trauma Adult Care Patient-Reported Experience Measure (QTAC-PREM) using a comprehensive literature review and focus groups with key trauma stakeholders [21]. The measure is comprised of two components, one to evaluate acute care (hospital) and the other post-acute care (discharge, follow-up). The measure is designed to be completed by patients and evaluate their experiences with injury care. However, because some injured patients (e.g. severe traumatic brain injured patients) cannot complete a survey, we also developed a family member version to allow for proxy measurement of patient experience [22].

Pilot evaluation at a single trauma centre showed the measure to be feasible to implement (81% overall response rate) and provided preliminary evidence of content and construct validity. The pilot study highlighted several areas of care for potential improvement including: caregivers dealing with patient concerns, information about the effect of injuries on the patients’ lives, information about the recovery process, treatment of agitation and anxiety, consideration of personal hygiene and patients’ emotional needs, and inconsistency of information. Additional areas of post-hospital care highlighted for improvement were: information about discharge and home care, and family physicians not receiving hospital discharge information. For the most part, our findings were consistent with studies of patient and family experiences with general hospital care [23], intensive care unit services [24], and injury care [6, 25].

The next step in this research is to evaluate the psychometric properties of the measure in multiple trauma centres. External validation, through a multi-centre study, is needed to ensure the reliability, content validity and construct validity of the measure hold across different settings and different participants. This would increase the generalizability and comparability of the results and thereby increase the value of the measure as a quality improvement tool. A larger validation sample also provides the opportunity to create a short form version of the measure to decrease respondent burden and potentially increase response rates in the future.

The primary objectives of this study are:

Objective 1: To test the psychometric properties (test-retest reliability, construct validity, internal consistency, predictive criterion validity) and feasibility of the Quality of Trauma Adult Care Patient-Reported Experience Measure (QTAC-PREM) in multiple Canadian trauma centers.

Objective 2: To assess whether the construct validity of items varies by patient clinical or demographic characteristics.

Objective 3: To refine the measure based on results of the multi-center study to improve efficiency and usability.

The secondary objectives of this study are:

Objective 4: To assess the correlation between patient survey measure responses and patient family member’s survey measure responses.

Objective 5: To assess the convergent validity of the measure with the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey measure.

Objective 6: To assess the divergent validity of the measure with the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey measure.

Methods/design

Design

This will be a prospective cohort study of consecutive adult (age ≥ 18 years) patients admitted to hospital due to injury. We will sample all patients admitted with a primary injury diagnosis as we want to obtain a comprehensive picture of the quality of injury care. We define injury as “the physical damage that results when a human body is suddenly subjected to energy in amounts that exceed the threshold of physiological tolerance” [26] resulting in admission to hospital.

Recruitment and data collection

Part 1: in-hospital acute care measure

We propose to implement the survey measure at three trauma centres in the province of Alberta. Research coordinators will conduct daily screening of patients admitted for traumatic injuries in conjunction with trauma program coordinators and charge nurses. This study has received approval from the Conjoint Health Research Ethics Board at the University of Calgary (primary site ethics I.D.: E-24364).

Eligible participants will be those admitted to hospital with a primary injury diagnosis. Patients that are unable to understand and consent to study procedures will not be eligible to complete the survey measure themselves. Patient capacity to provide informed consent will be determined using a modified Aid to Capacity Evaluation form (ACE) [27]. If a patient is unable to provide informed consent (e.g. head injury), a family member will be invited to participate by completing the surrogate consent form and survey measure as a surrogate. Family members of patients admitted due to injury will be eligible if they visit their injured relative at least one time in hospital. We will exclude family members of patients who die during their hospital stay.

Participant recruitment and study flow is outlined in Figure 1 and will be conducted according to the following procedure:

  1. 1.

    Research coordinators will conduct daily screening (Monday through Friday) of patients admitted due to injury for whom discharge planning has been initiated (planned discharge within 2 days).

  2. 2.

    Research coordinators will approach eligible patients and family members prior to discharge, describe the study, and invite them to participate. The research coordinators will use the Aid to Capacity Evaluation form [27] to evaluate the capacity of patients for whom there is concern about their ability to provide informed consent. If a patient is unable to provide informed consent (e.g. severely head-injured), one of their family members will be offered participation. If a patient is able to provide informed consent, but would prefer that a family member participant (e.g. too tired, nauseated etc.) one of their family members will be offered participation.

  3. 3.

    Research coordinators will administer one in-hospital acute care survey measure per consenting patient/family. To evaluate the concordance of patient and proxy/family responses a second survey measure will be offered to eligible family members of participating patients (administration of second surveys restricted to coordinating study site).

  4. 4.

    To assess reliability, consecutive participants will be approached to re-complete the survey measure within 24–48 hours of initial survey administration until the required sample is reached (n = 75; ~25 per site).

  5. 5.

    Once we have achieved the sample for the reliability assessment at the coordinating study site (~n = 25) we will initiate one of the site-specific secondary objectives: to assess convergent and divergent validity with the HCAHPS measure. Consecutive patients will be approached at the coordinating study site to complete the HCAHPS measure concurrently with the QTAC-PREM. We aim to administer the HCAHPS to approximately 50 participants.

  6. 6.

    The completed in-hospital acute care survey measure will be sealed in an envelope and numbered with a unique letter/number code.

Figure 1
figure 1

Recruitment flow chart.

Part 2: after-hospital post-acute care measure

Patients/families that complete the in-hospital acute care survey measure will be offered to participate in the post-acute care survey. Consenting patients/families will be contacted by telephone 8–12 weeks post-discharge by an experienced telephone interviewer (NB).

  1. 7.

    A telephone script will be used to:

    1. a)

      Remind patients and family members of the purpose of the study.

    2. b)

      Re-evaluate patient capacity to provide informed consent. Family members of patients previously unable to provide consent in-hospital (e.g. head injured) will be asked about the condition of their recovering relative. If deemed appropriate (i.e. capacity potentially regained), patients will be contacted to assess their capacity to consent (using the modified version of the Aid to Capacity Evaluation tool [27]) and to discuss their willingness to continue participation in the study.

  2. 8.

    The interviewer will record participant answers on a paper copy of the post-acute care measure. Completed survey measures will be linked to participant’s acute care survey measure using unique letter/number codes. To assess test-retest reliability of the post-acute care measure it will be re-administered via telephone interview to consecutive participants 7–10 days after the initial completion until the required sample size is reached (n = 75).

QTAC-PREM

Our measure has undergone multiple revisions based on our pilot-test and cognitive interviews with injured patients and their family members. The acute care measure (Additional file 1) consists of seven domains: communication and information, transfers and patient transport, pain management, comfort, interpersonal care, safety, and equality. This measure includes 35 items: 7 demographic, 1 health status, 4 open-ended, and 23 close ended. The post-acute care measure (Additional file 2) consists of six domains: communication and information, pain management, access, interpersonal care, coordinated care, and safety. This measure includes 22 items: 3 open-ended and 19 close-ended. This measure uses screening questions to determine which set of items participants will be asked. Participants only answer questions about care they have received.

Sample size

Our sample size is based on ensuring precision for test-retest reliability. Previous validation studies on similar populations found survey item correlation estimates to be in the range of 0.65 to 0.85 [28]. A test-retest sample size of 75 with an intra-class correlation (ICC) of 0.75 corresponds to 95% CI width of +/- 0.10. We will conduct re-tests on 25% of participants (both for the acute care and post-acute care survey measures), estimate that 25% of participants will decline requests for re-tests, and therefore, estimate the need to recruit approximately 400 participants.

Data analysis

Objective 1

  1. i)

    We will assess test-retest reliability by calculating Pearson correlation coefficients at the level of individual items and for each composite domain.

  2. ii)

    Confirmatory factor analysis will be performed to assess construct validity by determining if items load adequately (factor loadings >0.3) [29, 30] onto a domain category. To perform this analysis individual binary and categorical item scores will be transformed to linear values on the standard normal distribution.

  3. iii)

    Corrected item-to-total correlation coefficients will be calculated between each item and both the domain and global item score to assess construct validity.

  4. iv)

    Internal consistency analyses will be conducted on the factors resulting from confirmatory factor analysis. We will determine the consistency of items within each factor by examining Cronbach’s α coefficients for each domain and across the entire set of items. To perform this analysis, item scores will be transformed to linear values on the standard normal distribution.

  5. v)

    We will examine predictive criterion validity of both the acute care measure and post-acute care measure in two ways:

    1. a)

      We will use ordinal regression to determine if the individual item scores are related to the scores of the global rating items. Individual items will be used as explanatory variables and the 0–10 global rating scales will be treated as ordinal outcome data.

    2. b)

      We will use ordinal regression to determine if the scores on the composite subscales (domains) are related to the scores of the global rating items. Individual item scores will be transformed to values on the standard normal distribution. A mean of the item scores will be calculated for each subscale and used as the summary subscale value. Missing values will be replaced by substitution of the mean value (sensitivity analysis will be performed using complete cases). The 0–10 global rating scales will be treated as ordinal outcome data.

vi) We will examine predictive criterion validity using two additional approaches for the acute care measure:

  1. a)

    We will use ordinal regression to determine if the injury care global rating score on the acute care measure is related to the injury care global rating score on the post-acute care measure.

  2. b)

    We will use multiple logistic regression to determine if subscale scores or the global rating scores on the acute care measure predict whether patients register formal hospital complaints or compliments. Subscale scores will be calculated by taking a linear mean of item scores after converting them to values on the standard normal distribution. The injury care global rating score will be treated as ordinal data. Registration of a formal complaint or compliment will be treated as a binary outcome (yes/no).

vii) We will examine the survey response rate (percentage of respondents who completed the measure among all those approached to participate in the study) to determine if implementing the measure is feasible in multiple trauma centres.

Objective 2

We will re-run the factor analysis using subgroup categories to determine if the factor structure varies by key patient characteristics. Differences will be determined by examining the pattern of loading/non-loading (>0.3 vs <0.3 respectively) [29, 30] in each group. Given the sample size requirements for factor analysis (about 10 participants per item is expected) [29, 30] it may only be possible to examine select characteristics. We will first analyze sex (male vs. female) and injury severity score (minor injury ISS <15 vs. major injury ISS >15). Secondary analysis will be performed on the following demographic variables if sample size permits: ethnicity, age, length of hospital stay, education level, and need for surgery or intensive care during hospital stay [31].

Objective 3

Item reduction will be based on principal axis factor analysis assessments of internal consistency. Redundant items (item-scale Cronbach’s α >0.8) [32] and items that do not adequately load on a factor (factor loadings <0.3 in principal axis factor analysis) [29, 30] will be eliminated.

Item scores will be transformed to linear values on the standard normal distribution for objectives 4-6 [33].

Objective 4

We will calculate intraclass correlation coefficients to determine the degree of concordance between patient survey measure responses and their family member’s survey measure responses.

Objective 5

Assessments of convergent validity will be based on intraclass correlation coefficients calculated between domains on the patient experiences measure and the HCAHPS survey measure. A coefficient of 0.9 will be the cut-off for collinearity [34].

Objective 6

Assessments of divergent validity will be based on intraclass correlation coefficients calculated between domains on the patient experiences measure and the HCAHPS survey measure. A coefficient of 0.4 will be the cut-off for collinearity [35].

The open-ended responses on the survey measure will be qualitatively analyzed. We will use a mixed inductive/deductive thematic analysis to identify major themes of patient experiences with injury care. This will include both the data-drive inductive approach outlined by Boyatzis [36] and the use of an a priori coding framework in the deductive approach outlined by Crabtree and Miller [37].

To assess non-response bias we will compare respondents’ characteristics to the average characteristics of the injury population admitted during the same time frame in each institution. Differences will be assessed using Students t-test and Mann–Whitney U comparisons.

Discussion

Implications

We believe a reliable and valid measure will be a valuable tool to evaluate patient experiences with injury care and guide quality improvement efforts.

If the measure is found to have desirable levels of validity and reliability, we will eliminate redundant items and begin to plan a multi-center study to assess patient experiences with injury care. Additional inquiry would be focused on two areas of investigation. First, to study the relationship between patient experiences of injury care and important patient outcomes including patient quality of life post-injury, hospital readmission after discharge (for an issue related to the initial injury), and primary care utilization after discharge. Second, to examine the relationship between patient reported experiences of care and clinical measures of care quality (Santana MJ, Stelfox HT, Straus S: Development and evaluation of the evidence-informed quality indicators for adult injury care, forthcoming).

If the measure is found not to have desirable levels of validity and reliability we will identify specific deficits and pursue appropriate revisions. If issues with validity are identified we will revise the measure’s content and items using small focus groups with injury patients and family members to ensure we are addressing priority aspects of injury care for patients. To address issues of reliability we will conduct cognitive interviews with patients to improve the clarity of items and consistency of item interpretation.

Potential limitations and challenges

There are a few potential limitations to the proposed study. First, there is the possibility of response bias. We will assess non-response bias by comparing respondents’ characteristics to the average characteristics of the injury population admitted to each institution during the same time frame as data collection. A second limitation is that we will not sample family members of patients that died during their hospital stay. As a result, a modified QTAC-PREM will need subsequent evaluation in this population. A third limitation is the possibility of social desirability bias, a common threat to measure validity [38, 39]. It is possible that completion of the measure in-hospital may lead to increased social desirability bias compared to mail-out survey measures. However, this issue must be balanced against the problem of recall bias, as well as feasibility. We selected in-hospital administration to reduce recall bias and to improve response rate; studies show response rates are often lower for mail-out surveys than on-site administration [40]. However, an additional limitation with administering surveys prior to discharge is that we may miss key aspect of care during the discharge process. To mitigate this we have included items about the discharge process in the post-acute care measure. A fourth limitation is our inability to quantify the agreement between surrogate responses and those of patients with severe traumatic brain injuries. This is an unavoidable limitation given the involvement of patients who do not have capacity to provide informed consent. Although we cannot be sure how accurate surrogate responses are of the perspectives of patients with severe traumatic brain injury, we may obtain an estimate by examining agreement between responses of patients with minor traumatic brain injury and those of one of their family members.

We foresee at least one key challenge to this study: the possibility of slow recruitment. This will be partially dependent on the volume of trauma patients passing through each centre. However, to ensure efficient recruitment of admitted trauma patients we have developed a detailed recruitment package to be used by research coordinators at each site. This package includes dialogue excerpts that were used during a previous pilot-testing phase that resulted in over 85% response rates in-hospital. In addition, one of the team members (NB) will conduct site visits to address recruitment concerns of research coordinators and ensure consistency in the recruitment strategy across the recruiting sites.

Conclusion

We propose to conduct a prospective cohort study to evaluate the reliability and validity of the Quality of Trauma Adult Care Patient Reported Experience Measure (QTAC-PREM). This is the first survey measure designed to capture patient experiences with acute and post-acute injury care. If the measure is found to have acceptable levels of validity and reliability it may be a valuable tool to evaluate patient experiences with injury care and guide quality improvement efforts.

References

  1. Public Health Agency of Canada: Facts on Injury, Injury Section, Health Surveillance and Epidemiology Division. 2012, Canada: Public Health Agency of Canada, Government of Canada, http://www.phac-aspc.gc.ca/injury-bles/facts-eng.php. Accessed April 11, 2012

    Google Scholar 

  2. Murray CJ, Loped AD: Global health statistics: a compendium of incidence, prevalence and mortality estimates for over 200 conditions. 1996, Boston, MA: Harvard School of Public Health

    Google Scholar 

  3. Committee on Quality of Health Care in America, Institute of Medicine: Crossing the Quality Chasm: A New Health System for the 21st Century. 2001, Washington DC: National Academy Press

    Google Scholar 

  4. Rhodes M, Maier RV: Trauma performance improvement. Injury Control. Edited by: Rivara FP, Cummings P, Koepsell TD, Grossman DC, Maier RV. 2001, Cambridge: Cambridge University Press, 236-249.

    Google Scholar 

  5. Davis JW, Hoyt DB, McArdle MS, Mackersie RC, Shackford SR, Eastman AB: The significance of critical care errors in causing preventable death in trauma patients in trauma system. J Trauma. 1991, 31: 813-8. 10.1097/00005373-199106000-00012. discussion 8–9

    Article  CAS  PubMed  Google Scholar 

  6. McMordie WR, Rogers KF, Barker SL: Consumer satisfaction with services provided to head-injured patients and their families. Brain Inj. 1991, 5: 43-51. 10.3109/02699059108998510.

    Article  CAS  PubMed  Google Scholar 

  7. Stelfox HT, Bobranska-Artiuch B, Nathens A, Straus SE: Quality indicators for evaluating trauma care: a scoping review. Arch Surg. 2010, 145 (3): 286-95. 10.1001/archsurg.2009.289.

    Article  PubMed  Google Scholar 

  8. Haas B, Poon V, Waller B, Sidhom P, Fortin C: National Trauma Registry 2011 Report: Hospitalizations for Major Injury in Canada, 2008-2009 Data. Canadian Institute for Health Information. 2012, Accessed on Oct 1, 2012 at: https://secure.cihi.ca/free_products/NTR_CDS_2008_2009_Annual_Report.pdf

    Google Scholar 

  9. Sitzia J: How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999, 11 (4): 319-328. 10.1093/intqhc/11.4.319.

    Article  CAS  PubMed  Google Scholar 

  10. Swaine BR, Pless IB, Friedman DS, Montes JL: Using the measure of processes of care with parents of children hospitalized for head injury. Am J Phys Med Rehabil. 1999, 78 (4): 323-329. 10.1097/00002060-199907000-00006.

    Article  CAS  PubMed  Google Scholar 

  11. Consumer Assessment of Healthcare Providers and Systems (CAHPS) Surveys and Guidance. : , Access on 25/04/2012. Available at http://qualitymeasures.ahrq.gov/browse/by-organization-indiv.aspx?orgid=29

  12. Davies E, Shaller D, Edgman-Levitan S: Evaluating the use of a modified CAHPS survey to support improvements in patient-centred care: lessons from a quality improvement collaborative. Health Expect. 2008, 11: 160-76. 10.1111/j.1369-7625.2007.00483.x.

    Article  PubMed  Google Scholar 

  13. Draper M, Cohen P, Buchan H: Seeking consumer views: what use are results of hospital patient satisfaction surveys?. Int J Qual Health Care. 2001, 13 (6): 463-8. 10.1093/intqhc/13.6.463.

    Article  CAS  PubMed  Google Scholar 

  14. Gilles RR, Shortell SM, Casalino L, Robinson JC, Rundall TG: How different is California? A comparison of US physician organizations. Health Affairs Millwood. 2003, http://content.healthaffairs.org/content/early/2003/10/15/hlthaff.w3.492.citation.

    Google Scholar 

  15. Richards N, Coulter A: Is the NHS becoming more patient-centered? Trends from the national surveys of NHS patients in England 2002–07. 2007, Oxford: Picker Institute, http://www.pickereurope.org/Filestore/PIE_reports/project_reports/ Trends_2007_final.pdf

    Google Scholar 

  16. Nyberg SM, Waswick W, Wynn T, Keuter K: Midlevel providers in a Level I trauma service: experience at Wesley Medical Center. J Trauma. 2007, 63 (1): 128-34. 10.1097/01.ta.0000221765.90190.73.

    Article  PubMed  Google Scholar 

  17. Boulanger B, Kearney P, Ochoa J, Tsuei B, Sands F: Telemedicine: a solution to the follow-up of rural trauma patients?. J Am Coll Surg. 2001, 192 (4): 447-52. 10.1016/S1072-7515(01)00796-7.

    Article  CAS  PubMed  Google Scholar 

  18. Fanta K, Cook B, Falcone RA, Rickets C, Schweer L, Brown RL, Garcia VF: Pediatric trauma nurse practitioners provide excellent care with superior patient satisfaction for injured children. J Pediatr Surg. 2006, 41 (1): 277-81. 10.1016/j.jpedsurg.2005.10.049.

    Article  PubMed  Google Scholar 

  19. Swaine BR, Dutil E, Demers L, Gervais M: Evaluating clients’ perceptions of the quality of head injury rehabilitation services: development and validation of a questionnaire. Brain Inj. 2003, 17 (7): 575-587. 10.1080/0269905031000088568.

    Article  PubMed  Google Scholar 

  20. Thomsen IV: The patient with severe head injury and his family. A follow-up study of 50 patients. Scand J Rehabil Med. 1974, 6: 180-3.

    CAS  PubMed  Google Scholar 

  21. Bobrovitz N, Santana M, Ball C, Kortbeek J, Stelfox HT: The development and testing of a survey to measure patient and family experiences with injury care. Journal of Trauma and Acute Care Surgery. 2012, 73 (5): 1332-9. 10.1097/TA.0b013e31825c4d57.

    Article  PubMed  Google Scholar 

  22. Stricker KH, Kimberger O, Brunner L, Rothen H: Satistfaction with care in the intensive care unit: can we rely on proxies?. The Acta Anaesthesiologica Scandinavica Foundation. 2011, 55 (2): 149-56. 10.1111/j.1399-6576.2010.02293.x.

    Article  CAS  Google Scholar 

  23. Jha AK, Orav JE, Zheng J, Epstein AM: Patients’ perception of hospital care in the United States. N Engl J Med. 2008, 359 (18): 1921-31. 10.1056/NEJMsa0804116.

    Article  CAS  PubMed  Google Scholar 

  24. Heyland DK, Rocker GM, Dodek PM, Kutsogiannis DJ, Konopad E, Cook DJ, Peters S, Tranmer JE, O’Callaghan CJ: Family satisfaction with care in the intensive care unit: results of a multiple center study. Crit Care Med. 2002, 30 (7): 1413-18. 10.1097/00003246-200207000-00002.

    Article  PubMed  Google Scholar 

  25. Jansenn C, Ommen O, Neugebauer E, Lefering R: How to improve satisfaction with hospital stay of severely injured patients. Langenbecks Arch Surg. 2007, 392: 747-60. 10.1007/s00423-007-0186-1.

    Article  Google Scholar 

  26. International statistical classification of diseases and related health problems, tenth revision. Volume 1: Tabular lists; Volume 2: Instruction manual; Volume 3: Index. 1992-1994, Geneva: World Health Organization

  27. Etchells E, Darzins P, Silberfeld M: Assessment of patient capacity to consent to treatment. J Gen Intern Med. 1999, 14: 27-34. 10.1046/j.1525-1497.1999.00277.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Heyland DK, Tranmer JE: Measuring Family Satisfaction with Care in the Intensive Care Unit: The Development of a Questionnaire and Preliminary Results. J Crit Care. 2001, 16 (4): 142-149. 10.1053/jcrc.2001.30163.

    Article  CAS  PubMed  Google Scholar 

  29. Floyd FJ, Widaman KF: Factor Analysis in the Development and Refinement of Clinical Assessment Instruments. Psychol Assessment. 1995, 7 (3): 286-299.

    Article  Google Scholar 

  30. Kline TJB: Psychological Testing: A practical approach to design and evaluation. 2005, Thousand Oaks, CA: Sage

    Book  Google Scholar 

  31. Committee on Trauma American College of Surgeons: Resources for Optimal Care of the Injured Patient. 2006, Saint Clair St., Chicago: American College of Surgeons

    Google Scholar 

  32. Tabachnick BG, Fidell LS: Using Multivariate Statistics. 2006, Needham Heights, MA, USA: Allyn & Bacon, Inc, 5

    Google Scholar 

  33. Moore D, McCabe GP, Craig B: Introduction to the Practice of Statistics. 2007, New York: Freeman & Co

    Google Scholar 

  34. Heyland DK, Jiang X, Day AG, Cohen SR, Canadian Researchers at the End of Life Network (CARENET): The Development and Validation of a Shorter Version of the Canadian Health Care Evaluation Project Questionnaire (CANHELP Lite): A Novel Tool to Measure Patient and Family Satisfaction With End-of-Life Care. J Pain Symptom Manage. 2012, Epub Ahead of Print

    Google Scholar 

  35. Defossez G, Mathoulin-Pelissier S, Ingrand I, Gasquet I, Sifer-Riviere L, Ingrand P, Salamon R, Migeot V: REPERES research network: Satisfaction with care among patients with non-metastatic breast cancer: development and first steps of validation of the REPERES-60 questionnaire. BMC Cancer. 2007, 16 (7): 129.

    Article  Google Scholar 

  36. Boyatzis R: Transforming qualitative information: Thematic analysis and code development. 1998, Thousand Oaks, CA: Sage

    Google Scholar 

  37. Crabtree B, Miller W: A Template Approach to Text Analysis: Developing and Using Codebooks. Doing qualitative research. Edited by: Crabtree B, Miller W. 1999, Newbury Park, CA: Sage, 163-177.

    Google Scholar 

  38. Kinnersley P, Stott N, Peters T, Harvey I, Hackett P: A Comparison of Methods for Measuring Patient Satisfaction with Consultations in Primary Care. Fam Pract. 1996, 13 (1): 41-51. 10.1093/fampra/13.1.41.

    Article  CAS  PubMed  Google Scholar 

  39. de Vries H, Elliott MN, Hepner KA, Keller SD, Hays RD: Equivalence of Mail and Telephone Responses to the CAHPS Hospital Survey. Health Serv Res. 2005, 6 part 2: 2120-2139.

    Article  Google Scholar 

  40. Gribble RK, Haupt C: Quantitative and qualitative differences between handout and mailed patient satisfaction surveys. Med Care. 2005, 43 (3): 276-281. 10.1097/00005650-200503000-00010.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgments

We acknowledge Dr. Sandy Widder, Dr. Kevin Martin, Yvonne Tul, and Theresa Pasquotti for agreeing to help with survey administration at the University of Alberta Hospital and Chinook Regional Hospital.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Henry T Stelfox.

Additional information

Competing interests

The project is supported by a Partnerships in Health System Improvement Grant (PHE-238551) from the Canadian Institutes of Health Research and Alberta Innovates. Nik Bobrovitz is supported by a Health Quality Council of Alberta Studentship and an Alberta Innovates Health Solutions Studentship. Dr. Stelfox is supported by a New Investigator Award from the Canadian Institutes of Health Research and a Population Health Investigator Award from Alberta Innovates. Funding sources will have no role in the design of this study and will have no role in the conduct or reporting of this study. We are unaware of any conflicts of interest. None of the authors have financial or professional conflicts of interest that would influence the conduct or reporting of this study.

Authors’ contributions

NB, MS, TK, JK, and HTS contributed to the design of this study. NB and HTS drafted the manuscript. NB, MS, TK, JK, and HTS contributed critical revisions of this manuscript and gave final approval of this version of the manuscript for publication. NB will acquire the data. NB, MS, TK, JK, and HTS will be involved in the analysis and interpretation of the data. All authors read and approved the final manuscript.

Electronic supplementary material

12913_2013_2532_MOESM1_ESM.doc

Additional file 1: Quality of Trauma Care Patient-Reported Experience Measure (QTAC-PREM). Part 1: Acute Care, Patient Survey. (DOC 351 KB)

12913_2013_2532_MOESM2_ESM.doc

Additional file 2: Quality of Trauma Care Patient-Reported Experience Measure (QTAC-PREM). Part 2: Post-Acute Care, Patient Survey. (DOC 320 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Bobrovitz, N., Santana, M., Kline, T. et al. Prospective cohort study protocol to evaluate the validity and reliability of the Quality of Trauma Care Patient-Reported Experience Measure (QTAC-PREM). BMC Health Serv Res 13, 98 (2013). https://doi.org/10.1186/1472-6963-13-98

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6963-13-98

Keywords