We used a validated inpatient satisfaction questionnaire to evaluate the health care received by patients admitted to several hospitals. This questionnaire was factored into distinct domains, creating a score for each to assist in the analysis.
We evaluated possible predictors of patient satisfaction in relation to socio-demographic variables, history of admission, and survey logistics.
Cross-sectional study of patients discharged from four acute care general hospitals. Random sample of 650 discharged patients from the medical and surgical wards of each hospital during February and March 2002. A total of 1,910 patients responded to the questionnaire (73.5%). Patient satisfaction was measured by a validated questionnaire with six domains: information, human care, comfort, visiting, intimacy, and cleanliness. Each domain was scored from 0 to 100, with higher scores indicating higher levels of patient satisfaction.
In the univariate analysis, age was related to all domains except visiting; gender to comfort, visiting, and intimacy; level of education to comfort and cleanliness; marital status to information, human care, intimacy, and cleanliness; length of hospital stay to visiting and cleanliness, and previous admissions to human care, comfort, and cleanliness. The timing of the response to the mailing and who completed the questionnaire were related to all variables except visiting and cleanliness. Multivariate analysis confirmed in most cases the previous findings and added additional correlations for level of education (visiting and intimacy) and marital status (comfort and visiting).
These results confirm the varying importance of some socio-demographic variables and length of stay, previous admission, the timing of response to the questionnaire, and who completed the questionnaire on some aspects of patient satisfaction after hospitalization. All these variables should be considered when evaluating patient satisfaction.
The number of patient satisfaction questionnaires has proliferated over the last decades as tools to measure health care from the patients' perspective [1-3]. One common target group has been patients admitted to a hospital, because admission can be a stressful and dissatisfying experience for many people and because of the high health care costs that an admission to a health care system entails.
As with other measurement instruments, patient satisfaction questionnaires must be tested for validity and reliability . These are basic properties that researchers try to show for their instruments. Beyond these, other possible sources of bias may arise when collected data must be analyzed.
Questionnaires can be completed by different methods: self-reporting, face-to-face interviewing, phone interviewing, or most recently by computer. The self-reporting method requires that the questionnaire is given to the patient at a specific time point, either personally, by mail, or by Internet. Although the Internet may become a frequent way of providing and completing questionnaires , in many countries this is either rare or used by a very homogeneous and different group of people from the general population. This explains why mailing is still a frequent method of delivering questionnaires to selected individuals . A major problem and source of bias are patients who do not complete the questionnaire . In order to minimize the number of missing people, researchers typically send reminders, up to two or three, after the first mailing. Additionally, they might contact by phone those who do not respond to try to encourage them to answer the questionnaire, although this is an additional source of bias that has already been studied .
Patients admitted to hospitals are generally old and in some cases have different handicaps or functional limitations that prevent or make it difficult for them to complete a questionnaire. For this reason, the interviewed patient may enlist the help of a relative or friend to answer the questionnaire, and this could be a source of bias .
In 2002, we used a validated inpatient satisfaction questionnaire to evaluate the health care received by patients admitted to several hospitals . As an advantage over other questionnaires, we had factored it into distinct domains, creating a score for each to assist in the analysis We used a self-reported version of the questionnaire delivered by mail and allowed patients to complete them personally or with the help of a relative or friend, with the stipulation that they indicate who completed it. One of the purposes of this study was to determine and evaluate possible predictors of satisfaction in relation to the more commonly studied socio-demographic variables, as well as the admission history and survey completion logistic variables.
Various sources and methods were used to determine the questions to be included in the questionnaire. First, a literature search was undertaken between January and April 2000, using MEDLINE and PSYCLIT databases, that aimed to analyze the instruments that had been devised so far to evaluate inpatient satisfaction at the national and international levels.
Second, eight focus groups were conducted with patients and two with health care professionals to explore opinions about the most positive and negative aspects of care received during the course of a hospital stay. These focus groups were geared towards understanding the issues and recording expressions that could be used to develop questions to be included in the questionnaire.
Thirdly, the research team developed a pool of question items, in relation to the literature and focus groups, to be included in the questionnaire. These items were shown to a group of patients and health professionals, who provided their opinions about the appropriateness of the items and the ability to comprehend them and evaluated the content and face validity of the questions. An initial version of the questionnaire was created, which was evaluated in a pilot study, to analyze the comprehensibility and clarity of the items and features related to the psychometric properties of the instrument. The results of the pilot study led to an amended questionnaire, i.e., the instrument used during the fieldwork described in the current study.
The final questionnaire included 34 questions, which follow in chronologic order the steps from the time the patient is admitted to hospital until discharge . The questionnaire included six domains: information and communication with doctors (12 items), nursing care (8 items), comfort (6 items), visiting (4 items), privacy (2 items), and cleanliness (2 items) (See 1-Appendix I). The response scale that we used had a varied number of options, ranging from three to six. The scores for each domain were calculated by adding the answers to all the items in each domain. A linear transformation then was carried out, so that the scoring scale for each domain was standardized between 0 and 100, with a score of 100 indicating the highest level of satisfaction. The questionnaire also contained sociodemographic variables, including age, sex, educational level, professional status, and marital status.
Additional file 1. Summary of the questions included in the patient satisfaction questionnaire. Short description of the data: questions included in the questionnaire, for each of the six domains that were obtained in the validation study; these questions have been summarized and listed in the file.
Format: DOC Size: 21KB Download file
This file can be viewed with: Microsoft Word Viewer
The study was conducted among patients admitted to one of four general acute hospitals in the Basque Health Care Service. The hospitals were selected because of their different geographic locations.
Adults 18 years and older were included if they had remained in the hospital longer than 48 hours. Patients admitted to the Neurology Department were excluded because a high percentage had pathologies of the central nervous system (such as cerebrovascular disease) that could hinder or prevent participation in the study. Patients with serious physical or mental pathologies, such as terminal disease and psychosis, which could make the comprehension and completion of the questionnaire difficult, also were excluded, as were patients whose destination after hospital discharge differed from their usual residence, given the difficulties associated with locating them.
All study participants signed a consent form. The study was in compliance with the Helsinki Declaration and the Research Committees of the participant hospitals gave approval to the study.
A random sample of 650 patients who had been discharged between February and March 2002 was contacted for each hospital. Two weeks after discharge, the selected patients received the questionnaire with a prepaid return envelope. A cover letter also was attached that explained the reasons for conducting the survey, encouraged their participation, and guaranteed data confidentiality. A follow-up letter was sent to non-responders 2 weeks later. If they still had not returned the questionnaire 15 days after the first reminder, they received a third letter with a new copy of the questionnaire. The response rate obtained using this method was 73.5%.
Descriptive statistics, including frequencies, percentages, means and standard deviations (SDs), were calculated for the socio-demographic variables. For comparisons between respondents and non-respondents on those variables where we had information, we used a Chi-square test for categorical variables and a t-test or the non-parametric Wilcoxon for continuous variables.
In the univariate analysis, we studied the relationships among the selected sociodemographic variables, the history of current and previous admissions, and survey completion logistics variables with the six dimensions of the questionnaire.
We also compared sociodemographic variables, the history of current admissions, and survey completion logistics variables based on the time of the response to the mailing. The Student t test, or analysis of variance (ANOVA), with the Scheffe's method for multiple comparisons, or the Kruskal-Wallis test was used for continuous variables, and the Chi-square test or Fisher's exact probability test for categorical variables. Patient satisfaction scores were also compared by time of response to mailing controlling by person who responded, using the analysis of variance (ANOVA), with the Scheffe's method for multiple comparisons, or the Kruskal-Wallis test.
Finally, general linear models were used to analyse differences in satisfaction scores according to time of response to mailing adjusted by the socio-demographic variables. In all cases, we considered the first mail respondents as the reference group.
In all analyses, P < 0.05 was considered statistically significant. All statistical analyses were performed using SAS for Windows statistical software, version 8.0.
The mean age of the participants was 62.2 years old; 54.3% were men, 68.3% were married or cohabitating, and 54.1% had only a primary education level. Of the 73.5% that participated in the study, 52.4% responded to the first mailing, 27.2% to the first reminder, and 20.4% to the second reminder (Table 1). Those who did not respond were a mean of 63 years old and 48.3% were women, but these differences were not significantly different. We found non-respondents significantly more likely to be emergency admissions in medical, rather than surgical, specialties, discharged to a place other than their normal residence, and a with a higher mean length of stay The univariate analysis of the selected variables showed their relationship with the scores of our satisfaction questionnaire (Table 2). We found that age was statistically correlated with all domains except the visiting domains, with higher satisfaction scores related to increasing age. Gender was related to comfort, visiting and intimacy, with men expressing higher satisfaction. Level of education was only related to comfort and cleanliness, with higher satisfaction among those with no schooling or a primary education level of studies. Marital status was correlated with the information, human care, intimacy, and cleanliness domains, with those married or cohabitating having higher scores except for the cleanliness domain. Shorter length of stay showed more satisfaction with visiting and cleanliness. Those admitted previously showed lower satisfaction with human care, comfort and cleanliness. Patients who responded to the 1st mailing expressed higher satisfaction than those who responded to the 2nd or 3rd mailings, with Information, Human Care, Comfort and Intimacy. Finally, the variable "who responds to the questionnaire" revealed that those who responded alone expressed higher satisfaction with information, human care, comfort and intimacy.
Table 1. Sociodemographic data of the total sample
Table 2. Univariate analysis by relevant variable
We checked whether there were differences by time of response to the mailing for different variables (Table 3) and we found this was significant for age, marital status and who completed the questionnaire; i.e. later response was more likely by older patients, widowed and those who needed help to answer the questionnaire. There were no discernible differences by gender, level of studies, or working status.
Table 3. Descriptive statistics by mailing
When evaluating the questionnaire satisfaction scores based on the time of response to the mailings and who responded to them, we observed that those who completed the questionnaire with help systematically had lower scores than those who responded themselves (Table 4). Statistically significant differences differences were found in the three mailings and for the information, human care, comfort, and intimacy domains but not for the visiting and cleanliness domains either for those who responded themselves or with help. A trend toward higher satisfaction was found for those who responded early and a trend toward lower satisfaction was found for those who responded later for those who responded themselves or with help.
Table 4. Mean patient satisfaction scores by response to mailing times and person who responds
We also studied the effect of the previous variables on the satisfaction scores after adjustment by all variables (Table 5) in a multivariate model. Age was significantly related to all domains with higher scores increasing with age. Gender showed similar results as in the univariate analyses. The level of education was related to visiting, intimacy, and cleanliness, with those with no education or primary studies having higher scores. Marital status was related to information, with higher scores for married patients; single or divorced individuals had higher scores for comfort, visiting, and cleanliness. Length of stay related to comfort, visiting and cleanliness, with lower scores for those with longer length of stay. Previous admissions related to information, human care, comfort, visiting and cleanliness, with lower scores for those with more than four previous admissions. Lower scores were also found for respondents to the 2nd and 3rd mailings, compared with the 1st mailing, for Information and Human Care, and specifically from the 3rd mailing compared with the 1st mailing for Comfort, Intimacy and Cleanliness. In all cases, a decrease in the scores is seen from the 2nd to the 3rd mailing. Finally, those who responded with help had lower scores on information, human care, comfort, intimacy and cleanliness. The R2 of each domain model also was estimated, and ranged between 0.028 (visiting) to 0.084 (comfort).
Table 5. Multivariate analysis by relevant variables
Our study showed that age, education level, marital status, sex, work status, length of stays, and previous admissions affected the scores of the six domains in the satisfaction questionnaire. Some variables had been studied previously, but to the best of our knowledge, the full range of variables included in this article had not been studied together in multivariate analyses for the different domains of a validated satisfaction questionnaire and with a large sample size. The validity of our satisfaction questionnaire was discussed previously and showed acceptable results. Nevertheless, to avoid bias we outlined two methodologic aspects: the reminders needed before a patient answered the questionnaire and if the patient completed the questionnaire or did so with the assistance of someone else.
As in previous studies, we showed that older patients tended to have higher satisfaction scores in all areas of our questionnaire [11,12]. Similarly, those with no education or only primary education had higher satisfaction scores. Marital status traditionally has been included in this kind of study , and usually, those married or cohabitating tended to have higher satisfaction scores, but in our study those who were single or divorced had higher satisfaction scores in the comfort, visiting, and cleanliness domains. In contrast to other studies , our results showed that men tended to have higher satisfaction scores than women, as in others [14,15]. We also studied the influence of the working status of our respondents but, unlike others , we did not find that this variable had any influence on our sample patient satisfaction. This can be due, in our case, to the fact that there was little variability since most male respondents had retired and most women were working at home. We did not evaluate if the type of insurance had any influence since 100% of our patients were covered by the public National Health System.
The longer the length of stay of the index admission studied, the lower the satisfaction on specific domains such as comfort, visiting, and cleanliness, which seemed logical, as in other studies . However, studies of mental health services have found the opposite to be true , and those seem to be areas more likely conditioned by a long stay. In addition, we found that patients who already had had a previous hospital admission tended to be more demanding or critical and have lower satisfaction levels on relevant areas such as information or human care, comfort, visiting, or cleanliness.
Two main aspects of the logistics of a self-administered patient questionnaire were studied here: the effect of the time when the patient responded to our mailings, with those who responded to a second or third reminder having lower levels of satisfaction; and who complete the questionnaire, the patient or someone else. The latter had the worse scores on all domains of the satisfaction questionnaire, except for the visiting domain. These logistic aspects also have been studied previously[6,8] not finding the later differences among delay on response and patients' satisfaction, but this could be due to the small sample size included in that study compared to ours (between 78 to 254 patients depending on the time when the patient responded to their mailings), little lower response rate, the design of the study, and the use of different satisfaction questions, though they found a tendency similar to ours in the decline in their satisfaction levels. But so many determinants of the satisfaction of hospitalized patients have not been studied globally together in multivariate models. The current study provides valuable information on the effect of all variables on the different domains that constitute our patient satisfaction tool. Therefore, we provide a more complete picture of the determinants of the satisfaction of the various domains.
The different studies that have evaluated the effect of the previous sociodemographic variables , previous admission experience , the length of hospitalization , and survey logistics showed, in some cases, contradictory results.
Studies of the impact of reminders on the results of patient satisfaction surveys are contradictory: some have shown that reminders affect the patients' responses , as in our study, while others did not show that effect .
Patient satisfaction can be measured in different ways. Among them, the use of surveys has been a common way of conducting patient satisfaction studies. The forms of administration of the survey, that is, self-administration, personnel interview, or a phone interview, have been evaluated in different studies[6,20]. However, the effect of who completed the questionnaire has been studied less often. We showed in the current study that who completed the questionnaire has an important effect on the results, in that a more negative satisfaction level was recorded on those surveys answered by someone other than the patient.
The limitations of this study include the type of design chosen (descriptive) and the inevitable non-responders. As in previous studies [21,22], the R2 values were low, indicating room for improving the prediction of patient satisfaction with other variables not included here. In addition, the range of possible explicative variables included in this study, although large, was not as exhaustive as we would have wished. Several other variables have been evaluated previously that also showed a relationship with patient satisfaction, as the previous health status or hospital characteristics. However, we would theoretically expect most explanation to be given by the differences in health care experiences, rather than the characteristics of the patients and their method of responding to a survey.
We concluded that, as in previous studies, there is evidence that patient sociodemographic characteristics affect patient satisfaction levels. In addition, it is logical that previous admissions and the length of the current admission also affect the patient response. Also, depending on the manner in which the survey was administered, the mail interview method may obtain high response rates when using reminders, but those reminders affect the patient responses. Finally, we must consider who completed the questionnaire, the patient or someone else. Therefore, when conducting a patient satisfaction survey we must be aware of the effect of many variables on the patient responses and make the appropriate adjustments to provide valid results.
The author(s) declare that they have no competing interests.
JMQ and NG conceived of the study, coordinated and participated in the design of the study, and drafted the manuscript. AE, FA, CE, JASS, ES and AT participated in the design and helped to draft the manuscript. AB, AT performed the statistical analyses and drafted the manuscript. All authors read and approved the final manuscript.
This study was supported by a grant from the Fondo de Investigación Sanitaria (FIS 00/0129), of the thematic networks (FIS G03/202) and the Research Committee of the Galdakao hospital. The authors of this article wish to thank all personnel at the data-gathering units of the four hospitals.
Med Care Res Rev 1995, 52:109-133. PubMed Abstract
Beck EJ, Griffith R, Fitzpatrick R, Mandalia S, Carrier, Conlon C, Mandel B, Ong E, Pozniak A, Tang A, Tomlinson D, Williams: Patient satisfaction with HIV service provision in NPMS hospitals: the development of a standard satisfaction questionnaire. NPMS Steering Group.
Psychiatr Serv 1997, 48:1553-1561. PubMed Abstract
J Health Care Mark 1992, 12:56-64. PubMed Abstract
The pre-publication history for this paper can be accessed here: