Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Patient satisfaction in pediatric outpatient settings from the parents’ perspective - The Child ZAP: A psychometrically validated standardized questionnaire

BMC Health Services Research volume 12, Article number: 347 (2012) Cite this article

Abstract

Background

Patient surveys constitute a valuable source of information in patient-focused health care. The objective of this study was to develop and validate a standardized, patient centered, quantitative instrument to assess parent satisfaction in ambulatory pediatric care to be used in quality management and benchmarking activities, the Child-ZAP.

Methods

A preliminary version of the survey (38 items) was conducted in n = 19 pediatric practices. After psychometric testing a modified Child-ZAP was tested in a second survey (n = 20 new pediatric practices). Data from n = 979 patients were available for analysis.

Results

The final version of the Child-ZAP contains eight dimensions, three "Child-Scales" and five "Parent-Scales". Confirmatory factor analysis confirms the three hypothesized child dimensions as well as the five parent dimensions. The factorial structure is confirmed in subgroups of younger and older children.

Conclusions

With satisfactory to good results for validity and reliability testing, the final Child-ZAP is applicable in pediatric ambulatory care for children of all age groups.

Peer Review reports

Background

The patient's experience in health care institutions should be considered and incorporated into every stage of the health care process [1]. Only the patients themselves can authentically report their perceptions of health care processes and outcomes. Patient input is a valuable source of information needed for a patient-oriented organization of health care. Since the patients’ major concern is to receive treatment and care that satisfies their needs [2], health care provider are interested in improving the quality of their services, not least regarding market competition and accountability [3, 4]. Current quality management and certification procedures throughout health care sectors (ambulatory care physicians, hospitals, rehabilitation centres) require patient surveys on satisfaction and outcomes of care [5, 6]. Data from such surveys are used for benchmarking purposes and are made publicly accessible [7].

The dimensions of patient satisfaction have been described recently [8]. However, the issue of shared decisions making has become increasingly important during the last years [9, 10]. There are a number of tools which are suitable for the assessment of the patient’s perspective [11]. In quality management, good results have been achieved using standardized written surveys describing and assessing patient satisfaction and health care settings [7, 9]. In order to minimize social desirability patient satisfaction surveys should be administered outside the health care providers’ office [12].

The German ZAP outpatient satisfaction questionnaire is a standardized instrument to assess process-related patient satisfaction in outpatient care, which was developed in 1999 and validated by questioning adults, treated in general and specialized medical practices [13]. The ZAP (German Acronym for "Zufriedenheit in der Arztpraxis") is distributed free of charge in collaboration with the German Association of Statutory Health Insurance Physicians. When it comes to pediatric care, publicly available psychometrically sound instruments addressing processes of care from the patients’ perspective become short: we used a standardized questionnaire or parents assessment of pediatric hospital care [14]. The parent satisfaction questionnaire considers two perspectives: the parents’ assessment of the child-physician interaction (proxy report) and the parents’ assessment of their own interaction with the physician (self-report). However, we are not aware of a validated questionnaire to assess pediatric and adolescent primary care available in Germany. To date, instruments measuring the satisfaction of parents and/or children within pediatric and adolescent primary care only exist in English-speaking countries [15, 16].

Methods

Survey development

The goal of the present study was to adapt two existing questionnaires to a survey of parents whose children are seen in pediatric and adolescent primary care practices: the ZAP questionnaire and the questionnaire of parent satisfaction with hospital care [14]). The notion to adapt the instrument to a children and adolescent self-report was abandoned because in German pediatric and adolescent primary care practices more than 50% of the patients are younger than 5 years of age [17], and thus unable to complete a written survey [18, 19]. Instead, we decided to evaluate parents' assessment of health care quality and satisfaction from their child's perspective (proxy report). However, although children and adolescents are the main recipients of care, physicians still need to address and involve the child’s parents. Therefore, it seems necessary to obtain the assessment of satisfaction and involvement with pediatric care reported by the parents.

The parent survey was designed to assess aspects of both the child-physician and the parent-physician relationship. Byczkowski et al. (2010) found a large degree of corresponding assessments between adolescent patients and their parents regarding patient satisfaction. Further, we decided against the use of different versions for various age groups to ensure that the questionnaire can be widely used for parents of children of all ages in every day pediatric outpatient care [20].

The Child-ZAP was developed from the validated ZAP questionnaire for adults [13] which contains four scales (23 items), and from a questionnaire of parent satisfaction with hospital care [14]. A preliminary qualitative study was conducted to assess the comprehensibility and relevance of questions of the adult version of the ZAP. This was done by conducting guided interviews with parents whose children were currently seen in pediatric and adolescent primary care practices as well as with older children and adolescents. Based on the results of the preliminary study and theoretical considerations, the adult version of the ZAP was modified into a preliminary version for children (Child ZAP).

The preliminary version of the Child ZAP contained six scales (24 items) for parent assessment of parent-physician interaction (self-report), three scales (14 items) for parent assessment of child-physician interaction (proxy report), and three global items (overall satisfaction with the physician, trust in the physician, and quality of care).

The preliminary version was then subjected to psychometric testing and modified accordingly into a second and final version of the Child ZAP, which then was tested in the main study with a random sample from selected pediatric and adolescent primary care practices. The results of the psychometric analysis, based on data gathered in the main study, are presented below.

The parents were instructed to answer the questions based on their overall satisfaction with the pediatrician in general, i.e., not merely based on the last doctor visit. This was included to ensure that the participants responded independent of their current doctor’s appointment. All items were rated on a four-point scale ranging from "very satisfied" to "very unsatisfied". Two scales, the proxy report scales "Child - Information" and "Child - Involvement" were coded with an additional response "Does not apply". The rationale behind this decision was the assumption that it would not always be possible or appropriate to provide information to very young children or involve them in decision making.

The questionnaire also contained supplementary questions on the current doctor visit and on socio-demographic characteristics of the parents and their children.

Study design

We decided to test the instrument in 20 practices in Northern Germany. In collaboration with the German Association of Pediatric and Adolescent Physicians (Berufsverband der Kinder- und Jugendärzte e.V.), all respective physicians in Lower Saxony, Bremen and Hamburg (n = 750) were invited to take part in the study. Of 222 practices who responded positively, 20 practices were randomly selected.

No specific inclusion criteria were used for recruiting parents. However staff members were instructed to ensure that the participants were sufficiently fluent in German. Each practice received 100 questionnaires (including a letter and a stamped return envelope each), which were distributed randomly. The staff members instructed the parents to fill out the questionnaire at home and to return the questionnaire anonymously to the Hannover Medical School (MHH). The data collection for the preliminary study took place in winter 2007/2008, and for the main study in May 2009.

Participating doctors and patients were informed about the study. The Ethics Committee of the MHH approved the study (No 379, 2008).

Data analysis

To identify potential methodological weaknesses of the instrument and to reduce the number of items if possible, the preliminary study data collected in 19 pediatric practices were used to perform item and factor analyses considering wording quality criteria (item wordings related to quality management should be as specific and detailed as possible) and statistical criteria (including factor loadings of <0.5 for the respective factor and correlation of <0.8 with the respective subscale; item difficulty defined as the percentage of parents correctly answering the item.). The factorial structure of the preliminary version revealed high construct validity. However, considering the above mentioned criteria 5 items were removed from the questionnaire in order to reduce its length.

The optimized instrument consisted of three scales (14 items) for parent assessment of the child's interaction, information and involvement in decision making and five scales (19 items) for assessment of the parents' own experience (with practice organization, practice facilities, the provision of information, involvement in decision making, and professional competence).

The questionnaire items are shown in Table 1 (child scales) and Table 2 (parent scales).

Table 1 Items on the "Child" scales
Full size table
Table 2 Items on the "Parent" scales
Full size table

The final psychometric analysis consisted of item analyses (e.g., discriminatory power, distribution and item difficulty) and tests of reliability and validity of the scales/subscales. Reliability was measured using a standardized coefficient of internal consistency (Cronbach's alpha). Construct validity was assessed by confirmatory factor analysis, which has been shown to be an adequate method for testing theoretically assumed factor structures of multidimensional scales [21, 22]. Two confirmatory factor analyses were performed: the first analysis consisted of the 19 items which exclusively covered the assessment of the parents' own experiences; the second consisted of the 14 items for parent assessment regarding the relationship between child and physician. Included into the analyses were all cases with a valid response to all items needed for the respective confirmatory analysis. The Maximum Likelihood method was used to estimate the parameters, a procedure used if a sufficient sample size is available and the Bollen-Stine bootstrap is relatively insensitive to a violation of the normal distribution assumption [22, 23].

To determine whether the measurement model was appropriate for both younger and older children, the model previously defined for the overall sample was analysed in two parallel groups: children up to age 6 and children older than 6 years of age. Three models were compared with the unconstrained baseline model.

Model 1 referred to the assumption that there would be no statistically significant differences in any of the estimated parameters within the individual subsamples.

Model 2 was based on the assumption that the parameter estimates would differ only in terms of the error variance and that there would be no statistically significant differences between both subsamples in terms of the regression coefficients of the latent constructs for the observed individual items and of the inter-correlation of the latent constructs.

The third model implied that there would be no statistically significant differences in the regression coefficients of the latent constructs of the observed individual items in both subsamples.

Stability of the measurement model is not given unless the chi-square statistic of the model does not differ significantly from that of the unconstrained model [24].

The test of model quality was performed using the chi-square statistic, the comparative fit index (CFI), the Tucker-Lewis index (TLI), the Root Mean Square Error of Approximation (RMSEA), and the Standardized Root Mean Square Residual (SRMR). Model adaptation was determined to be acceptable based on the following criteria: non-statistically significant difference in chi-square statistic, high CFI (> 0.95), high TLI (> 0.95), low RMSEA (< 0.06), and low SRMR (< 0.11) [25–29].

An initial assessment of the convergent reliability was obtained by calculating correlations (Spearman correlation coefficient) between the subscales and the global items for satisfaction. We compared subscale means along different categories of wait times and consultation length by one way analysis of variance.

All statistical analyses were performed using SPSS for Windows V.17 and AMOS17 software.

Results

Sample characteristics

A total of 979 valid questionnaires were available for analysis (range of responses by pediatric practice: 21% to 72%; median: 50%). More than 90% of the questionnaires were completed by the mothers (see Table 3). The mean age of respondents was 35.4 years (SD: 6.6; range: 41), and the mean age of children treated in the pediatric and adolescent practices was 4.7 years (SD: 4.0; range: 16). The most frequent reasons for consultation were routine check-ups, vaccinations and acute disease symptoms.

Table 3 Study population (n = 979)
Full size table

Item analyses

Missing values ranged from 0.2% to 46% (Table 4; Table 5). All item difficulty values were above the theoretical scale midpoint; the mean values are 0.81 (child scales) and 0.79 (adult scales). The distributions of responses at item level were asymmetrical, with the majority of responses in the upper quarter of the response scales (Table 4; Table 5). The discriminatory power coefficients [30] were all significantly higher than r = 0.40.

Table 4 "Child"-Scales- Item Statistics
Full size table
Table 5 "Parent"-Scales – Item Statistics
Full size table

Scoring and reliability of the subscales

The items of each dimension were summarized into subscales. High subscale scores reflect a high degree of satisfaction. In addition, each subscale was transformed into scales ranging from 0 to 100 (Table 6; Table 7).

Table 6 "Child"-Scales – Scale statistics and reliability
Full size table
Table 7 "Parent-Scales – Scale statistics and reliability
Full size table

All subscales showed that the distribution of responses was skewed to the left (subscale median values in the upper third, negative skewness and ceiling effects). This tendency was most pronounced in the subscales "Child – Interaction" and "Child - Information". Ceiling effects were much less pronounced in all other scales. The internal consistency of the child-subscales was acceptable to good [31] with Cronbach's alpha ranging from 0.72 to 0.95.

Construct validity

A confirmatory factor analysis of the dimensionality of the construct "patient satisfaction", as derived from the preliminary study data, was conducted using main study data (the parent and child scales of the Child ZAP were tested separately). The regression weights of the individual items of the respective scales on the latent factors, the squared multiple correlations of the individual item, and the correlations of the latent factors with each other are presented in ( Additional file 1: Figure S1) and ( Additional file 2: Figure S2). The parameters used to assess the quality of the overall model are specified.

Multiple criteria should be used for assessing the confirmatory factor analyses [21, 22].

  1. 1.

    The individual parameter estimates should be plausible (i.e., the parameter estimates of the individual items should match theoretical considerations in terms of size and direction.

  2. 2.

    Negative variance estimates or correlations > 1 should not occur.

  3. 3.

    Measurement errors should be within an acceptable range

Finally, different indicators of the overall quality of the model should be used.

As shown in the excerpts of the model estimates for the two models ( Additional file 1: Figure S1) and ( Additional file 2: Figure S2), all parameter estimates of the individual items exhibited positive correlations with the latent variables, and none of the parameter estimates was implausible. The correlations of the observed variables with the respective latent dimensions were high. The squared multiple correlations for the child scales ranged from 0.62 to 0.87 and were therefore within an acceptable range. The individual items of the parent scales were explained by the latent factors to a lesser degree; most of the squared multiple regression values ranged from 0.6 to 0.7, but some values were lower.

As expected, the correlation between the latent factors was high, which implies that the individual dimensions of satisfaction with the pediatric and adolescent primary care physicians were not independent of each other. There were strong correlations between the three domains information, involvement in decision making and professional competence covered in the child scales and the parent scales covered in the child scales, and further between parent scales for information, involvement in decision making and professional competence.

The indicators for assessing the quality of the overall models were acceptable to good for both the child scales and the adult scales of the Child ZAP. Initial variance can be largely attributed to the model (CFI 0.95; TLI 0.95). Conversely, the proportion of residual variance not explained by the model were low (RMSEA 0.6/046 and SRMR 0.038/0.049). Thus, the values were within the recommended range. The chi-square statistic of the two models was highly significant. However, considering the large sample size, this should not be overrated [22].

Stability of the measurement model – older and younger children

The results of the test of stability of the measurement model are shown in Table 8. All compared models (i.e., those for both the child scales and the parent scales) featured comparable quality indices in the different subsamples of older and younger children. Regarding the child scales, in both samples with older and younger children, the latent factors were comparable and not significantly different in terms of explaining the observed individual items (as shown by the non-significant p-value for the chi-square statistic as compared to Model 3 with the unrestricted baseline model). Regarding the parent scales, the model with assumed non-statistically significant regression weights also exhibited a slightly significant difference from the unrestricted baseline model. Therefore, the measurement model and the assumed theoretical structure of the child scales can be replicated in different subgroups. The same applies to the parent scales, however, to a slightly lower extent only.

Table 8 ZAP – Confirmatory factor analysis - Model fit in younger and older children
Full size table

Correlation between subscales and global items

All subscales featured a positive and statistically significant correlation with the three global items overall satisfaction with the pediatrician, quality of care, and trust in the physician (Table 9). The subscales "interaction", "information" and "professional competence" showed a satisfying correlation with the three global items (correlation coefficient range: 0.55 to 0.63), whereas the subscale "practice organization" correlated slightly lower with the global items (correlation coefficient range: 0.39 to 0.41).

Table 9 Correlation of ZAP subscales with global items on satisfaction with pediatric care (n = 394, complete cases analyses)
Full size table

Correlation between subscales and wait time/physician contact time

As shown in ( Additional file 3: Figure S3), a wait time of more than 30 minutes was associated with significantly lower satisfaction (10 points less than average) for all investigated aspects. The highest decrease was observed for satisfaction with practice facilities and practice organization (−17 and −13 points, respectively). A patient-physician contact shorter than 10 minutes was also associated with lower satisfaction ( Additional file 4: Figure S4). Short contact times with the physician had the highest effect on satisfaction with "Child – Involvement in decision making" and "Parent – Information" (−12 and - 11 points, respectively) and the lowest effect on satisfaction with patient organization and practice facilities (−7 and −8 points, respectively). All differences were statistically significant on a 5% level. Interestingly, a very short wait time (less than ten minutes) as well as very long physician contact time (more than fifteen minutes) were also associated with lower satisfaction. These findings are consistent with findings from the validation study of the original ZAP questionnaire.

Discussion

Psychometric analyses

The construct validity of the Child ZAP is supported by the confirmatory factor analyses which were plausible in content and offer adequate results according to statistical criteria. The child and parent scales of the Child ZAP give a good representation of the multidimensional and multi-perspective construct of patient satisfaction with process quality in pediatric and adolescent primary care practices. The inter-correlations of the subscales, which were sometimes rather high, could be interpreted as a sign of redundancy in the instrument, leading to considerations to shorten the instrument or the individual subscales further. However, due to content related reasons (to obtain a wide diversity of potential aspects for quality management) and statistical reasons, it was decided not to shorten the tool. Moreover, the Child-ZAP was not reduced any further, because it is designed for quality assurance in outpatient pediatric practices. Thus, not only the scale scores, but also the results at single item level is of interest and important, for example, for the scale "professional competence", which consists of the items "collaboration with other medical faculties", "thoroughness and diligence in examinations" and "readiness to refer the child." For this reason and due to specific requirements in outpatient pediatric practice the child-ZAP is significantly longer than the original adult ZAP.

Strengths and limitations

Although the ceiling effects were pronounced and corresponded to the "high" patient satisfaction observed in other studies [32, 33], they were lower than those obtained from the ZAP questionnaire for adults [34]. For example, in the validation study for the adult ZAP the subscales "practice organization" and "professional competence" received maximum scores from more than 40% of persons surveyed, whereas in this study these subscales received a maximum score of only 27.2% and 36.4%, respectively. Nevertheless, the skewness of distribution and the pronounced ceiling effects limit an interpretation of the results.

Further, it has to be noted that the participating practices and parents were not randomly selected, and not representative of the population. Although we provided an instruction for this random distribution, it was not possible to control that this was done correctly. Thus, a selection bias can not be ruled out. It would be desirable to validate the questionnaire in a population-based sample.

The relatively high percentage of missing values for the parent scale "professional competence" appears to be problematic. However, the two items on the "professional competence" scale that resulted in the high number of missing responses concerned the parent's opinion of the pediatrician's collaboration with other medical facilities and the pediatrician's readiness to refer the child. Thus, it can be assumed that many parents who did not provide a valid answer to these items did not have any experience regarding the physician's readiness to refer the patient or collaborate with other facilities, and are not able to answer these questions. As the probability of parents having such an experience presumably increases with their child’s age, missing responses for these questions are most likely for parents of younger children. Post-hoc analyses of our data showed, that this assumption is supported by the decrease of percentage of missing data with increasing age of the child (data not shown).

Practical implications and future developments

Basically it can be assumed that the pediatric and adolescent primary care physicians were motivated to participate in the study. The response rate of nearly 50% is comparable to similar patient surveys in German private practices. [12, 35, 36].

When assessing the process quality from the patient’s point of view in pediatric and adolescent primary care rather than in adult health care, both the parents’ as well as the child’s perspective must be included. Therefore, the notion of "patient satisfaction in pediatric and adolescent primary care" is more complex than in adult primary care. This was taken into account while developing questions and scales which explicitly relate to the interaction between the physician and the child as well as to experiences and opinions of the accompanying parent.

The inclusion of the patient partnership in decision making as a component of health care process quality assessments, particularly patient satisfaction surveys, is a recent development [10, 11], and failure to do so is seen as a methodological deficiency [37, 38]. Therefore, the Child ZAP questionnaire developers decided to include items and subscales to measure child and parent involvement in decision making even though it was known that this would lead to a high rate of missing data, particularly in cases where the patients were very young children. Considering that the Child ZAP is designed to apply to children of all ages, content-related considerations and the stability of the measurement models in both younger and older children support the decision to include the scale in the Child ZAP. However, it is recommended to restrict the analysis of this scale to children 5 to 6 years of age and older.

The fact that in a questionnaire used in outpatient pediatric practice, only the parents were interviewed, may at first seem strange. However, given the fact that more than half of the target population can not be interviewed directly due to their age, this decision appears to be justified. In addition, studies in which self-assessments of children and assessments by their parents are compared show a high correlation between these two measures [39–41].

Conclusions

The proposed instrument to assess patient satisfaction in pediatric and adolescent primary care practices shows psychometric qualities which justify its use in quality management. Due to specific circumstances in pediatric and adolescent primary care practice (child and adult interviewees), the Child ZAP is longer than the original adult version of the ZAP. Its modular design and feasible procedure allow for a flexible implementation of the survey instrument which meets various requirements of quality management. Considering the cultural diversity of patients seen in pediatric and adolescent medicine, a translation of the Child ZAP into other languages, such as Turkish, Serbian, Russian and English would be desirable.

Abbreviations

CFI:

Comparative fit index

ChDM:

Child-Subscale "Decision making"

Chi2 :

Chi-Square-Statistic

Child ZAP:

Patient satisfaction in pediatric outpatient settings from the parents’ perspective

CHINFO:

Child-Subscale "Information

CHINT:

Child-Subscale "Interaction"

Df:

Degrees of freedom

M:

Mean

MHH:

Hannover Medical School

MV:

Missing values

ParDM:

Parent-Subscale "Parent-Decision making"

ParInfo:

Parent-Subscale "Parent-Information"

PFacil:

Parent-Subscale "Practice facilities"

POrg:

Parent-Subscale "Practice organization"

ProfComp:

Parent-Subscale "Professional competence"

RMSEA:

Root Mean Square Error of Approximation

SD:

Standard deviation

SRMR:

Standardized Root Mean Square Residual

TLI:

Tucker-Lewis index

ZAP:

Patient satisfaction with ambulatory care.

References

  1. Gesundheitsministerkonferenz: Weiterentwicklung einer einheitlichen Qualitätsstrategie im Gesundheitswesen. 2006, http://www.gmkonline.de/_beschluesse/Protokoll_79-GMK_Top92_Qualitaetsstrategie_Anlage2.pdf.

    Google Scholar 

  2. Coulter A, Jenkinson C: European patients' view on the responsiveness of health systems and health providers. Eur J Public Health. 2005, 15 (Suppl 4): 355-360.

    Article  PubMed  Google Scholar 

  3. Baker DW, Einstadter D, Thomas C, Husak S, Gordon NH, Cebul RD: The effect of publicly reporting hospital performance on market share and risk-adjusted mortality at high-mortality hospitals. Medical Care. 2003, 41 (6): 729-740.

    PubMed  Google Scholar 

  4. Dierks ML, Seidel G, Schwartz FW, Horch K: Bürger- und Patientenorientierung in Deutschland. Gesundheitsbericht für Deutschland. 2006, Berlin: Robert Koch Institute

    Google Scholar 

  5. KTQ: KTQ-Leitfaden zur Patientenbefragung. 2000, Düsseldorf: Deutsche Krankenhausverlagsgesellschaft mbH

    Google Scholar 

  6. Egner U, Gerwinn H, Schliehe F: Das bundesweite Reha-Qualitätssicherungsprogramm der gesetzlichen Rentenversicherung, Erfahrungen aus einem mehrjährigen Umsetzungsprozess. Zeitschrift für ärztliche Fortbildung und Qualität im Gesundheitswesen. 2002, 96: 4-9.

    PubMed  Google Scholar 

  7. Dierks ML: Datenquellen und Methoden zur Erfassung der Versorgungsqualität aus Sicht der Nutzer – Behandlungszufriedenheit, Patientenerfahrungen und -bewertungen. Monitoring der gesundheitlichen Versorgung in Deutschland - Konzepte, Anforderungen, Datenquellen. Edited by: Kurth MB. 2008, Köln: Deutscher Ärzte-Verlag, 197-210.

    Google Scholar 

  8. Sitzia J, Wood N: Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997, 45: 1829-1843. 10.1016/S0277-9536(97)00128-7.

    Article  CAS  PubMed  Google Scholar 

  9. Joosten EA, DeFuentes-Merillas L, de Weert GH, Sensky T, van der Staak CP, de Jong CA: Systematic review of the effects of shared decision-making on patient satisfaction, treatment adherence and health status. Psychother Psychosom. 2008, 77 (Suppl 4): 219-226.

    Article  CAS  PubMed  Google Scholar 

  10. Isfort J, Floer B, Butzlaff M: Shared Decision Making - Partizipative Entscheidungsfindung auf dem Weg in die Praxis. Gesundheitsmonitor 2004. Die ambulante Versorgung aus Sicht von Bevölkerung und Ärzteschaft. Edited by: Böcken B, Braun B, Schnee M. 2004, Gütersloh: Bertelsmann Stiftung, 88-100.

    Google Scholar 

  11. Nübling M, Weber H, Zierath M, Langewitz W: Patient opinion surveys in the hospital: revalidation and improvement of a questionnaire. Psychother Psychosom Med Psychol. 2003, 53 (Suppl 5): 236-242.

    Article  PubMed  Google Scholar 

  12. Dierks ML, Bitzer EM: Patientenbefragungen in der Arztpraxis - Praktikabilität, Akzeptanz und Relevanz aus der Sicht von niedergelassenen Ärzten. Zeitschrift für ärztliche Fortbildung und Qualität im Gesundheitswesen. 2000, 94 (Suppl 8): 389-395.

    CAS  PubMed  Google Scholar 

  13. Bitzer EM, Dierks ML, Dörning H, Schwartz FW: Zufriedenheit in der Arztpraxis aus Patientenperspektive. Psychometrische Prüfung eines standardisierten Erhebungsinstrumentes. J Public Health. 1999, 7 (Suppl 3): 196-209.

    Article  Google Scholar 

  14. GEK-Report akut-stationäre Versorgung 2008. Schriftenreihe zur Gesundheitsanalyse. Edited by: Bitzer EM, Grobe T, Neusser S, Dörning H, Schwartz FW. 2008, Schwerpunkt: Kinder im Krankenhaus, 63.

  15. Chesney M, Lindeke L, Johnson L, Jukkala A, Lynch S: Comparison of child and parent satisfaction ratings of ambulatory pediatric subspecialty care. J Pediatr Health Care. 2005, 19 (Suppl 4): 221-229.

    Article  PubMed  Google Scholar 

  16. Simonian SJ, Tarnowski KJ, Park A, Bekeny P: Child, parent, and physician perceived satisfaction with pediatric outpatient visits. J Dev Behav Pediatr. 1993, 14 (Suppl 1): 8-12.

    CAS  PubMed  Google Scholar 

  17. Grobe TG, Dörning H, Schwartz FW: GEK-Report ambulant ärztliche Versorgung 2008. 2009, St. Augustin: Asgard-Verlag

    Google Scholar 

  18. Ravens-Sieberer U: Lebensqualitätsansätze in der Pädiatrie. Lebensqualität und Gesundheitsökonomie in der Medizin: Konzepte, Methoden, Anwendung. Edited by: Ravens-Sieberer U, Cieza A. 2000, Landsberg: Ecomed, 277-292.

    Google Scholar 

  19. Seyfarth-Metzger I, Satzinger W, Höpner F, von Walter J: Kinder im Krankenhaus. Zur Methodik einer Kinder- und Elternbefragung. Schriftenreihe Forum Sozial- und Gesundheitspolitik. Edited by: Satzinger W, Trojan A, Kellermann-Mühlhoff P. 2001, St. Augustin: Asgard-Verlag, 221-228.

    Google Scholar 

  20. Byczkowski TL, Kollar LM, Britto MT: Family experiences with outpatient care: do adolescents and parents have the same perceptions?. J Adolesc Health. 2010, 47 (1): 92-98. 10.1016/j.jadohealth.2009.12.005.

    Article  PubMed  Google Scholar 

  21. Backhaus K, Erichson B, Plinke W, Weiber R: Der LISREL-Ansatz der Kausalanalyse. Multivariate Analysemethoden. Edited by: Backhaus K, Erichson B, Plinke W, Weiber R. 1994, Heidelberg, New York: Springer, Berlin, 322-432.

    Chapter  Google Scholar 

  22. Bühner M: Einführung in die Test- und Fragebogenkonstruktion. 2006, München: Pearson Studium

    Google Scholar 

  23. Garson GD: Structural Equation Modeling, Statnotes: Topics in Multivariate Analysis. http://faculty.chass.ncsu.edu/garson/pa765/statnote.htm.

  24. Arbuckle JL: AMOS 17.0 User's Guide. 2008, Chicago: Amos Development Cooperation

    Google Scholar 

  25. Hu LT, Bentler PM: Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychol Methods. 1998, 3 (Suppl 4): 424-453.

    Article  Google Scholar 

  26. Hu LT, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999, 6 (Suppl 1): 1-5.

    Article  Google Scholar 

  27. Bollen KA: Structural equations with latent variables. 1989, New York: Wiley

    Book  Google Scholar 

  28. Bentler PM: Comparative fit indices in structural models. Psychol Bull. 1990, 107: 238-246.

    Article  CAS  PubMed  Google Scholar 

  29. Browne MW, Cudeck R: Alternative ways of assessing model fit. Testing structural equation models. Edited by: Bollen KA, Long JS. 1993, Newbury Park, CA: Sage, 136-162.

    Google Scholar 

  30. Bullinger M, Kirchberger I, Steinbüchel N: Der Fragebogen Alltagsleben - ein Verfahren zur Erfassung der gesundheitsbezogenen Lebensqualität. Z Med Psychol. 1993, 3: 121-131.

    Google Scholar 

  31. Lienert GA: Testaufbau und Testanalyse. 1969, Verlag Julius Beltz: Weinheim

    Google Scholar 

  32. Raspe H, Weber U, Voigt S, Kosinski A, Petras H: Qualitätssicherung durch Patientenbefragungen in der medizinischen Rehabilitation: Wahrnehmungen und Bewertungen von Rehastrukturen und –prozessen (“Rehabilitationszufriedenheit“). Rehabilitation. 1997, 36: XXXI-XLII.

    PubMed  Google Scholar 

  33. Aust B: Zufriedene Patienten? Eine kritische Diskussion von Zufriedenheitsuntersuchungen in der gesundheitlichen Versorgung. 1994, Berlin: WZB

    Google Scholar 

  34. Dierks ML, Bitzer EM: Wie kann man Erwartungen und Zufriedenheit der Patienten im Qualitätsmanagement berücksichtigen? - Erhebungsverfahren und Erfahrungen aus der ambulanten Versorgung. Qualitätsmanagement in der Arztpraxis. Schriftenreihe des Bundesministeriums für Gesundheit, Band 117. Edited by: Baden-Baden HB. 1999, Nomos Verlagsgesellschaft, 125-184.

    Google Scholar 

  35. Klingenberg A, Bahrs O, Szecsenyi J: Was wünschen Patienten vom Hausarzt?. Z Allgemeinmed. 1996, 3 (Suppl 72): 180-186.

    Google Scholar 

  36. Jung HP, Wensing M, Grol R: What makes a good general practitioner: do patients and doctors have different views?. Br J Gen Pract. 1997, 47: 805-809.

    CAS  PubMed  PubMed Central  Google Scholar 

  37. Berger B, Lenz M, Mühlhauser I: Patient zufrieden, Arzt gut? Inwiefern ist Patientenzufriedenheit ein Indikator für die Qualität der hausärztlichen Versorgung? Eine systematische Übersichtsarbeit. Z Evid Fortbild Qual Gesundhwes. 2008, 102 (Suppl 5): 299-306.

    Article  PubMed  Google Scholar 

  38. Härter M, Loh A, Spies C: Gemeinsam entscheiden – erfolgreich behandeln. Neue Wege für Ärzte und Patienten im Gesundheitswesen. 2005, Köln: Deutscher Ärzteverlag

    Google Scholar 

  39. le Coq EM, Boeke AJ, Bezemer PD, Colland VT, van Eijk JT: Which source should we use to measure quality of life in children with asthma: the children themselves or their parents?. Qual Life Res. 2000, 9 (6): 625-636. 10.1023/A:1008977200176.

    Article  CAS  PubMed  Google Scholar 

  40. Erhart M, Ellert U, Kurth BM, Ravens-Sieberer U: Measuring adolescents‘HRQoL via self reports and parent proxy reports: an evaluation of the psychometric properties of both versions of the KINDL-R instrument. Health Qual Life Outcomes. 2009, 7: 77-10.1186/1477-7525-7-77.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Verhulst FC, Althaus M, Berden GF: The Child Assessment Schedule: parent–child agreement and validity measures. J Child Psychol Psychiatry. 1987, 28 (3): 455-466. 10.1111/j.1469-7610.1987.tb01766.x.

    Article  CAS  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The Child ZAP was developed with financial and non-material support from the German Association of Pediatric Physicians (BVKJ).

We would like to thank all participating pediatric and adolescent primary care physicians for their support.

Author information

Authors and Affiliations

  1. ISEG-Institut für Sozialmedizin, Epidemiologie und Gesundheitssystemforschung, Lavesstr. 80, Hannover, 30157, Germany

    Eva Maria Bitzer

  2. Pädagogische Hochschule Freiburg, Institut für Alltagskultur, Bewegung und Gesundheit, Gesundheitspädagogik, Kunzenweg 21, Freiburg, 79117, Germany

    Eva Maria Bitzer & Marco Petrucci

  3. Medizinische Hochschule Hannover, Institut für Epidemiologie, Sozialmedizin und Gesundheitssystemforschung, Forschungsschwerpunkt Patientenorientierung und Gesundheitsbildung, Carl-Neuberg-Str. 1, Hannover, 30625, Germany

    Stephanie Volkmer & Marie-Luise Dierks

  4. Berufsverband der Kinder- und Jugendärzte e.V, Mielenforster Str. 2, Köln, 51069, Germany

    Nikolaus Weissenrieder

Authors
  1. Eva Maria Bitzer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stephanie Volkmer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marco Petrucci
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nikolaus Weissenrieder
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marie-Luise Dierks
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marie-Luise Dierks.

Additional information

Competing interests

'The authors declare that they have no competing interests. NW is Member of the Board of German Association of Pediatric Physicians (BVKJ).

Authors’ contributions

EMB and MLD designed and oversaw the study, EMB and MP performed the statistical analysis, SV developed the questionnaire and organized the data collection, EMB, MLD and MP wrote the manuscript, NW recruited the participating physicians and critically revised the manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

12913_2012_2180_MOESM1_ESM.ppt

Additional file 1: Figure S1. Child ZAP: Confirmatory factor analysis of the "Child" scales (unrestricted baseline model). (PPT 252 KB)

12913_2012_2180_MOESM2_ESM.ppt

Additional file 2: Figure S2. Child ZAP: Confirmatory factor analysis of the "Parent" scales (unrestricted baseline model). (PPT 306 KB)

Additional file 3: Figure S3. Child ZAP: Wait time at the practice. (DOC 85 KB)

Additional file 4: Figure S4 Child ZAP: Physician contact time. (DOC 81 KB)

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Bitzer, E.M., Volkmer, S., Petrucci, M. et al. Patient satisfaction in pediatric outpatient settings from the parents’ perspective - The Child ZAP: A psychometrically validated standardized questionnaire. BMC Health Serv Res 12, 347 (2012). https://doi.org/10.1186/1472-6963-12-347

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6963-12-347

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us