Email updates

Keep up to date with the latest news and content from BMC Public Health and BioMed Central.

Open Access Research article

Validation of self-reported anthropometrics in the Adventist Health Study 2

Maira Bes-Rastrollo1*, Joan Sabaté23, Karen Jaceldo-Siegl2 and Gary E Fraser3

Author affiliations

1 Dept. of Preventive Medicine and Public Health, School of Medicine, University of Navarra, Pamplona, Spain

2 Dept. of Nutrition, School of Public Health, Loma Linda University, Loma Linda, CA, USA

3 Dept. of Epidemiology and Statistics. School of Public Health, Loma Linda University, Loma Linda, CA, USA

For all author emails, please log on.

Citation and License

BMC Public Health 2011, 11:213  doi:10.1186/1471-2458-11-213


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2458/11/213


Received:12 January 2011
Accepted:5 April 2011
Published:5 April 2011

© 2011 Bes-Rastrollo et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Relying on self-reported anthropometric data is often the only feasible way of studying large populations. In this context, there are no studies assessing the validity of anthropometrics in a mostly vegetarian population. The objective of this study was to evaluate the validity of self-reported anthropometrics in the Adventist Health Study 2 (AHS-2).

Methods

We selected a representative sample of 911 participants of AHS-2, a cohort of over 96,000 adult Adventists in the USA and Canada. Then we compared their measured weight and height with those self-reported at baseline. We calculated the validity of the anthropometrics as continuous variables, and as categorical variables for the definition of obesity.

Results

On average, participants underestimated their weight by 0.20 kg, and overestimated their height by 1.57 cm resulting in underestimation of body mass index (BMI) by 0.61 kg/m2. The agreement between self-reported and measured BMI (as a continuous variable), as estimated by intraclass correlation coefficient, was 0.97. The sensitivity of self-reported BMI to detect obesity was 0.81, the specificity 0.97, the predictive positive value 0.93, the predictive negative value 0.92, and the Kappa index 0.81. The percentage of absolute agreement for each category of BMI (normoweight, overweight, and obese) was 83.4%. After multivariate analyses, predictors of differences between self-reported and measured BMI were obesity, soy consumption and the type of dietary pattern.

Conclusions

Self-reported anthropometric data showed high validity in a representative subsample of the AHS-2 being valid enough to be used in epidemiological studies, although it can lead to some underestimation of obesity.

Background

Obesity is one of the main public health problems of this century. The prevalence of overweight and obesity has reached epidemic proportions around the world, not only in developed countries but also in developing countries. Thus, it has been recognised as a pandemic by the World Health Organization [1].

Obesity is an important risk factor for several chronic diseases such as cardiovascular disease, hypertension, type 2 diabetes, arthritis, and some cancers [2]. In addition, the causes of obesity are multiple and complex. For all these reasons it is important to assess obesity as a risk factor and to study the potential causes of weight gain in large populations.

Body mass index (BMI) has been used as a measure of obesity, with obesity defined as a BMI ≥30 kg/m2 (calculated as weight in kg divided by height in meters squared) [1]. Self-reported height and weight provide a cost-effective assessment of these variables and thus have been used in numerous epidemiological studies as the only feasible way to obtain information. However, relying on self-reported data of participants has inherent problems. Therefore, it is of the utmost importance to assess the validity of that information.

The validity of "self-reported" BMI, calculated from self-reported height and weight has been assessed in several populations [3-6]. Results vary depending on the characteristics of the population. In this context, there are no studies assessing the validity of these self-reported measures in a population mostly vegetarian. Therefore, our objective was to evaluate the validity of self-reported anthropometrics in a representative subsample of the Adventist Health Study 2 (AHS-2) cohort.

Methods

The Adventist Health Study 2 (AHS-2)

The AHS-2 is a prospective cohort study of over 96,000 adult Adventists in the USA and Canada. The main objective of the study is to assess the association between lifestyle choices, particularly diet, and the risk of cancer and other health outcomes. Its methods have been described elsewhere [7]. Briefly, the sample includes Seventh-day Adventist church members living in the USA and Canada who were 30 years and older, and who were sufficiently fluent in English to complete the lengthy lifestyle questionnaire. Enrolment started in February 2002 and finished December 2007. All participants completed a self-reported lifestyle questionnaire including their weight and height. Most participants were either Caucasian or Black/African-American. The AHS-2 cohort is relatively unique for its wide range of dietary patterns compared with the general Western population. Also interesting is that about half of participants practice some kind of vegetarian dietary pattern [8].

Validation study

Subjects included in this report are part of a calibration study for the AHS-2 conducted at Loma Linda University. Participants were randomly selected from the AHS-2 using a two-stage random selection method: first, churches were randomly selected from around North America, being weighted for church size; then subjects were randomly chosen from each of these churches. Participants attended a scheduled clinic appointment at their local church. Weight was measured with a calibrated scale without shoes and heavy outer garments, to the nearest 0.1 kg and height was measured with a stadiometer without shoes to the nearest 1/4 inch. Both measurements were taken by a trained research assistant. Vegetarian status, and intake of soy and nuts were obtained from a previously validated food frequency questionnaire [9]. Participants with a diagnosis of active cancer, Alzheimer's disease, or pregnant women were excluded from the calibration study. Unqualified subjects and those who refused to take part in the calibration study (about one third) were replaced with individuals randomly chosen from the same church and matched by race, age (within 5 y of the original subject age), and sex. Because of the special focus on black Adventist as a minority in the AHS-2, the calibration was designed to include approximately equal numbers of blacks and whites. The study was approved by the institutional review board of Loma Linda University, and all subjects signed a written informed consent.

Statistical analyses

We calculated the crude differences between self-reported and measured anthropometrics (weight, height, and BMI) and adjusted them for time-lag between self-reported and measured anthropometric data, and for race, age, and sex by analyses of covariance. We report the differences between self-reported and measured variables according to population characteristics and compared them through Student T tests, or analyses of variance, depending on the form of the variables.

We studied the agreement between self-reported and measured anthropometric variables using a random-effect model intraclass correlation coefficient and the survival agreement plot for BMI proposed by Luiz et al. [10] differentiating between negative and positive differences [11].

Non-parametric Spearman correlation coefficients were calculated between self-reported and measured anthropometric variables. Sensitivity, specificity, predictive positive and negative values and Kappa index were calculated for the validation of obesity (BMI≥30 kg/m2).

Participants were categorised into quintiles of weight according to their self-reported and measured weight information. The percentages of misclassification in different adjacent quintiles or, when the misclassification was more than two quintiles, were estimated. Similarly, we classified participants according to each category of BMI (normal weight, overweight and obese) and calculated the absolute agreement and the overall kappa index.

We also present the BMI relative error (self-reported-measured/measured*100) graphed against the average BMI according to Bland and Altman [12].

Finally, to evaluate predictors of differences between self-reported and measured weight and BMI, multivariate linear regression analyses were performed taking weight and BMI differences [self-reported-measured] as the dependent variable.

Results

From 1011 participants in the calibration study, we excluded one hundred participants with missing values, thus finally including 911 participants.

Those 911 participants were a good representation of the overall AHS-2cohort, except that the validation sample had a slightly higher percentage of soy consumers (Table 1). The difference in race is by design as the calibration study over-sampled black subjects.

Table 1. Characteristics of participants in the validation sample and in the Adventist Health Study-2 (AHS-2).

On average, participants self-reported lower weight (-0.31 kg, 95% CI: -1.20 to +0.58), greater height (+1.66 cm, 95% CI: +0.99 to +2.33) and thus lower BMI (-0.64 kg/m2, 95% CI: -1.02 to -0.25) as compared to measured values, after adjusting for time-lag, measured anthropometrics, age and sex (Table 2).

Table 2. Comparison between self-reported and measured values for weight, height and body mass index (BMI) in the validation sample (n = 911) of the Adventist Health Study-2.

When we compared self-reported and measured anthropometrics according to population characteristics we found differences according to age: younger participants reported less weight than measured, however older participants reported more weight than objectively measured. Older participants reported more height than was measured. Those participants who reported less BMI were particularly between 45-55 years old. Obese participants also reported a more inaccurate BMI than non-obese participants reporting -0.9 kg/m2 [95% CI: -1.3 to -0.6] less than measured. Similarly, those participants who were non-soy consumers (<1 g of soy protein per day) had more measurement error than soy-consumers (Table 3). There were no differences between sex, race, nut consumption and dietary pattern.

Table 3. Anthropometric differences according to population characteristics in the AHS-2 validation sample (n = 911).

Spearman correlation coefficients (95% CI) for weight, height, and BMI were 0.96 (0.95-0.96), 0.96 (0.95-0.96), and 0.94 (0.93-0.94), and intraclass correlation coefficients were 0.98 (0.97-0.98), 0.95 (0.93-0.97), and 0.97 (0.96-0.97). The sensitivity of self-reported BMI to detect obesity was 0.81 (0.76-0.85), the specificity 0.97 (0.95-0.98), the predictive positive value 0.93 (0.89-0.97), the predictive negative value 0.92 (0.89-0.94), and the Kappa index 0.81 (0.77-0.85).

After cross-classifying participants into quintiles of self-reported and measured weight, the absolute agreement between quintiles was 74% (95% CI: 71-77%). In addition, if we calculated the absolute agreement between self-report and measured values using a category including participants with values in the same quintiles or +/- 1 adjacent quintile, there was almost total agreement (99.1%, 95% CI: 98.3%-99.6%).

The absolute agreement in the cross-classification of participants according to their self-reported and measured BMI categories (normal weight, overweight and obese) was 83.4% (95% CI: 80.9%-85.8%).

After multivariate analyses, predictors of differences between self-reported and measured weight were age, obesity, education, soy consumption, and type of dietary pattern followed-up. Similarly, predictors of BMI differences were obesity, soy consumption, and type of dietary pattern followed-up (Table 4). The Bland-Altman plot shows a relatively random variability given the inexistence of a funnel plot (Figure 1).

Table 4. Multivariate Prediction of differences between self-reported and measured weight and body mass index (BMI).

thumbnailFigure 1. Bland-Altman plot for Body Mass Index (BMI) relative error*. *[(Self-reported - Measured)/Measured]*100.

Finally, we used the survival-agreement plot to depict graphically the agreement between self-reported and measured BMI (Figure 2). We noted that negative BMI relative errors (under-reported) tended to be greater than positive BMI relative errors (over-reported) (log-rank test, p < 0.001).

thumbnailFigure 2. Survival agreement Plot for Body Mass Index (BMI). *[(Self-reported - Measured)/Measured ]*100 Log-Rank Test < 0.001 Survival agreement Plot as proposed by Luiz et al. (J Clin Epidemiol 2003; 56:963-7). The x-axis shows the absolute difference between self-reported and measured weight (kg), and the y-axis shows the proportions of observations with differences that are at least those in the x-axis. Separate lines for negative difference (self-reported-measured; infra-reported) and continuous line for positive difference (self-reported-measured; over-reported).

Discussion

Overall our results showed a high validity of self-reported anthropometrics in a representative subsample of the AHS-2 cohort. These results are in agreement with a meta-analysis of self-reported weight that included 24 studies which concluded that self-reporting is sufficiently accurate in epidemiological studies [13]. However, in the present study we also found some independent predictors of inaccurate values after multivariate analysis.

In contrast to some previous studies [6], [14], [15] we did not find differences between sexes in evaluating anthropometric data. Nevertheless, in agreement with the majority of the studies age was a predictor of reporting less height [3], [5], [15], [16]. This is understandable, since height declines with age in later life [17] and older people may be unaware of this decrease in their stature. Additionally in our study, age was also a predictor of reporting greater weight.

Similarly to other studies [3], [5], [16], [18] obese subjects provided less accurate weight and BMI data. They tended to underestimate their weight and hence BMI, but the bias in self-reported weight was only 0.6 kg on average among the obese. In this context, and in agreement with Villanueva et al [3], normal weight participants were least likely to be incorrectly classified to another BMI category, while obese participants were most likely to be incorrectly classified since obesity is seen as socially undesirable.

Regarding education, participants with at least 2-years of college reported less weight and BMI compared to those with a high school education or lower. This may be explained by the higher pressure and desirability bias in this group of people.

Race was not an independent predictor of validity as was observed in a recent study [6]. There were no differences between the white and black population of AHS-2 in the validity of self-reported anthropometrics. Gillum, et al [4] with data from NHANES III, similar to Kuczmarski, et al. [16], also did not find differences between blacks and whites. Gillum, et al [4] found a greater bias in BMI using self-reported data from Hispanic men and women compared with white non-Hispanic men and women. This is similar to our findings even though the trends were not statistically significant probably due to the small number of Hispanics' participants.

Interestingly, we found that soy consumers over-reported their weight compared to non-soy consumers; however, the latter group was more inaccurate regarding their anthropometric data, as the variances of differences between self-report and measured data were higher. Soy consumers might be more health conscious and as a consequence they might have more accurate knowledge of their weight and height. By contrast, semi-vegetarian participants, those with low meat and fish consumption, significantly underreported their weight and BMI in comparison to non-vegetarians. Future research is necessary to determine the generalizability of these findings to other settings. It is worth noting that the magnitude of differences between self-reported and measured weight was smaller than in other populations [5], [18]. The sensitivity in assessing obesity was higher [81%] than the 74% observed in the USA [19], 57% in Spain [20] and 55-61% in Sweden [21]. Our results were similar to those in a Scottish population [22] and in a Japanese workplace population [23].

One potential limitation of the study was the existence of a relatively wide time-lag between ascertainment of self-reported data and measured data. The median time-lag between the answered questionnaire and the time when subjects were been objectively weighted and measured for height was 1.58 years. Therefore, the observed differences between self-reported and measured weight and BMI may truly be due to real changes of weight and BMI across time. In fact, when we repeated the analyses including only those participants who went to clinics within a year after answering the questionnaire the results improved (i.e. Kappa index for obesity: 0.87; 95% CI: 0.77-0.97). However, our results were adjusted for time-lag period and in any case this potential limitation should bias the results towards a worse validity. Confounding by variables not controlled for cannot be excluded. However, given the uncertainty about the existence or nature of such associations it is unclear which other variables should be controlled for as confounders.

On the other hand, subjects completed the questionnaire on self-reported weight and height before the clinics and without knowing that their weight and height would be measured in the future. In addition, the number of participants in the validation study is relatively high and it was a representative sample of the AHS-2 cohort.

Conclusion

In conclusion, this study indicates that self-reported weight and height data from a cohort of Adventists in the USA and Canada is valid enough to be used in epidemiological association studies, although it can lead to some underestimation of obesity.

Abbreviations

BMI: Body Mass Index; AHS-2: Adventists Health Study 2; 95% CI: 95% Confidence Interval

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All authors (MB-R, JS, KJ, GF) participated in the planning and conception of the research questions and the study design. GF was the principal investigator of the study and primarily conceptualized the research. MB-R analyzed the data and drafted the manuscript. JS contributed to the study design, interpretation of data, and review the paper. KJ was responsible for retrieving the data. All authors participated in interpreting the data and critically revising the manuscript for important intellectual content. All authors have approved the final version of the manuscript.

Acknowledgements

The study was supported by a grant form the National Cancer Institute R01 CA94594. MB-R received a fellowship from "Obra Social de Bancaja". We would like to thank the participants of the AHS-2 for their continuous cooperation.

References

  1. World Health Organization: Report of a WHO Consultation: Obesity: Preventing and managing the global epidemic. Geneva, Switzerland: World Health Organization; 2000.

  2. Hu FB: Obesity epidemiology. New York: Oxford University Press; 2008. OpenURL

  3. Villanueva EV: The validity of self-reported weight in US adults: a population based cross-sectional study.

    BMC Public Health 2001, 1:11. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  4. Gillum RF, Sempos CT: Ethnic variation in validity of classification of overweight and obesity using self-reported weight and height in American women and men: the Third National Health and Nutrition Examination Survey.

    Nutr J 2005, 4:27. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  5. McAdams MA, Vand Dam RM, Hu FB: Comparison of self-reported and measured BMI as correlates of disease markers in US adults.

    Obesity 2007, 15:288-296. PubMed Abstract | Publisher Full Text OpenURL

  6. Merill RM, Richardson JS: Validity of self-reported height, weight, and body mass index: findings from the National Health and Nutrition Examination Survey, 2001-2006.

    Prev Chronic Dis 2009, 6:A121. PubMed Abstract | PubMed Central Full Text OpenURL

  7. Butler TL, Fraser GE, Beeson WL, Knutsen S, et al.: Cohort profile: the Adventist Health Study-2 (AHS-2).

    Int J Epidemiol 2008, 37:260-265. PubMed Abstract | Publisher Full Text OpenURL

  8. Fraser G: Diet, Life Expectancy and chronic disease. In Studies of Seventh-day Adventists and other vegetarians. New York: Oxford University Press; 2003. OpenURL

  9. Jaceldo-Siegl K, Knutsen SF, Sabaté J, Beeson WL, Chan J, Herring RP, Butler TL, Haddad E, Bennett H, Montgomery S, Sharma SS, Oda K, Fraser GE: Validation of nutrient intake using a food-frequency questionnaire and repeated 24 h recalls in Black and White subjects of the Adventist Health Study-2 (AHS-2).

    Public Health Nutr 2010, 13:812-819. PubMed Abstract | Publisher Full Text OpenURL

  10. Luiz RR, Leal Costa AJ, Kale PL, Werneck GL: Assessment of agreement of a quantitative variable: a new graphical approach.

    J Clin Epidemiol 2003, 56:963-967. PubMed Abstract | Publisher Full Text OpenURL

  11. Llorca J, Delgado-Rodriguez M: Survival techniques were used to assess agreement of a quantitative variable.

    J Clin Epidemiol 2005, 58:314-315. PubMed Abstract | Publisher Full Text OpenURL

  12. Bland JM, Altman DG: Comparing methods of measurement: why plotting difference against standard method is misleading.

    Lancet 1995, 346:1085-1087. PubMed Abstract | Publisher Full Text OpenURL

  13. Bowman RL, De Lucia JL: Accuracy of self-reported weight: a meta-analysis.

    Behav Ther 1992, 23:637-655. Publisher Full Text OpenURL

  14. Palta M, Prineas RJ, Berman R, Hannan P: Comparison of self-reported and measured height and weight.

    Am J Epidemiol 1982, 115:223-230. PubMed Abstract OpenURL

  15. Nyholm M, Gullberg B, Merlo J, Lundqvist-Persson C, Rastam L, Lindblad U: The validity of obesity based on self-reported weight and height: implications for population studies.

    Obesity 2007, 15:197-208. PubMed Abstract | Publisher Full Text OpenURL

  16. Kuczmarski MF, Kuczmarski RJ, Najjar M: Effects of age on validity of self-reported height, weight, and body mass index: findings from the Third National Health and Nutrition Examination Survey, 1988-1994.

    J Am Diet Assoc 2001, 101:28-34. PubMed Abstract | Publisher Full Text OpenURL

  17. Giles E, Hutchinson DL: Stature- and age-related bias in self-reported stature.

    J Forensic Sci 1991, 36:765-780. PubMed Abstract OpenURL

  18. Spencer EA, Appleby PN, Davey GK, Key TJ: Validity of self-reported height and weight in 4808 EPIC-Oxford participants.

    Public Health Nutr 2002, 5:561-565. PubMed Abstract | Publisher Full Text OpenURL

  19. Nieto-Garcia FJ, Bush TL, Keyl PM: Body mass definitions of obesity: sensitivity and specificity using self-reported weight and height.

    Epidemiology 1990, 1:146. PubMed Abstract | Publisher Full Text OpenURL

  20. Alverez-Torices JC, Franch-Nadal J, Alverez-Guiswasola F, et al.: Self-reported height and weight and prevalence of obesity. Study in a Spanish population.

    Int J Obes 1993, 17:663-667. OpenURL

  21. Bostrom G, Diderichesen F: Socioeconomic differentials in misclassification of height, weight and body mass index based on questionnaire data.

    Int J Epidemiol 1997, 26:860-866. PubMed Abstract | Publisher Full Text OpenURL

  22. Woodward M, Tunstall-Pedoe H, Morrison C: Accuracy of the estimated prevalence of obesity from self-reported height and weight in an adult Scottish population.

    J Epidemiol Community Health 2000, 54:143-148. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  23. Wada K, Tamkoshi K, Tsunekawa T, et al.: Validity of self-reported height and weight in a Japanese workplace population.

    Int J Obes 2005, 29:1093-1099. Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2458/11/213/prepub