Email updates

Keep up to date with the latest news and content from BMC Public Health and BioMed Central.

Open Access Research article

Development and validation of a measure of health literacy in the UK: the newest vital sign

Gill Rowlands1*, Nina Khazaezadeh2, Eugene Oteng-Ntim2, Paul Seed3, Suzanne Barr3 and Barry D Weiss4

Author Affiliations

1 London South Bank University, London, UK

2 Guy’s and St Thomas’ NHS Foundation Trust, London, UK

3 Kings College London, London, UK

4 University of Arizona, Tucson, AZ, USA

For all author emails, please log on.

BMC Public Health 2013, 13:116  doi:10.1186/1471-2458-13-116


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2458/13/116


Received:20 July 2012
Accepted:3 January 2013
Published:7 February 2013

© 2013 Rowlands et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Health literacy (HL) is an important public health issue. Current measures have drawbacks in length and/or acceptability. The US-developed Newest Vital Sign (NVS) health literacy instrument measures both reading comprehension and numeracy skills using a nutrition label, takes 3 minutes to administer, and has proven to be acceptable to research subjects. This study aimed to amend and validate it for the UK population.

Methods

We used a three-stage process; (1) a Delphi study with academic and clinical experts to amend the NVS label to reflect UK nutrition labeling (2) community-based cognitive testing to assess and improve ease of understanding and acceptability of the test (3) validation of the NVS-UK against an accepted standard test of health literacy, the Test of Functional Health Literacy in Adults (TOFHLA) (Pearson’s r and the area under the Receiver Operating Characteristic (ROC) curve) and participant educational level. A sample size calculation indicated that 250 participants would be required. Inclusion criteria were age 18–75 years and ability to converse in English. We excluded people working in the health field and those with impaired vision or inability to undertake the interview due to cognitive impairment or inability to converse in English.

Results

In the Delphi study, 28 experts reached consensus (3 cycles). Cognitive testing (80 participants) yielded an instrument that needed no further refinement. Validation testing (337 participants) showed high internal consistency (Cronbach’s Alpha = 0.74). Validation against the TOFHLA demonstrated a Pearson’s r of 0.49 and an area under the ROC curve of 0.81.

Conclusions

The NVS-UK is a valid measure of HL. Its acceptability and ease of application makes it an ideal tool for use in the UK. It has potential uses in public health research including epidemiological surveys and randomized controlled trials, and in enabling practitioners to tailor care to patient need.

Keywords:
Literacy; Health literacy; Nutrition label; Measure

Background

Health literacy (HL) is defined as ‘the cognitive and social skills that determine the motivation and ability of individuals to gain access to, understand and use information in ways that promote and maintain good health’ [1,2]. It is recognised as an important cause of health inequalities in industrialised nations such as the UK, US, Canada, and Australia [2-6]. HL is a complex concept, with multiple components [7]. The ability to understand both language and numbers in health contexts are core competencies. Health literacy is associated with educational status and other social determinants of health such as ethnicity and socio-economic status, but has an association with health and long-term conditions that persists even when these are controlled for in analyses [8].

Where there is a mismatch between individuals’ health-related literacy and numeracy skills and the demands of the health system, those with lower skills are at risk of poorer health. Low HL is associated with limited participation in screening for diseases, limited understanding of one’s illness or treatment plan, difficulties managing a chronic conditions such as diabetes mellitus, coronary health disease, heart failure, and asthma, poorer overall health status [5,9-14] and increased mortality [15].

Development of the evidence that links low HL and health has been facilitated by the use of measures of individual HL skills. The two most commonly used measures are the Test of Functional Health Literacy in Adults (TOFHLA) [16] and the Rapid Estimate of Adult Literacy in Medicine (REALM) [17]. Both TOFHLA and REALM have been validated for use in the UK [18,19]. However, both have disadvantages in use in research and practice. The length of time required for administration of the TOFHLA (22 minutes or more for the full version and up to 10 minutes for the shortened version) precludes its use in busy clinic settings and significantly increases the length of participant questioning if used in research. The REALM can be administered quickly (in less than 3 minutes) but, unlike the TOFHLA, does not test word comprehension or numeracy.

The Newest Vital Sign is a relatively new instrument, developed in the US and a validated predictor of health literacy, measuring both literacy and numeracy skills. Now described in more than 50 peer-reviewed journal articles, the NVS consists of a food nutrition label with six associated questions giving scores from 0 to 6 [20]. It is quick to administer (3 minutes), acceptable to patients, and accurately predicts health literacy levels when compared to the lengthier TOFHLA.

This study’s objectives were to undertake a process of cognitive testing with health practitioners, nutritionists, academics, and the public in the UK to (a) modify the NVS nutrition label to match the style and content of nutrition labels used in the UK and (b) modify the questions associated with the nutrition label so that terminology and language matched common language usage in the UK. This was followed by validation of the amended test (the “NVS-UK”) against the UK-validated version of the TOFHLA. The TOFHLA was chosen as the standard against which the NVS-UK would be validated as it tests comprehension, is an accepted standard test for health literacy [5] and was the standard against which the original US version of the NVS was validated [20].

Methods

Modifying the original NVS to develop the NVS-UK

The NVS nutrition label was adapted to conform to current UK food labeling practice and the questions were converted from US- to UK-style English. We did this with a web-based Delphi technique [21,22] that involved a panel of experts from clinical practice (medicine, nursing, pharmacy), public health, dietetics, research, adult education, and the food and drink industry. Recruitment of these experts was undertaken through the Health Literacy Group UK, a not-for profit organization that aims to raise the profile of health literacy as a remediable cause of health inequalities [23]. All Health Literacy Group UK members were invited by email to participate and all who expressed an interest were recruited. We asked these experts to assess nutrition labels used in the UK, to compare their content and layout to the nutrition label used on the original (US) version of the NVS, and to suggest modifications of the original NVS nutrition label to make it concordant with UK nutrition labels. We also asked them to make suggestions for modifying the wording of the questions that accompany the nutrition label. The intent of these modifications was to make the style of English in the questions correspond to common usage in the UK.

Participants then used a web-based Delphi technique to score the layout of the modified nutrition label and questions, ranking them on a 5-point scale in which 1 indicated complete disagreement that the nutrition label and questions were suitable for use in the UK, and 5 indicating complete agreement. Further modifications of the nutrition label and questions were made in response to these scores and suggestions from participants, and rounds of web-based scoring were continued until consensus was reached (i.e. all participants scoring 4 or 5) that the label and questions were suitable for use in the UK and no more suggestions for improvement were being made.

Further Refinement of the NVS UK through Cognitive Testing in the Community

The nutrition label and questions were then tested for ease of understanding and acceptability by the public in a series of one-on-one interviews conducted by the market-research firm, Ipsos MORI. The individuals interviewed in this phase were residents of Lambeth borough in central London, an inner-city area with marked socio-demographic variation. Lambeth is the 14th most deprived of England’s 354 Boroughs, with a high proportion of residents from Black and Ethnic Minority (BEM) groups [24]. Recruitment was in–street in Lambeth, with the time of day and recruitment site varied to ensure a wide cross-section of participants. A multi-stage sampling procedure was undertaken in 4 cycles over 6 weeks enabling the research team to assure that at least 30% of participants were from groups likely to have lower health literacy, such as members of BEM groups, those with education qualification levels below the standard English educational achievement expected at age 16 (5 grades A-C in the English matriculation examinations (GCSE)) [25], and people from the lowest two social grades (grades D and E) on the National Readership Survey (NRS) social grading system. The NRS social grades are the standard for market research in the UK [26]; and are shown in Table  1. Prospective participants with low levels of spoken English were screened out of the research. The interviews took place in participants’ homes.

Table 1. National readership survey social grades

Each participant was asked to complete the NVS UK questions, comment on question wording and label content and layout, and explain the processes they used to answer each question. They were asked to give feedback on the length of the survey and the clarity and difficulty of the questions.

This was an iterative process in which successive rounds of 15–20 interviews were carried out. Each round was followed by a review of the responses by project investigators and further modification of the NVS label and questions as indicated by interview results. Interview rounds continued until no more modifications were suggested. Participants in the cognitive interviews all gave informed consent and were offered a £25 voucher as compensation for their time.

The socio-demographic characteristics of the participants in the cognitive interviews were compared with local and national population characteristics using Office of National Statistics (ONS) 2007 mid-year estimates [27], ONS 2009 mid-year estimates [28] and 2001 UK census data [29].

Validation

Validation of the NVS-UK was assessed by comparing its performance to that of an accepted standard measure of health literacy, the TOFHLA [16,18], including the area under the Receiver Operating Characteristic (ROC) curve, and it’s correlation with education qualification attainment.

Data were collected on socio-demographic, lifestyle, and educational attainment in an interview that lasted 45–60 minutes. Age data were collected in 10-year age bands. The interview procedures were pilot tested with 20 Lambeth residents, following which the main validation survey was undertaken.

Instruments

The reference standard measure for HL used in this study, the TOFHLA, was developed from hospital materials and consists of a 50-item reading comprehension and 17-item numerical ability test, taking 22 minutes or more to administer. The reading items use a modified Cloze procedure, in which every 5th to 7th word in a passage is omitted and replaced with a blank space; the word to fit into each blank space is chosen from multiple-choice options. The numeracy items use prescription forms, clinic instructions, and medical insurance examples about which questions are asked requiring calculations. TOFHLA scores range from 0 to 100. A score of <60 represents inadequate health literacy; people with skills at this level are likely to experience the greatest barriers due to limited literacy and numeracy. A score of 60 to 74 represents marginal literacy; people scoring at this level may experience some difficulties understanding and using health information. Those scoring >75 have adequate literacy and are unlikely to experience problems arising from limited health literacy and numeracy skills.

Participants completed the NVS UK first followed by the UK-validated version of the TOFHLA.

Sample and recruitment

For validation against the TOFHLA, the sample size calculation was based on published reports on the validation of the original NVS, where correlation against the TOFHLA was 0.59 [20]. An unacceptable correlation was considered to be 0.3 (i.e. accounting for 9% of variance), and (based on previous data) a plausible correlation for purposes of power calculation was defined as 0.5 (or more). All correlations that could be shown to be significantly higher than 0.3 were regarded as acceptable. At least 250 subjects were required to give 90% power to detect such a difference.

The recruitment area for the validation stage was widened to include the London Borough of Southwark. Southwark is a borough neighbouring Lambeth with similar socio-demographic characteristics i.e. high levels of socio-economic deprivation and a high proportion of people from BEM groups [28]. Eligibility criteria were age 18 – 75 years, living at home, and ability to converse in English. We excluded potential participants if they were health care professionals (defined as people working in the National Health Service or private health care), did not live at home, had self-reported impaired vision (unable to read the test card), or were unable to hold a conversation with the interviewer due to cognitive impairment or inability to converse in English. Sampling aimed to recruit a sample reflecting the age, gender, NRS social grades and ethnic mix of Lambeth and Southwark. Recruitment was by postcode with interviewers assigned to clusters of postcodes with a high prevalence of residents fitting the desired recruitment profile. A total of 51 sample points were issued, with 7 interviews to achieve within each sample point. Interviewers knocked at the doors of potential recruits; if no-one eligible for the study was available or participation was declined, the interviewer went to the next address on their list. The interviews took place in participants’ homes with consent. Participants were given a £15 gift voucher in compensation for their time.

Data analysis

The principal analysis to determine the validity of the NVS-UK was to assess the correlation (Pearson r) between scores on the NVS and an accepted standard measure of health literacy, the TOFHLA [16,18] and by calculating the area under the receiver operating characteristic (ROC) curve. Validity was further assessed by the correlation (Pearson’s r) between the NVS and participants’ educational qualification attainment.

Optimal cut-off point(s) on the NVS UK for differentiating different levels of health literacy as identified by the TOFHLA were undertaken through calculation of the sensitivity and specificity for selected cut scores in the ROC analysis.

Statistical analyses were performed using STATA. V 11.2.

Ethics review

The cognitive testing and validation interviews were conducted by Ipsos MORI under the Market Research Society (MRS) Code of Conduct and Interviewer Quality Control Scheme (IQCS). Ethics approval for the study was granted by the London South Bank University Ethics Committee (ref UREC 1034). This project was exempt from NHS Research Ethics Approval as participants were not recruited from the NHS.

Results and discussion

Delphi survey and cognitive interviews

All Health Literacy Group UK members (n=254) were approached to participate by email; 28 volunteered to do so. The areas of interest and expertise of the expert panel is shown in Table  2.

Table 2. Area of interest/expertise of Delphi expert panel1

Participants were from a wide range of health, psychology, education, patient and public involvement, and industry. The expert panel reached consensus (scoring for all questions 4 or 5 out of a maximum 5) on the format and contents of the amended label and questions after 3 rounds on the web-based Delphi survey. After five cycles of cognitive interviews in the community, involving 80 local residents and with modifications made based on participant feedback, all participants found the NVS acceptable. The socio-demographic characteristics of the participants of the cognitive interview stage are shown in Table  3.

Table 3. Cognitive testing to amend Newest Vital Sign (NVS) UK: Socio-demographic characteristics of participants

The final version of the NVS UK is shown in Table  4 (showcard) and Table  5 (accompanying questions and correct responses).

thumbnailFigure 1. Distribution of scores NVS-UK.

Table 4. NVS Showcard

Validation

A total of 337 participants were recruited for the validation study (Table  6). As planned, the sample included at least 30% representation from groups likely to have low literacy skills: 32% from social grades D and E, 36% with education below level 2, and 53% members of a BEM group. The high percentage of BEM participants reflected the ethnic mix of the local population.

Table 5. NVS UK questions and correct responses

The final test subjected to validation consisted of a nutrition label and six questions, with one point awarded for each correct answer, giving a minimum score of 0 and a maximum score of 6. Total scores in this study ranged from 0 to 6, with a mean of 3.5 (Standard Deviation (SD) 1.8). The distribution of NVS UK scores is shown in Figure  1.

thumbnailFigure 2. Distribution of scores TOFHLA (total score).

Total scores on the TOFHLA-UK ranged from 0 to 100 (mean = 88.9 SD 12.8). As reported previously, TOFHLA scores were skewed, with larger numbers of participants scoring at the higher end of the scale [20,30,31], higher scores indicate higher levels of health literacy. The distribution of total TOFHLA scores is shown in Figure  2.

thumbnailFigure 3. Receiver operating characteristics curve: ability of NVS-UK scores to predict TOFHLA scores.

The internal consistency of the NVS UK was high (Cronbach’s Alpha = 0.74).

The correlation against the reference standard TOFHLA was 0.49 on 332 observations (95% CI: 0.40 to 0.57), meaning that 24% (95% CI 16 to 32) of variance is accounted for; which can be deemed acceptable as it is significantly higher (P<0.001) than the unacceptable value of 0.30 set in the power calculation.

The area under the receiver operating characteristic (ROC) curve for predicting TOFHLA scores was 0.81 (Standard Error (SE) 0.0302, 95% confidence interval 0.76 to 0.88). This is shown in Figure  3.

The ROC analysis explored the sensitivity (true positive) and specificity (true negative) of different cut-off points for predicting adequate health literacy as defined by the TOFHLA. These are shown in Table  7. As expected, decreasing threshold levels reduced the likelihood of correctly identifying those individuals with adequate health literacy as defined by the TOFHLA (sensitivity) and increased the likelihood of correctly identifying people with TOFHLA scores below the ‘adequate’ threshold i.e. intermediate or low health literacy (specificity). An NVS-UK cut-off level of ≥ 4 would correctly identify all those with adequate health literacy as defined by the TOFHLA but would only identify 40% of those with health literacy levels below adequate as identified by the TOFHLA. A cut-off point of < 2 would, in contrast, only correctly identify 82% of those with adequate health literacy as defined by the TOFHLA, but would correctly identify 70% of those with lower health literacy as identified by the TOFHLA, The NVS-UK showed a low positive correlation with educational level (Pearson’s r=0.22). Although low, this was higher than the correlation with education levels of the TOFHLA literacy and numeracy subscales, and for the combined TOFHLA scores (Pearson’s r = 0.13, 0,16 and 0.09 respectively).

Table 6. Validation of NVS UK: Socio-demographic characteristics of participants

Table 7. Optimal cut-off points for prediction of adequate health literacy levels on the TOFHLA

Discussion

We have modified the original NVS to develop a new version that is suitable for use in the UK. The NVS-UK has face validity, as it tests skills used in everyday life (i.e. understanding and interpreting information on a food nutrition label) – a factor that is likely to contribute to its acceptability to patients [32]. The instrument measures both text comprehension (literacy) and numeracy skills.

In addition, our analysis shows that the NVS-UK has good psychometric characteristics. Scores correlate well with a UK-validated version of the more complex and lengthy TOFLHA. Importantly, the area under the ROC curve of 0.81 was high, indicating high accuracy and, in fact, higher accuracy than many screening tests that are widely used in clinical practice [33-35]. The broader distribution and lesser skewness of the NVS scores across the population when compared with the TOFHLA (Figures  1 and 2) indicate a better ability to discriminate across a wider range of health literacy levels.

The ROC analysis identified optimal cut-off points for interpreting NVS-UK results in research or clinical practice. A score of 4 or more would correctly identify all those with adequate health literacy skills, a score of 2 – 3 would indicate intermediate health literacy skills, and a score of 0 – 1 would indicate low health literacy skills. These cut-off levels are the same as those found in validation of the original NVS. These values can be used in both research and clinical practice to identify individuals likely to have health literacy skills at those three levels.

It important to note, however, both the NVS and the TOFHLA are assessment tools that identify only certain aspects of the ‘cognitive and social skills needed by individuals as they access, understand, and use information in ways that promote and maintain good health’ [1,2]. Neither will measure the full range of skills needed to be ‘health literate’, or can assign a specific reading or numeracy level. Our study does show, however, that the NVS-UK is valid as a screening test that gives an accurate prediction of health literacy skills in comparison to the more complex and longer TOFHLA, and is likely to discriminate across a wider range of skills levels.

It should be noted that our study only included people able to converse in English. Further studies are required to determine potential use of the NVS-UK in people who have limited English skills. This may be facilitated by its translation into and validation in other languages. A validated Spanish version of the NVS is available [20] and the instrument has recently been translated into Dutch and Turkish, [36,37].

Finally, although the UK-NVS had a higher correlation with educational attainment than the TOFHLA or REALM, the correlation is nonetheless low. This low correlation was not unexpected as it is known that educational attainment is not a good predictor of literacy skills; many individuals have literacy skills well below what might be expected from the number of years of schooling they completed [38]. When health literacy skills need to be ascertained in research or practice, education level should not be used to make this determination. Rather, a direct measure such as the NVS-UK should be used.

Conclusions

Implications for research

The NVS-UK is a simple and accurate predictor of health literacy skills. Previous studies [20,32,39] show that it takes an average of 3 minutes to complete and can be administered by both clinical and non-clinical personnel. This, combined with its acceptability to patients [32] makes it an ideal measure to be used in surveys, cohort studies, and clinical trials in which health literacy may be a factor.

Implications for practice

The NVS has been widely used in clinical practice to aid practitioners and practice managers in understanding the HL skills of their patient populations, and such assessments have been found acceptable to nearly all patients [40,41].

An interesting possibility is the potential use of HL assessment as a diagnostic tool when patients appear to be experiencing difficulties in understanding and managing complex conditions or adhering to medication or other treatment regimens, as HL is known to be a predictor of poor adherence [42-44]. Further research is required to investigate this.

Summary

The speed, simplicity, validity and acceptability of the NVS-UK make it an ideal research tool to investigate the role of health literacy in health and illness. It also has a potentially valuable role in improving clinical practice and patient communication.

Abbreviations

BEM: Black and ethnic minority;HL: Health literacy;NVS: Newest vital sign;ONS: Office of national statistics;REALM: Rapid estimate of adult literacy in medicine;ROC: Receiver operating characteristic;TOFHLA: Test of functional health literacy in adults

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

GR contributed to the development of the project protocol, chaired the project steering group, led on the Delphi rounds and led on writing the paper. NK led on obtaining funding for the project, and contributed to protocol development, and the project steering group. She led on data analysis and contributed to writing the paper. EO-N contributed to developing the protocol, the project steering group and writing the paper. PS provided supervision of the data analysis and interpretation and contributed to writing the paper. SB provided nutrition expertise and co-led on the design of the nutrition label and questions that form the NVS-UK. She contributed to the paper. BDW developed the original NVS, on which the NVS-UK was based. He contributed to the project protocol, and co-led on the design of the nutrition label and questions that form the NVS-UK. He contributed to the paper. All authors read and approved the final manuscript.

Full size electronic copies (pdf) of the NVS UK showcard, questions and administration instructions are available free of charge from the following url: http://www.healthliteracy.org.uk/newest-vital-sign-uk webcite.

Authors’ information

GR (corresponding author) is Professor of Health Disparities at London South Bank University, UK and Chair of the Health Literacy Group UK http://www.healthliteracy.org.uk webcite.

NK is a Consultant Community Midwife at Guy’s and St Thmoas’ NHS Foundation Trust, London, UK.

EO-M is Head of Obstetrics at Guy’s and St Thomas’ NHS Foundation Trust, London UK.

PS is a non-clinical Senior Lecturer in Medical Statistics at King’s College London, UK.

SB is a Research Dietician at King’s College London, UK.

BDW is a Professor of Family Medicine at the University of Arizona, US.

Acknowledgments

The authors thank Ipsos MORI team who conducted the interviews for this project, Dr Bridget Holmes who contributed to writing the grant application, additional thanks to expert panel from the Health Literacy Group UK who supported us with the Delphi technique, and Lucy McDonald who provided administrative support.

Funding support

This study was funded by The Guys & St Thomas’ Charity http://www.gsttcharity.org.uk.

References

  1. Kickbusch IS: Health literacy: Addressing the health and education divide.

    Health Promot Int 2001, 16:289-297. PubMed Abstract | Publisher Full Text OpenURL

  2. Health Inequalities: Progress and Next Steps. England: Department of Health; 2008. OpenURL

  3. CSDH: Closing the gap in a generation: health equity through action on the social determinants of health. Final Report of the Commission on Social Determinants of Health. Geneva: World Health Organization; 2008. OpenURL

  4. Health Literacy in Canada: Initial results from the International Adult Literacy and Skills Survey 2007. Ottowa; 2007. OpenURL

  5. Health Literacy: A Prescription to End Confusion. Washington DC: Institute of Medicine; 2004. OpenURL

  6. Health Literacy, Australia. Canberra: Australian Bureau of Statistics; 2006. OpenURL

  7. Nutbeam D: The evolving concept of Health Literacy.

    Social Science and Medicine 2008, 67(12):2072-2078. PubMed Abstract | Publisher Full Text OpenURL

  8. Baker DW, Parker RM, Williams MV, Clark WS, Nurss J: The relationship of patient reading ability to self-reported health and use of health services.

    Am J Publ Health 1997, 87(6):1027-1030. Publisher Full Text OpenURL

  9. Mancuso CA, Rincon M: Impact of health literacy on longitudinal asthma outcomes.

    J Gen Intern Med 2006, 21(8):813-817. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Murray MD, Tu W, Wu J, Morrow D, Smith F, Brater DC: Factors associated with exacerbation of heart failure include treatment adherence and health literacy skills.

    Clin Pharmacol Therapeut 2009, 85(6):651-658. Publisher Full Text OpenURL

  11. Rothman R, Malone R, Bryant B, DeWalt D, Pignone M: Health literacy and diabetic control.

    JAMA 2002, 288(21)):2687-2688.

    2002/12/4

    PubMed Abstract | Publisher Full Text OpenURL

  12. Baker DW, Wolf MS, Feinglass J, Thompson JA, Gazmararian JA, Huang J: Health literacy and mortality among elderly persons.

    Arch Intern Med 2007, 167(14):1503-1509. PubMed Abstract | Publisher Full Text OpenURL

  13. Lindau ST, Tomori C, Lyons T, Langseth L, Bennett CL, Garcia P: The association of health literacy with cervical cancer prevention knowledge and health behaviors in a multiethnic cohort of women.

    Am J Obstet Gynecol 2002, 186(5):938-943. PubMed Abstract | Publisher Full Text OpenURL

  14. Dolan NC, Ferreira MR, Davis TC, Fitzgibbon ML, Rademaker A, Liu D, Schmitt BP, Gorby N, Wolf M, Bennett CL: Colorectal cancer screening knowledge, attitudes, and beliefs among veterans: does literacy make a difference?

    J Clin Oncol 2004, 22(13):2617-2622. PubMed Abstract | Publisher Full Text OpenURL

  15. Bostock S, Steptoe A: Association between low functional health literacy and mortality in older adults: longitudinal cohort study.

    BMJ 2012, 344:e1602. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Parker RM, Baker DW, Williams MV, Nurss JR: The Test of Functional Health Literacy in Adults (TOFHLA): a new instrument for measuring patients’ literacy skills.

    J Gen Intern Med 1995, 10:537-542. PubMed Abstract | Publisher Full Text OpenURL

  17. Davis TC, Long SW, Jackson RH, Mayeaux EJ, George RB, Murphy PW, Crouch MA: Rapid estimate of adult literacy in medicine: a shortened screening instrument.

    Fam Med 1993, 25(6):391-395. PubMed Abstract OpenURL

  18. von Wagner C, Knight K, Steptoe A, Wardle J: Functional health literacy and health-promoting behaviour in a national sample of British adults.

    J Epidemiol Community Health 2007, 61(12):1086-1090. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  19. Ibrahim SY, Reid F, Shaw A, Rowlands G, Gomez GB, Chesnokov M, Ussher M: Validation of a health literacy screening tool (REALM) in a UK population with coronary heart disease.

    J Public Health (Oxf) 2008, 30(4):449-455. Publisher Full Text OpenURL

  20. Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, Mockbee J, Hale FA: Quick assessment of literacy in primary care: the newest vital sign.

    Ann Fam Med 2005, 3(6):514-522. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  21. Graham B, Regehr G, Wright JG: Delphi as a method to establish consensus for diagnostic criteria.

    J Clin Epidemiol 2003, 56(12):1150-1156. PubMed Abstract | Publisher Full Text OpenURL

  22. Manca DP, Varnhagen S, Brett-MacLean P, Allan GM, Szafran O, Ausford A, Rowntree C, Rumzan I, Turner D: Rewards and challenges of family practice: Web-based survey using the Delphi method.

    Can Fam Physician 2007, 53(2):278-286.

    277

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  23. Health Literacy Group UK.

    http://www.healthliteracy.org.uk/ webcite

    OpenURL

  24. State of the Borough. London: Lambeth First; 2011.

    http://www.lambethfirst.org.uk/stateoftheborough webcite

    OpenURL

  25. Williams J, Clemens S, Oleinikova K, Tarvin K: The skills for life survey. A national needs and impact survey of literacy, numeracy and ICT skills. London: Department for Education and Skills (UK); 2003. [Williams J, Clemens S, Oleinikova K, Tarvin K] OpenURL

  26. National Readership Survey. Lifestyle data. Social grade - definitions and discriminatory power.

    http://www.nrs.co.uk/lifestyle-data/ webcite

    OpenURL

  27. Population Estimates for UK, England and Wales, Scotland and Northern Ireland, mid 2007. UK: Office for National Statistics;

    http://www.ons.gov.uk/ons/rel/pop-estimate/population-estimates-for-uk--england-and-wales--scotland-and-northern-ireland/2007/index.html webcite

    OpenURL

  28. Population Estimates for UK, England and Wales, Scotland and Northern Ireland - mid 2009. UK: Office of National Statistics;

    http://www.ons.gov.uk/ons/rel/pop-estimate/population-estimates-for-uk--england-and-wales--scotland-and-northern-ireland/2009/index.html webcite

    OpenURL

  29. 2001 Census. UK: Office of National Statistics;

    http://www.ons.gov.uk/ons/guide-method/census/census-2001/index.html webcite

    OpenURL

  30. Lee SY, Bender DE, Ruiz RE, Cho YI: Development of an easy-to-use Spanish Health Literacy test.

    Health Serv Res 2006, 41(4 Pt 1):1392-1412. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  31. Powell CK, Hill EG, Clancy DE: The relationship between Health Literacy and Diabetes knowledge and readiness to take health actions.

    Diabetes Educat 2007, 33:144-151. Publisher Full Text OpenURL

  32. Shah LC, West P, Bremmeyr K, Savoy-Moore RT: Health literacy instrument in family medicine: the "newest vital sign" ease of use and correlates.

    Journal of the American Board of Family Medicine: JABFM 2010, 23(2):195-203. PubMed Abstract | Publisher Full Text OpenURL

  33. Bradley KA, Boyd-Wickizer J, Powell SH, Burman ML: Alcohol screening questionnaires in women: a critical review.

    JAMA: the journal of the American Medical Association 1998, 280(2):166-171. Publisher Full Text OpenURL

  34. Cook RL, Chung T, Kelly TM, Clark DB: Alcohol screening in young persons attending a sexually transmitted disease clinic. Comparison of AUDIT, CRAFFT, and CAGE instruments.

    Journal of general internal medicine 2005, 20(1):1-6. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  35. Elmore JG, Armstrong K, Lehman CD, Fletcher SW: Screening for breast cancer.

    JAMA 2005, 293(10):1245-1256. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  36. Fransen MP, Van Schaik TM, Twickler TB, Essink-Bot ML: Applicability of internationally available health literacy measures in the Netherlands.

    J Heal Commun 2011, 16(Suppl 3):134-149. OpenURL

  37. Ozdemir H, Alper Z, Uncu Y, Bilgel N: Health literacy among adults: a study from Turkey.

    Heal Educ Res 2010, 25(3):464-477. Publisher Full Text OpenURL

  38. Kutner M, Greenberg E, Jin Y, Paulsen CT: The Health Literacy of America’s Adults: Results from the 2003 National Assessment of Adult Literacy. US Department of Education; 2006. OpenURL

  39. Johnson K, Weiss BD: How long does it take to assess literacy skills in clinical practice?

    J Am Board Fam Med 2008, 21(3):211-214. PubMed Abstract | Publisher Full Text OpenURL

  40. Welch VL, VanGeest JB, Caskey R: Time, costs, and clinical utilization of screening for health literacy: a case study using the newest vital sign (NVS) Instrument.

    J Am Board Fam Med 2001, 24:281-289. OpenURL

  41. Ryan JG, Leguen F, Weiss BD, Albury S, Jennings T, Velez F, Salibi N: Will patients agree to have their literacy skills assessed in clinical practice?

    Health Educ Res 2008, 23(4):603-611. PubMed Abstract | Publisher Full Text OpenURL

  42. Seliverstov I: Practical management approaches to anticoagulation non-compliance, health literacy, and limited English proficiency in the outpatient clinic setting.

    Journal of thrombosis and thrombolysis 2011, 31(3):321-325. PubMed Abstract | Publisher Full Text OpenURL

  43. Osborn CY, Cavanaugh K, Wallston KA, Kripalani S, Elasy TA, Rothman RL, White RO: Health literacy explains racial disparities in diabetes medication adherence.

    J Heal Commun 2011, 16(Suppl 3):268-278. OpenURL

  44. Lindquist LA, Go L, Fleisher J, Jain N, Friesema E, Baker DW: Relationship of health literacy to intentional and unintentional non-adherence of hospital discharge medications.

    J Gen Intern Med 2012, 27(2):173-178. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2458/13/116/prepub