Email updates

Keep up to date with the latest news and content from BMC Medical Informatics and Decision Making and BioMed Central.

Open Access Research article

The development of a web- and a print-based decision aid for prostate cancer screening

Caroline S Dorfman1, Randi M Williams1, Elisabeth C Kassan1, Sara N Red1, David L Dawson1, William Tuong1, Elizabeth R Parker1, Janet Ohene-Frempong2, Kimberly M Davis1, Alexander H Krist3, Steven H Woolf3, Marc D Schwartz1, Mary B Fishman4, Carmella Cole5 and Kathryn L Taylor1*

Author Affiliations

1 Department of Oncology, Lombardi Comprehensive Cancer Center, Georgetown University Medical Center, 3300 Whitehaven Street, NW Suite 4100, Washington, DC 20007-2401, USA

2 The Clear Language Group, 7907 Roneale Drive, Elkins Park, PA 19012-1115, USA

3 Department of Family Medicine, Virginia Commonwealth University, PO Box 980251 Richmond VA 23298-0251, USA

4 Division of General Internal Medicine, Georgetown University Hospital, 3800 Reservoir Rd NW, Washington, DC 20007, USA

5 Division of General Internal Medicine, Washington Hospital Center, 110 Irving Street, NW, Washington, DC 20010, USA

For all author emails, please log on.

BMC Medical Informatics and Decision Making 2010, 10:12  doi:10.1186/1472-6947-10-12

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6947/10/12


Received:16 July 2009
Accepted:3 March 2010
Published:3 March 2010

© 2010 Dorfman et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Whether early detection and treatment of prostate cancer (PCa) will reduce disease-related mortality remains uncertain. As a result, tools are needed to facilitate informed decision making. While there have been several decision aids (DAs) developed and tested, very few have included an exercise to help men clarify their values and preferences about PCa screening. Further, only one DA has utilized an interactive web-based format, which allows for an expansion and customization of the material. We describe the development of two DAs, a booklet and an interactive website, each with a values clarification component and designed for use in diverse settings.

Methods

We conducted two feasibility studies to assess men's (45-70 years) Internet access and their willingness to use a web- vs. a print-based tool. The booklet was adapted from two previous versions evaluated in randomized controlled trials (RCTs) and the website was created to closely match the content of the revised booklet. Usability testing was conducted to obtain feedback regarding draft versions of the materials. The tools were also reviewed by a plain language expert and the interdisciplinary research team. Feedback on the content and presentation led to iterative modifications of the tools.

Results

The feasibility studies confirmed that the Internet was a viable medium, as the majority of men used a computer, had access to the Internet, and Internet use increased over time. Feedback from the usability testing on the length, presentation, and content of the materials was incorporated into the final versions of the booklet and website. Both the feasibility studies and the usability testing highlighted the need to address men's informed decision making regarding screening.

Conclusions

Informed decision making for PCa screening is crucial at present and may be important for some time, particularly if a definitive recommendation either for or against screening does not emerge from ongoing prostate cancer screening trials. We have detailed our efforts at developing print- and web-based DAs to assist men in determining how to best meet their PCa screening preferences. Following completion of our ongoing RCT designed to test these materials, our goal will be to develop a dissemination project for the more effective tool.

Trial Registration

NCT00623090

Background

Prostate cancer (PCa) is the leading cancer diagnosis among men and the second leading cause of male cancer death [1,2]. While research has shown that PCa screening can find cancer at its earliest stages, it is uncertain whether early detection and treatment of PCa leads to a reduction in disease-related mortality [3,4]. Preliminary results from two large randomized controlled cancer screening trials (RCTs) have recently been published [5,6]. While one trial found a 20% reduction in death from PCa as a result of screening [6], findings from the other trial showed no significant reduction in disease-related mortality [5]. Given these inconclusive results, the uncertainties regarding screening continue. The final mortality results from these trials will not be available for several years.

The challenge of making medical decisions prior to the availability of definitive outcome data has been a long-standing issue in cancer screening [7-9] that is likely to become increasingly important as advances in screening technology outpace our ability to validate effectiveness [10-14]. Currently, there is no national standard of care with regard to PCa screening and national medical organizations differ in their screening recommendations [15-21]. However, most recommend that men learn about the pros and cons of PCa screening in order to reach an informed decision [16-19,21]. Thus, widely applicable and easily disseminable approaches to health education are needed [22].

Informed decision making occurs when individuals understand the benefits, risks, alternatives and uncertainties surrounding a medical condition or procedure and are able to use this information in conjunction with their preferences to make a decision that is consistent with those preferences [23]. One approach to promoting informed decisions for PCa screening is the use of patient education materials and decision aids (DAs). The goals of DAs are to foster informed health decisions by: 1) providing facts about the condition and procedures; 2) helping patients to clarify personal preferences and values; and 3) encouraging discussions with medical professionals to guide health decisions that match these preferences [24]. DAs are considered particularly useful when efficacy is unclear, outcomes are uncertain, and/or subjective judgments about benefits and risks are required [24]. Cancer screening-related DAs are particularly important because they have been found to increase cancer-related knowledge without increasing anxiety [25].

Increasingly, cancer screening decision tools have begun to utilize the Internet [26-31]. Despite the digital divide and differences in Internet use among different age and racial groups [32], the percentage of Americans who use the Internet is continuing to grow [33,34]. Internet users who access medical or health information have also increased between 2001 and 2007, from 66% to 76% for those aged 50 to 64 and from 60% to 71% for those over 65 [32]. These trends suggest that the Internet has vast potential as a widely accessible approach to delivering decision support materials for PCa screening.

The most recent systematic review of DAs for PCa screening was published in 2007, which presented the findings of 12 RCTs [35]. While we did not conduct our own systematic review, we used the same Medline search criteria used in Volk's review ('prostate cancer' and 'decision making') to locate RCTs published since the review, between January 2007 and June 2009. We located an additional six trials [27-29,36-38], and thus there have been a total of 18 published RCTs evaluating materials designed to improve informed decision making regarding PCa screening [26-29,36-49]. These trials have assessed print, verbal, Internet, video and interactive computer-based PCa screening DAs. We have provided a summary of these 18 published RCTs (see Additional File 1). Quasi-experimental studies [50-54], abstracts, and studies evaluating DAs designed to increase PCa screening were excluded from our summary. Of the 16 trials that assessed knowledge, all reported a significant improvement. However, inconsistencies were seen among the trials with respect to changes in decisional conflict, screening behavior, intent to screen, and active participation in the screening decision (see Additional File 1).

Additional file 1. Appendix A. Outcomes of Randomized Controlled Trials of Prostate Cancer Screening Decision Aids

Format: DOC Size: 95KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Although these were well-conducted trials, there were several limitations in the development and evaluation of these DAs. First, only 5 of the 18 studies [27,38,40-42] included a values clarification component to assist men in integrating the information and elucidating their preferences about PCa screening. This may explain why most studies reported only a modest improvement in participants' knowledge, or modest reductions in decisional conflict [27-29,37,40,41,43-46,48]. Second, of the 4 web-based DAs, only one [27] utilized an interactive format, while the other studies with web-based interventions did not exploit the strengths of this medium [26,28,29]. Third, while one web-based tool utilized a tracking mechanism to monitor whether participants viewed the website [27], that study did not determine whether the amount of time spent and topics accessed on the site impacted outcome measures. Fourth, several of the studies reporting pre- and post-intervention evaluations had a brief follow up period of less than 1 month, thereby limiting the understanding of the long-term impact of the interventions on screening behavior and other outcomes [28,38,40,41,43,44]. Finally, only 4 of the RCTs included a substantial number of African American (AA) men, who are at greatest risk for PCa [36,38,42,45].

Our goal was to extend these prior studies by developing two new patient DAs, a booklet and an interactive web-based tool, that could be utilized in a variety of settings. We sought to create widely disseminable and relevant materials that would improve PCa knowledge and assist a heterogeneous population of men in making informed screening decisions. We incorporated a values clarification component into each DA, which is intended to help individuals determine their personal preferences and beliefs about PCa screening and to make informed choices in accordance with those preferences. We are currently conducting a three arm RCT (including a usual care arm) to assess the efficacy of these tools among a diverse sample of men accrued from primary care clinics. This paper describes the development and content of these two DAs, including a description of our prior feasibility studies and randomized trials, each of which contributed to the evolution of these tools.

Methods

Development of Decision Aids

The development of the booklet and website was guided by two print booklets we had previously created and evaluated (Studies 1 and 2). Further, we conducted two feasibility studies and usability testing to confirm the viability of developing and testing a web-based decision tool (Study 3). All studies were approved by the Georgetown University/Medstar Oncology Institutional Review Board.

Study 1- The Right Decision is Yours: A Guide to Prostate Cancer Check-ups

Our initial version of the booklet was developed in collaboration with the Most Worshipful Prince Hall Grand Lodge of the District of Columbia (Masons) and was targeted to AA men and their spouses [55]. We conducted eight focus groups (N = 44) with AA men between the ages of 40 and 70 to determine the target population's informational needs and to guide the content and format of the booklet. We conducted two additional focus groups with internists, family physicians, and urologists to obtain input about factual information to include in the booklet.

Thematic analyses of transcripts of the lay focus groups, along with input from the physicians and guidelines of the Centers for Disease Control and Prevention for the development of educational materials (i.e., clear presentation, logical sequence, ease in understanding, and interesting, familiar, realistic, positive images) aided in the creation of pilot materials [55,56]. We modified the pilot materials based on iterative feedback from focus groups, members of the Prince Hall Masons, and the entire project team.

The end product, completed in May 2000, was a 16-page educational booklet entitled The Right Decision is Yours: A Guide to Prostate Cancer Check-ups and targeted specifically to AA men [55,57]. We found that the print intervention increased knowledge and reduced decisional conflict when compared to videotape and control conditions, and that screening behavior was not associated with either of the interventions [45].

Study 2- Prostate Cancer Screening: Making an Informed Decision

In our next study, we revised the above booklet to target men of all ethnic and racial backgrounds. The additions to the content were adapted from a Centers for Disease Control and Prevention educational tool [58] and provided information about the leading causes of death among men, the accuracy of the prostate-specific antigen (PSA) test, and the treatment decisions that need to be considered when PCa is diagnosed.

Additionally, we included a 10-item values clarification component (adapted from Gattellari and Ward, 2003) [40] to help participants weigh the relative benefits and risks of screening. The balance sheet consisted of five items that addressed the benefits of screening (e.g., "I am worried about PCa and screening may give me peace of mind") and five items that addressed the limitations of screening (e.g., "I do not want to risk finding out I have cancer when it may never bother me"). Participants were asked to consider each item and indicate those 'that sound like you.' The purpose of the exercise was to provide men with a descriptive rather than a prescriptive summary of the screening objectives that were important to them. Their response patterns suggested whether they were leaning toward or away from getting screened.

We conducted 8 usability testing sessions with 3-4 men per session (total N = 29; 74% AA, 22% White, and 4% of Caribbean/West Indian descent; age 40-70). The majority of participants were recruited from fliers posted at Georgetown University Hospital (GUH), Howard University Hospital, the National Prostate Cancer Coalition, and the local fire department. Participants provided feedback on the style and method of presentation of the information to ensure that the booklet addressed relevant topics and that the uncertainty surrounding screening was addressed in a balanced manner. Further, participants gave their opinion of the values clarification component and suggested ways to improve the balance sheet.

Based on the usability testing findings and research team recommendations, a plain language specialist was consulted to ensure that the DA did not exceed an 8th grade reading level. The end product, a 24 page booklet entitled Prostate Cancer Screening: Making an Informed Decision, was completed in July, 2004. We evaluated the booklet in a RCT among men who were registered to undergo free screening [59], comparing this booklet to the PSA question and answer fact sheet developed by the National Cancer Institute [60]. Similar to Study 1, exposure to the DA resulted in a significant increase in knowledge and a decrease in decisional conflict but no change in screening behavior.

Study 3- Prostate Cancer Screening: Making the Best Choice

Overview

The development of our final set of materials was conducted in several steps. We conducted two studies to assess the feasibility of an Internet-based PCa screening decision tool. Next, we drafted both the new booklet and the website based on the materials described in Studies 1 and 2. Finally, we conducted usability testing to obtain feedback on our draft materials.

Feasibility Studies

We sought to gain an understanding of our target population's access to and knowledge of the Internet. To do this, we conducted two feasibility studies with men accrued from the primary care clinics at two Washington, DC teaching hospitals, GUH and the Washington Hospital Center (WHC), the accrual sites for the target population in the ongoing RCT. GUH and WHC serve different populations with regard to race/ethnicity and socioeconomic backgrounds. GUH serves a racially diverse and middle to upper-middle class patient population, while WHC serves a largely AA patient population of predominately lower- to middle-class socioeconomic status.

We conducted feasibility studies with patients from both hospitals to determine how our materials should be tailored in order to meet the needs of each group. The feasibility studies were conducted 18 months apart to examine how Internet access and use changed among this population of men over time (January 2005 and June 2006). For each study, men between the ages of 45 and 70 without a previous diagnosis of PCa were accrued from the waiting rooms of the primary care clinics at GUH and WHC. Participants completed a brief survey that contained questions about sociodemographic information, PCa screening knowledge, and typical Internet use (see Table 1 for the sample description) (See Additional file 2). In the second study, we added the Newest Vital Sign component, a measure of medical literacy, to the questionnaire (See Additional file 3) [61].

Table 1. Feasibility Study 1, January 2005

Additional file 2. Supp File 2. Pilot Screening and Internet Usage Questionnaire-Feasibility Study 1 - January 2005

Format: PDF Size: 68KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Additional file 3. Supp File 3. Pilot Screening and Internet Usage Questionnaire-Feasibility Study 2 - June 2006

Format: PDF Size: 160KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Development of the Booklet and the Website

The study team and consultants first drafted a new version of the booklet. The primary differences from the prior booklet included both substantive changes (e.g., additional information on screening recommendations, different methods of PSA measurement, and additional figures and statistics) as well as improved readability (e.g., layout changes, improved wording, adding text boxes to highlight main points, greater use of bulleted text, reordering of topics). At each step in the development process, members of our research team, including primary care physicians and researchers specializing in PCa screening education, reviewed and modified drafts of the booklet.

After finalizing the content of the new booklet, we began working with the web developers to design the website prototype. We provided them with both the draft form of the booklet and a list of website features to include or avoid, based on our review of several existing health websites. We sought to create a universally functional site by accommodating varying web-browsers (e.g., Internet Explorer, Safari), using Adobe Flash ™ in the user interface, and using open source development tools to facilitate flexible site maintenance and support. The time required to load pages made the website unsuitable for dial-up connections. However, the results of the second feasibility study confirmed widespread access to high-speed Internet, and we anticipated even greater broadband use after the completion of the randomized trial.

The booklet and website were edited by a plain language expert who provided guidance on the presentation of the information, including the use of parallel sentence construction, bolded headers and sub-headers to alert readers to changes in topic, the use of bulleted text and tabs on the right edge of the pages, and the inclusion of a detailed glossary that defined medical terms often misunderstood by laypersons. The presentation of content on the website was designed to improve its appeal to persons who may not be regular web-users. We omitted sections of text to increase readability and wrote the materials in the conditional tense to prevent the reader from misinterpreting the information. Importantly, we acknowledged men's uncertainty surrounding screening in an effort to help them consider information that conflicted with their prior beliefs. Both the booklet and the website were written at or below an 8th grade reading level based on the Fleish-Kincaid grade level formula [62].

The development of these materials was also guided by criteria from the International Patient Decision Aid Standards (IPDAS) Collaboration, a worldwide group of health-care practitioners and researchers who have developed standards for DAs [63]. IPDAS standards help researchers create DAs to prepare patients to have conversations with their physicians about medical tests and procedures [64].

Booklet Usability testing

We recruited participants (N = 14) from GUH and WHC primary care clinic waiting rooms, from fliers placed in surrounding neighborhoods, and from a General Education Development center to ensure inclusion of men with limited literacy. Men were eligible if they were 45-70 years old and had not had PCa. Participants reviewed the booklet in our research offices (N = 6), as well as the clinic waiting room (N = 7) and their own home (with follow-up to discuss his feedback; N = 1) in order to accommodate their schedules.

At the start of each session, one to two members of the research team held a brief discussion with participants regarding their prior experiences with screening to ensure that no one had had unusual experiences that would impact their feedback. Participants then individually reviewed the booklet and completed a brief questionnaire concerning their opinions of the DA, their overall health, and demographic information (See Additional file 4). Moderators noted participants' recommendations for modifications to the text, graphs, figures, and their impressions of the overall message of the DA.

Additional file 4. Supp File 4. Booklet Usability Testing Questionnaire

Format: PDF Size: 39KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Our intention was not to conduct traditional qualitative analyses, as we had previously done in Study 1 [55]. The majority of the content was decided upon from the previous versions of our materials and through updates gained from the CDC [58]. We conducted the usability testing to assess men's reactions to the presentation of the materials. The usability testing concluded with a brief questionnaire that inquired about men's opinions of the materials and demographic information.

Website Usability testing

Participants for the usability testing were again recruited from GUH and WHC primary care clinics. Usability testing of the website involved the same recruitment method and protocol described above for the booklet usability testing. However, all but one session was conducted in our research offices. Following the consent process, we provided an explanation of the rationale for the website and then asked participants to individually review the proposed website content. As in the booklet usability testing, website usability testing sessions were not recorded. However, one to three members of the research team observed each participant during the review process to look for navigation and usability issues and take note of verbal comments made by participants. The meetings ended with an informal discussion and a questionnaire to assess participants' thoughts, likes, and dislikes of the materials (See Additional file 5).

Additional file 5. Supp File 5. Website Usability Testing Questionnaire

Format: PDF Size: 38KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Results

Feasibility Studies

Sample

For the initial feasibility study (January 2005), 55/58 (95%) men agreed to participate. The mean age of participants was 54.7 (SD = 7.6), with a little over half of the men reporting that they were AA (Table 1).

The second feasibility study (June 2006) had a participation rate of 83% (99/119). The sociodemographic characteristics of these participants were virtually identical to that of the first feasibility study (see Table 2), with a mean age of participants of 54.6 (SD = 7.4) and just over half AA.

Table 2. Feasibility Study 2, June 2006

Results

Responses to the first feasibility study indicated that, regarding PCa screening knowledge, 97.1% of men at GUH and 85.7% at WHC endorsed the belief that 'experts agree that all men should be tested for PCa.' This suggested a lack of understanding of the uncertainties surrounding screening. Overall, the majority of men with Internet access at home or work reported accessing the Internet a few times a week or daily (82.9%). Further, 79.3% of all men indicated they would 'probably' or 'definitely' read information about PCa on the Internet. We did not compare the two sites for statistically significant differences as the goal was simply to describe the men present at each site.

In the second feasibility study, a majority of men reported having Internet access at home or work (70.7%), and just over half reported preferring to receive health related information on the Internet (53.8%). The mean total score for the Newest Vital Sign scale was 3.9 (SD = 2.0) at GUH and 1.9 (SD = 1.8) at WHC. Scores on the Newest Vital Sign scale range from 0 to 6, with fewer than four correct answers indicating the possibility of limited literacy.

The feasibility studies identified the need for educational tools to improve men's knowledge of the uncertainties surrounding PCa screening. Responses to the Internet access and use questions confirmed that the Internet was a feasible medium for a widely accessible PCa screening educational tool. Although these were not representative samples, the data suggest that a majority of men had access to the Internet, and this access was sustained over time. These results further supported and gave us confidence in our decision to create a website that used a broadband Internet connection (as opposed to a dial-up connection) in order to deliver more complex interactive and video features. Participants' scores on the Newest Vital Sign reinforced the need for a plain language specialist in developing text for the website and the booklet.

Booklet Usability testing

Sample

The mean age of participants (N = 14) was 53.8 (SD = 7.8). Half of the men were unemployed or retired and 71.4% were AA. Additional demographic information for these participants is presented in Table 3. Given the overlap between the groups of men who reviewed the booklet and the website (N = 6 reviewed both), we did not assess the potential differences between the two groups.

Table 3. Evaluation Data from Usability testing (Study 3)†

Results

Responses to the questionnaire are presented in Table 3. Half of the men reviewing the booklet indicated that it had about the right amount of information and was about the right length, but a substantial minority reported that it contained more information than they would have liked (42.8%) or was too long (35.7%). Despite our efforts to provide balanced information, a majority of men (71.5%) said that the overall message of the booklet was that they should probably or definitely get screened for PCa. Many participants indicated that they were unaware of the uncertainty surrounding PCa screening. This suggested that a single discussion of the uncertainty was not enough to impact men's understandings of this complex topic.

In general, men were positive about the booklet, but many provided suggestions for information they would like to have added (Table 4); the content and layout of the booklet were revised accordingly. For example, the values clarification component presented in the Study 2 booklet, containing a non-prescriptive balance sheet, was simplified based on feedback from usability testing participants (see Figure 1). Participants were asked to select which of 10 statements 'sound like you,' with five highlighting the benefits of screening and five highlighting limitations. Participants' responses were intended to indicate whether they leaned toward or away from screening. Because many men found the original questions to be complex, we tested multiple versions of the questions.

thumbnailFigure 1. Booklet Values Clarification Component (Adapted from Gattellari & Ward (2003)[40].

Table 4. Feedback and Subsequent Changes from Usability testing (Study 3)

Table 5 summarizes the booklet content and discusses the similarities and differences between the booklet and the web-based DA. We maintained consistency between the content of the booklet and website but note differences related to the interactive features of the web-based tool.

Table 5. Comparison of the Booklet and Web-based Educational Tools (Study 3)

Website Usability testing

Sample

Overall, 14 men reviewed the website, six of whom had previously reviewed the booklet. The mean age of participants was 54.0 (SD = 7.2). Despite the small sample size, half of the participants were AA and half were employed. Additional demographic information for these participants is presented in Table 3.

Results

Based on the questionnaire data, one-half (50%) of the men said the site provided about the right amount of information and 42.9% said it was about the right length. Despite our efforts to ensure a balanced presentation of the issues, only 35.7% indicated that the website's overall message neither favored nor opposed PCa screening. Although far short of our goals, this was an improvement over our prior decision tools and over the current booklet (see Table 3). Anecdotal information suggested that this viewpoint may be most prevalent among men who were screened regularly, as they may have taken note of the benefits of screening more so than the limitations. Table 4 describes revisions made to the website based on usability testing feedback. Changes related to content were made to both the website and booklet.

A primary concern during website development was whether men with little or no computer experience could successfully use the site. Based on difficulties experienced by three participants with little to no computer experience, several necessary modifications were made to the site to make it more user-friendly (Table 4). Difficulties in site navigation would have been overlooked if only computer savvy men had been sampled. While some men initially had trouble using the website, they were all ultimately able to successfully navigate the site and understand its content after viewing printed instructions.

Based on usability testing and recommendations from the research team, the web developers created several iterations of the website before a release candidate was created, approved, and launched. The website required 30-50 minutes to review and had a literacy level that did not exceed an eighth grade reading level. Importantly, the website aimed to present information in a balanced manner, neither encouraging nor discouraging screening. The web developers continue to provide ongoing technical support to ensure that team members and study participants do not encounter difficulties using the website.

Table 5 also provides details on the nine topic areas presented in the website as well as the booklet, including content features, similarities and differences with regard to the presentation of information, as well as a description of how general features differ between the two formats (e.g., audio vs. text, graphics). The final versions of the booklet and website, entitled Prostate Cancer Screening: Making the Best Choice, were completed in October 2007. The remainder of the Results section is devoted to the description of specific interactive features of the website.

Components of the Website

The interactive features of the website enabled an expansion and customization of the material. For example, web-users could access additional external information (e.g., the resource page included links to the homepages of national organizations that provide more information on PCa screening and treatments) or could use the table of contents to easily navigate to other sections of interest.

The website was made more accessible to men with limited literacy by presenting the majority of the text via voice over. Audio was available for approximately 70% of the text, and 80% of the audio matched the text verbatim. Users could deactivate the audio if they preferred to only read text.

The website included eight testimonials, prepresented as video clips of men speaking about their screening decision, whereas the booklet included written quotations from two men (one pro, one con). The videos enabled users to view the emotional reactions and facial expressions of the different actors as they relayed personal stories about PCa screening. We utilized actors that represented a racially diverse group of men in an effort to help make the information more relevant and understandable [31]. Of the eight video testimonials presented, 3 of the actors were AA, two were white, one was Asian, one was Native American, and one was Hispanic.

The interactive nature of the website insured that users were exposed to a perspective about PCa screening that differed from their own, in an effort to address the presence of a confirmation bias [65]. To do this, users indicated their history of screening, which was assessed upon entry into the website. The first two video testimonials were tailored so that a user who was leaning toward screening first viewed two testimonials of men who chose not to get screened, and vice versa for men leaning against screening. In subsequent sections of the website, the remaining six testimonials (3 pro, 3 con) were presented back to back so that everyone viewed all 3 pairs. The race of the actors varied so that the pro and con messages were delivered by actors of different races.

The 10-item values clarification component described above for the booklet was also included on the website in an interactive format (Figure 2). Individual items were presented at the end of different content sections and users were prompted to respond: 'sounds like me,' 'does not sound like me 'or 'not sure yet.' Questions that men skipped as they navigated through the site were automatically entered as 'not sure yet.' The questions were displayed again at the end of the website to provide men with an opportunity to change the response. Responses to all items were then depicted on a balance scale to help men determine if they leaned toward or away from getting screened. Finally, users always received a prompt to review the values clarification tool upon exiting the website; thus, it was seen by all men, even those who did not review the entire website.

thumbnailFigure 2. Website Values Clarification Component (Adapted from Gattellari & Ward (2003))[40].

The web-based format also allowed for animation and graphics to draw attention to key points and direct the user through the website. For example, a graphic of 100 men that illustrated the accuracy of the PSA test changed colors to distinguish subgroups from the whole and was accompanied by a voiceover that explained the figure (Figure 3). The booklet, however, provided a single tree diagram to depict the same statistics (Figure 4).

thumbnailFigure 3. Website Screenshot of Animation Depicting the Accuracy of the PSA Test [83-85].

thumbnailFigure 4. Booklet Depiction of the Accuracy of the PSA Test [83-85].

Finally, the website is capable of tracking men's use of the materials and provides data on the behaviors of visitors. Data stored in a password protected Structured Query Language database provides records of the time spent visiting the website, time spent in each section, and responses to the DA queries. Upon completion of the RCT, this information will help determine whether initial screening preferences and usage patterns are associated with knowledge acquisition, decisional conflict, baseline screening preference, and subsequent screening decisions.

Discussion

There is considerable interest in assisting men with PCa screening decisions, as evidenced by the 18 RCTs conducted to assess the efficacy of DAs. We sought to address several limitations of the previous studies with the development of two disseminable tools with extensive formative evaluations: a print booklet and an interactive website. The booklet and the website offer the identical content, while the website also includes an interactive values clarification component, video testimonials, and tracking software to assess men's utilization of the website. The website recently received the 2009 American Public Health Association's award for Public Health Education Materials [66]. Our ongoing RCT will examine the impact of the website and booklet on PCa screening knowledge, decisional conflict, satisfaction with decision, health-related quality of life and screening behaviors. The trial will be completed in 2011.

Our new materials offer several improvements over prior DAs. Given the persistent problem created by the digital divide, regarding both limited access and preferentially attracting Internet-savvy users, we designed features of the website to appeal to more diverse groups. Our formative work and prior randomized trials included a large number of AA participants as well as participants from diverse socioeconomic backgrounds, which provided insights to design materials for these groups. For example, our DAs maintained a maximum of an 8th grade reading level, information was provided in plain language, and a glossary defined terms used throughout the website and booklet. Further, we incorporated visuals, graphs and charts, all of which have been suggested as methods for increasing comprehension among low-literacy groups [31].

In addition to making the materials appealing and understandable to diverse groups of men, we also assessed the extent of web access within our target sample. We found that over an 18-month period, web usage among lower socioeconomic men had increased. These results are consonant with some findings from the Pew Foundation [67], although other studies have reported slower growth among low SES and minority groups [68]. Our ongoing trial will provide more definitive evidence regarding the impact of web- vs. print-based media for PCa screening education, as well as the extent to which we managed to bridge the digital divide. The testing of these DAs among minorities and low literacy participants will provide an important opportunity to validate effectiveness in this population, which tends to be less informed about screening options and less engaged in decision-making [69,70].

To our knowledge, ours is the second study to describe an interactive web-based tool designed to educate men about PCa screening [27], and the first to utilize tracking software to compare website utilization patterns with patient outcomes. Potential advantages of using web-based materials include the relatively low cost of updating information and the increased capability of tailoring and interactivity, which may assist in the acquisition and integration of knowledge. For example, by tailoring the presentation of the first two video testimonials in response to the user's baseline screening preference, we have insured that men consider counterarguments to help balance their perspective. Also, the interactive nature of the web-based values clarification exercise was designed to actively engage participants and enhance the integration of knowledge. This was intended to help men make a decision that corresponds more closely with their own values and screening preferences, decrease decisional conflict, and increase decisional satisfaction.

Over the course of the development of these DAs, we have encountered several important issues that may be useful to others who are creating similar tools. First, there was a tradeoff between providing detailed information vs. risking that the materials would require more time than men would be willing to devote to them. Despite our best efforts to be concise, between 35% (booklet) and 50% (website) of the usability testing participants thought the materials were too long. As we did not want to exclude any pertinent information, it is possible that the length of our materials may deter some men from reading all of the text. However, with both the booklet and the website, we expect that men will selectively access sections of interest by using the Table of Contents.

Secondly, when we conducted our web usability testing, we provided a step-by-step instruction sheet for using the website. Men reported that the instructions were very helpful, particularly for those with less computer experience. Due to these findings, as well as what we know about the disparities between SES groups and Internet use, we have included the instruction sheet in the current randomized trial to ensure that men with less experience using the Internet will be able to successfully access and use our materials.

Finally, it was challenging to develop a DA that addressed the uncertainty of a screening test for men who had been undergoing regular screening and who were completely unaware of the uncertainty. The balancing act was to validate what men already knew while also providing information that was both counterintuitive and contrary to their previous impression. We worked to present the materials in an evenhanded fashion; however, results from the usability testing suggested that only a minority of men thought the booklet (14%) and website (36%) neither endorsed nor opposed screening. These findings highlight the fact that it may take more than a single exposure to materials such as ours for patients to grasp a message that is both complex and counter to one's current understanding and practices. While our usability testing provided critical information during the development process and our sample size was comparable to other studies involving usability testing [71,72], a larger sample may have provided the feedback necessary to more effectively present the uncertainty and the message of neither endorsing nor opposing screening.

Conclusion

Despite the uncertainty surrounding PCa screening, most primary care physicians routinely order the PSA test for men over 50, and some engage in unsupported practices, such as screening patients over age 75 and referring such men for biopsies when PSA values are elevated [73-75]. Due to the logistic constraints they face [76], many physicians administer PCa screening with little opportunity to discuss the test beforehand [77]. However, evidence indicates that many men would prefer to make a shared PCa screening decision in conjunction with their physicians [78-81]. Consequently, access to an effective DA in the primary care setting may promote shared decisions among large numbers of men in the decisive period before testing occurs. In 2005, 80% of males had at least one visit with an ambulatory care physician [82], suggesting that an intervention implemented in this setting could have a widespread impact.

Providing assistance for informed decision making for PCa screening may be important for some time, particularly if a definitive recommendation either for or against screening does not emerge from the ongoing screening trials. We have detailed our efforts at developing print- and interactive web-based DAs to assist men in determining whether they prefer to be screened or not. Given that technological advances in medical screening tests will continue to occur faster than clinical translational research can keep pace, we hope that insights from the development of our decision tools will be applicable as other screening dilemmas arise.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

CD took the lead role in the writing and editing of the manuscript, as well as in usability testing recruitment. RW administered the questionnaires for the first feasibility study and participated in drafting the manuscript. EK participated in drafting the manuscript and in data analysis. SR participated in drafting the manuscript, conducting usability testing, and data analysis. DD recruited participants, conducted usability testing, and participated in data analysis. WT participated in drafting the manuscript. EP recruited participants, conducted usability testing, and participated in data analysis. J O-F was the plain language consultant during the iterative development process and provided multiple edits to both the layout and the wording of the text. KD, AK, SW, and MS participated in drafting the manuscript and reviewing and editing the materials during the iterative process. MF provided access to the primary care clinic in which men were recruited for the feasibility studies and usability testing, as well as drafting the manuscript and reviewing the materials during the iterative process. CC provided access to the primary care clinic in which men were recruited for the feasibility studies and usability testing, as well as drafting the manuscript and reviewing the materials during the iterative process. KLT conceived the project, is the Principal Investigator of the NCI and DoD grants which have funded this project, edited and reviewed the materials during the iterative process, and participated in writing the manuscript. All authors read and approved the final manuscript.

Acknowledgements

We thank Cheryl Manning and Catherine Swinson of Triad Interactive, Inc. for their work on creating the website. We also thank Susan Spangler for her work on the layout and design of the booklet.

Funding: This work was supported by grants from the National Cancer Institute, Bethesda, MD, USA (#1ROI CA119168-01) and the Department of Defense, Fort Detrick, MD, USA (No. W81XWH-06-1-0182). The funding sources for this study did not play an active role in the design of the study, collection, analysis, interpretation of data or writing of this manuscript.

References

  1. American Cancer Society: Cancer Facts and Figures 2009. [http://www.cancer.org/downloads/STT/500809web.pdf] webcite

  2. Jemal A, Siegel R, Ward E, Hao Y, Xu J, Thun MJ, et al.: Cancer Statistics, 2009.

    CA Cancer J Clin 2009, 59:225-249. PubMed Abstract | Publisher Full Text OpenURL

  3. Ries LAG, Melbert D, Krapcho M, Stinchcomb DG, Howlader N, Horner MJ, et al.: SEER Cancer Statistics Review. [http://seer.cancer.gov/csr/1975_2005/] webcite

    National Cancer Institute. Bethesda, MD; 1975.

    based on November 2007 SEER data submission, posted to the SEER web site 2008

  4. Stanford JL, Stephenson RA, Coyle LM, Cerhan J, Correa R, Eley JW, et al.: Prostate Cancer Trends 1973-1995. SEER Program, National Cancer Institute. NIH publication; 1999:99-4543.

  5. Andriole GL, Crawford ED, Grubb RLI, Buys SS, Chia D, Church TR, et al.: Mortality results from a randomized prostate-cancer screening trial.

    N Engl J Med 2009, 360:1310-1319. PubMed Abstract | Publisher Full Text OpenURL

  6. Schroder FH, Hugosson J, Roobol MJ, Tammela TL, Ciatto S, Nelen V, et al.: Screening and prostate-cancer mortality in a randomized European study.

    N Engl J Med 2009, 360:1320-1328. PubMed Abstract | Publisher Full Text OpenURL

  7. Collins MM, Barry MJ: Controversies in prostate cancer screening. Analogies to the early lung cancer screening debate.

    JAMA 1996, 276:1976-1979. PubMed Abstract | Publisher Full Text OpenURL

  8. Laara E, Day NE, Hakama M: Trends in mortality from cervical cancer in the Nordic countries: association with organised screening programmes.

    Lancet 1987, 1:1247-1249. PubMed Abstract OpenURL

  9. Woolf SH, Lawrence RS: Preserving scientific debate and patient choice: lessons from the Consensus Panel on Mammography Screening. National Institutes of Health.

    JAMA 1997, 278:2105-2108. PubMed Abstract | Publisher Full Text OpenURL

  10. Brawley OW, Kramer BS: Cancer screening in theory and in practice.

    J Clin Oncol 2005, 23:293-300. PubMed Abstract | Publisher Full Text OpenURL

  11. Curry SJ, Byers T, Hewitt MA, National Cancer Policy Board, Institute of Medicine, National Research Council: Fulfilling the Potential of Cancer Prevention and Early Detection. Washington, DC: National Academies Press; 2003.

  12. Mahadevia PJ, Fleisher LA, Frick KD, Eng J, Goodman SN, Powe NR: Lung cancer screening with helical computed tomography in older adult smokers: a decision and cost-effectiveness analysis.

    JAMA 2003, 289:313-322. PubMed Abstract | Publisher Full Text OpenURL

  13. Ornstein DK, Rayford W, Fusaro VA, Conrads TP, Ross SJ, Hitt BA, et al.: Serum proteomic profiling can discriminate prostate cancer from benign prostates in men with total prostate specific antigen levels between 2.5 and 15.0 ng/ml.

    J Urol 2004, 172:1302-1305. PubMed Abstract | Publisher Full Text OpenURL

  14. Watson RW, Schalken JA: Future opportunities for the diagnosis and treatment of prostate cancer.

    Prostate Cancer Prostatic Dis 2004, 7(Suppl 1):S8-S13. PubMed Abstract | Publisher Full Text OpenURL

  15. American Academy of Family Physicians: Summary of Recommendations for Clinical Preventive Services. [http:/ / www.aafp.org/ online/ etc/ medialib/ aafp_org/ documents/ clinical/ CPS/ rcps08-2005.Par.0001.File.tmp/ CPSapprovedApril2009.pdf] webcite

    Revision: 6.8 2009. OpenURL

  16. American Cancer Society: Overview: Prostate Cancer. [http:/ / www.cancer.org/ docroot/ CRI/ content/ CRI_2_2_3X_How_is_prostate_cancer_f ound_36.asp?sitearea] webcite

    Atlanta, GA: American Cancer Society; 2009.

  17. American College of Physicians: Clinical Guideline: Part III: Screening for Prostate Cancer.

    Ann Intern Med 1997, 126:480-484. PubMed Abstract | Publisher Full Text OpenURL

  18. American Medical Association: Annual meeting of the American Medical Association: Reports of the Council on Scientific Affairs. [http://www.ama-assn.org/ama1/pub/upload/mm/443/csaa-00.pdf] webcite

    Chicago, IL 2000. OpenURL

  19. American Urological Association Education and Research Inc: Prostate-Specific Antigen Best Practice Statement. American Urological Association: 2009 Update. [http:/ / www.auanet.org/ content/ guidelines-and-quality-care/ clinical-guidelines/ main-reports/ psa09.pdf] webcite

    2009.

  20. Lim LS, Sherin K: Screening for prostate cancer in U.S. men ACPM position statement on preventive practice.

    Am J Prev Med 2008, 34:164-170. PubMed Abstract | Publisher Full Text OpenURL

  21. U.S.Preventive Services Task Force (USPSTF): Screening for Prostate Cancer: Recommendations and Rationale. [http://www.ahrq.gov/clinic/uspstf08/prostate/prostaters.htm] webcite

    AHRQ publication 08-05121-EF-2 Agency for Healthcare Research and Quality, Rockville, MD; 2008. OpenURL

  22. Chapman GB, Sonnenberg FA: Introduction. In Decision Making in Health Care: Theory, Psychology, and Applications. Edited by Chapman GB, Sonnenberg FA. New York: Cambridge University Press; 2000:3-19. OpenURL

  23. Rimer BK, Briss PA, Zeller PK, Chan EC, Woolf SH: Informed decision making: what is its role in cancer screening?

    Cancer 2004, 101:1214-1228. PubMed Abstract | Publisher Full Text OpenURL

  24. O'Connor AM, Elwyn G, Barratt A, Barry M, Coulter A, Holmes-Rovner M, et al.: International Patient Decision Aid Standards (IPDAS) Collaboration. [http://ipdas.ohri.ca/IPDAS_checklist.pdf] webcite

    Criteria for Judging the Quality of Patient Decision Aids 2005. OpenURL

  25. O'Brien MA, Whelan TJ, Villasis-Keever M, Gafni A, Charles C, Roberts R, et al.: Are cancer-related decision aids effective? A systematic review and meta-analysis.

    J Clin Oncol 2009, 27:974-985. PubMed Abstract | Publisher Full Text OpenURL

  26. Frosch DL, Kaplan RM, Felitti VJ: A randomized controlled trial comparing internet and video to facilitate patient education for men considering the prostate specific antigen test.

    J Gen Intern Med 2003, 18:781-787. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  27. Frosch DL, Bhatnagar V, Tally S, Hamori CJ, Kaplan RM: Internet patient decision support: a randomized controlled trial comparing alternative approaches for men considering prostate cancer screening.

    Arch Intern Med 2008, 168:363-369. PubMed Abstract | Publisher Full Text OpenURL

  28. Ilic D, Egberts K, McKenzie JE, Risbridger G, Green S: Informing men about prostate cancer screening: a randomized controlled trial of patient education materials.

    J Gen Intern Med 2008, 23:466-471. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  29. Krist AH, Woolf SH, Johnson RE, Kerns JW: Patient education on prostate cancer screening and involvement in decision making.

    Ann Fam Med 2007, 5:112-119. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  30. Ruffin MT, Fetters MD, Jimbo M: Preference-based electronic decision aid to promote colorectal cancer screening: results of a randomized controlled trial.

    Prev Med 2007, 45:267-273. PubMed Abstract | Publisher Full Text OpenURL

  31. Thomson MD, Hoffman-Goetz L: Readability and cultural sensitivity of web-based patient decision aids for cancer screening and treatment: a systematic review.

    Med Inform Internet Med 2007, 32:263-286. PubMed Abstract | Publisher Full Text OpenURL

  32. Pew Internet and American Life Project: Derived From Trends--Usage Over Time. [http://www.pewinternet.org/Static-Pages/Trend-Data/Usage-Over-Time.aspx] webcite

  33. Fox S, Pew Internet American Life Project: Digital Divisions: There are clear differences among those with broadband connections, dial-up connections, and no connections at all to the internet. [http:/ / www.pewinternet.org/ ~/ media/ / Files/ Reports/ 2005/ PIP_Digital_Divisions_Oct_5_2005.pd f.pdf] webcite

  34. U.S.Department of Commerce, Economics and Statistics Administration, National Telecommunications and Information Administration: A Nation Online: how Americans are expanding their use of the Internet. [http://www.ntia.doc.gov/ntiahome/dn/anationonline2.pdf] webcite

  35. Volk RJ, Hawley ST, Kneuper S, Holden EW, Stroud LA, Cooper CP, et al.: Trials of decision aids for prostate cancer screening: a systematic review.

    Am J Prev Med 2007, 33:428-434. PubMed Abstract | Publisher Full Text OpenURL

  36. Kripalani S, Sharma J, Justice E, Justice J, Spiker C, Laufman LE, et al.: Low-literacy interventions to promote discussion of prostate cancer: a randomized controlled trial.

    Am J Prev Med 2007, 33:83-90. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  37. Stamatiou K, Skolarikos A, Heretis I, Papadimitriou V, Alevizos A, Ilias G, et al.: Does educational printed material manage to change compliance with prostate cancer screening?

    World J Urol 2008, 26:365-373. PubMed Abstract | Publisher Full Text OpenURL

  38. Volk RJ, Jibaja-Weiss ML, Hawley ST, Kneuper S, Spann SJ, Miles BJ, et al.: Entertainment education for prostate cancer screening: a randomized trial among primary care patients with low health literacy.

    Patient Educ Couns 2008, 73:482-489. PubMed Abstract | Publisher Full Text OpenURL

  39. Davison BJ, Kirk P, Degner LF, Hassard TH: Information and patient participation in screening for prostate cancer.

    Patient Educ Couns 1999, 37:255-263. PubMed Abstract | Publisher Full Text OpenURL

  40. Gattellari M, Ward JE: Does evidence-based information about screening for prostate cancer enhance consumer decision-making? A randomised controlled trial.

    J Med Screen 2003, 10:27-39. PubMed Abstract | Publisher Full Text OpenURL

  41. Gattellari M, Ward JE: A community-based randomised controlled trial of three different educational resources for men about prostate cancer screening.

    Patient Educ Couns 2005, 57:168-182. PubMed Abstract | Publisher Full Text OpenURL

  42. Myers RE, Daskalakis C, Cocroft J, Kunkel EJ, Delmoor E, Liberatore M, et al.: Preparing African-American men in community primary care practices to decide whether or not to have prostate cancer screening.

    J Natl Med Assoc 2005, 97:1143-1154. PubMed Abstract | PubMed Central Full Text OpenURL

  43. Partin MR, Nelson D, Radosevich D, Nugent S, Flood AB, Dillon N, et al.: Randomized trial examining the effect of two prostate cancer screening educational interventions on patient knowledge, preferences, and behaviors.

    J Gen Intern Med 2004, 19:835-842. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  44. Schapira MM, VanRuiswyk J: The effect of an illustrated pamphlet decision-aid on the use of prostate cancer screening tests.

    J Fam Pract 2000, 49:418-424. PubMed Abstract | Publisher Full Text OpenURL

  45. Taylor KL, Davis JL, Turner RO, Johnson L, Schwartz MD, Kerner JF, et al.: Educating African American men about the prostate cancer screening dilemma: a randomized intervention.

    Cancer Epidemiol Biomarkers Prev 2006, 15:2179-2188. PubMed Abstract | Publisher Full Text OpenURL

  46. Volk RJ, Spann SJ, Cass AR, Hawley ST: Patient education for informed decision making about prostate cancer screening: a randomized controlled trial with 1-year follow-up.

    Ann Fam Med 2003, 1:22-28. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  47. Watson E, Hewitson P, Brett J, Bukach C, Evans R, Edwards A, et al.: Informed decision making and prostate specific antigen (PSA) testing for prostate cancer: a randomised controlled trial exploring the impact of a brief patient decision aid on men's knowledge, attitudes and intention to be tested.

    Patient Educ Couns 2006, 63:367-379. PubMed Abstract | Publisher Full Text OpenURL

  48. Wilt TJ, Paul J, Murdoch M, Nelson D, Nugent S, Rubins HB: Educating men about prostate cancer screening. A randomized trial of a mailed pamphlet.

    Eff Clin Pract 2001, 4:112-120. PubMed Abstract | Publisher Full Text OpenURL

  49. Wolf AM, Nasser JF, Wolf AM, Schorling JB: The impact of informed consent on patient interest in prostate-specific antigen screening.

    Arch Intern Med 1996, 156:1333-1336. PubMed Abstract | Publisher Full Text OpenURL

  50. Berglund G, Nilsson S, Nordin K: Intention to test for prostate cancer.

    Eur J Cancer 2005, 41:990-997. PubMed Abstract | Publisher Full Text OpenURL

  51. Ellison GL, Weinrich SP, Lou M, Xu H, Powell IJ, Baquet CR: A randomized trial comparing web-based decision aids on prostate cancer knowledge for African-American men.

    J Natl Med Assoc 2008, 100:1139-1145. PubMed Abstract OpenURL

  52. Flood AB, Wennberg JE, Nease RF Jr, Fowler FJ Jr, Ding J, Hynes LM: The importance of patient preference in the decision to screen for prostate cancer. Prostate Patient Outcomes Research Team.

    J Gen Intern Med 1996, 11:342-349. PubMed Abstract | Publisher Full Text OpenURL

  53. Frosch DL, Kaplan RM, Felitti V: The evaluation of two methods to facilitate shared decision making for men considering the prostate-specific antigen test.

    J Gen Intern Med 2001, 16:391-398. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  54. Ruthman JL, Ferrans CE: Efficacy of a video for teaching patients about prostate cancer screening and treatment.

    Am J Health Promot 2004, 18:292-295. PubMed Abstract OpenURL

  55. Taylor KL, Turner RO, Davis JL, Johnson L, Schwartz MD, Kerner J, et al.: Improving knowledge of the prostate cancer screening dilemma among African American men: an academic-community partnership in Washington, DC.

    Public Health Rep 2001, 116:590-598. PubMed Abstract | PubMed Central Full Text OpenURL

  56. AMC Cancer Research Center: Beyond the Brochure: Alternative Approaches to Effective Health Communication. [http://www.cdc.gov/cancer/nbccedp/pdf/amcbeyon.pdf] webcite

    Atlanta, GA: CDC; 1994.

  57. Georgetown University Medical Center, The Most Worshipful Prince Hall Grand Lodge of the District of Columbia: The Right Decision is Yours: A Guide to Prostate Cancer. [http://lombardi.georgetown.edu/pdf/community/prostate_screening_handbook.pdf] webcite

    Funded by the U.S. Centers for Disease Control and Prevention, Cooperative Agreement #TS-290 and the National Cancer Institute, #KO7 CA72645 2000. OpenURL

  58. U.S. Department of Health and Human Services, Centers for Disease Control and Prevention (CDC): Prostate Cancer Screening: A Decision Guide. [http://www.cdc.gov/cancer/Prostate/pdf/prosguide.pdf] webcite

    2006.

  59. Taylor KL, Schwartz M, Davis K, Zincke N, Williams R, Dawson D, et al.: Prostate cancer screening: fostering informed decisions. Presented at the Society of Behavioral Medicine annual meeting, Washington, DC; 2007.

  60. National Cancer Institute, U.S. National Institutes of Health. Prostate-Specific Antigen (PSA) Test: Questions and Answers. [http://www.cancer.gov/cancertopics/factsheet/Detection/PSA] webcite

    2009.

  61. Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, et al.: Quick assessment of literacy in primary care: the newest vital sign.

    Ann Fam Med 2005, 3:514-522. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  62. Friedman DB, Hoffman-Goetz L: A systematic review of readability and comprehension instruments used for print and web-based cancer information.

    Health Educ Behav 2006, 33:352-373. PubMed Abstract | Publisher Full Text OpenURL

  63. Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, et al.: Developing a quality criteria framework for patient decision aids: online international Delphi consensus process.

    BMJ 2006, 333:417. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  64. O'Connor AM: Ottawa Decision Support Framework to Address Decisional Conflict. [http://decisionaid.ohri.ca/docs/develop/ODSF.pdf] webcite

    2006.

  65. Redelmeier DA, Rozin P, Kahneman D: Understanding patients' decisions. Cognitive and emotional perspectives.

    JAMA 1993, 270:72-76. PubMed Abstract | Publisher Full Text OpenURL

  66. Williams RM, Dorfman CS, Kassan EC, Red S, Dawson DL, Tuong W, et al.: Prostate Cancer Screening: Making the Best Choice. In Public Health Education and Health Promotion. Award winning health education and promotion materials presentation. American Public Health Association annual meeting; 2009. OpenURL

  67. Horrigan JB, Pew Internet American Life Project: Trends in Internet Adoption and Use: Comparing Minority Groups. [http:/ / www.pewinternet.org/ Presentations/ 2004/ Trends-in-Internet-Adoption-and-Use .aspx] webcite

    2004.

  68. Horrigan JB, Pew Internet American Life Project: Home Broadband Adoption. [http://pewresearch.org/pubs/888/home-broadband-adoption-2008] webcite

    2008.

  69. Lillie SE, Brewer NT, O'Neill SC, Morrill EF, Dees EC, Carey LA, et al.: Retention and use of breast cancer recurrence risk information from genomic tests: the role of health literacy.

    Cancer Epidemiol Biomarkers Prev 2007, 16:249-255. PubMed Abstract | Publisher Full Text OpenURL

  70. Miller DP Jr, Brownlee CD, McCoy TP, Pignone MP: The effect of health literacy on knowledge and receipt of colorectal cancer screening: a survey study.

    BMC Fam Pract 2007, 8:16. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  71. Health and Human Services Dept: Research-Based Web Design & Usability Guidelines. [http://www.usability.gov/refine/learnusa.html] webcite

    2006.

  72. Stoddard JL, et al.: The importance of usability testing in the development of an internet-based smoking cessation treatment resource.

    Nicotine and Tobacco Research 2006, 8:S87-S93. PubMed Abstract | Publisher Full Text OpenURL

  73. Fowler FJ Jr, Bin L, Collins MM, Roberts RG, Oesterling JE, Wasson JH, et al.: Prostate cancer screening and beliefs about treatment efficacy: a national survey of primary care physicians and urologists.

    Am J Med 1998, 104:526-532. PubMed Abstract | Publisher Full Text OpenURL

  74. Sirovich BE, Schwartz LM, Woloshin S: Screening men for prostate and colorectal cancer in the United States: does practice reflect the evidence?

    JAMA 2003, 289:1414-1420. PubMed Abstract | Publisher Full Text OpenURL

  75. Voss JD, Schectman JM: Prostate cancer screening practices and beliefs.

    J Gen Intern Med 2001, 16:831-837. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  76. Yarnall KS, Pollak KI, Ostbye T, Krause KM, Michener JL: Primary care: is there enough time for prevention?

    Am J Public Health 2003, 93:635-641. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  77. Dunn AS, Shridharani KV, Lou W, Bernstein J, Horowitz CR: Physician-patient discussions of controversial cancer screening tests.

    Am J Prev Med 2001, 20:130-134. PubMed Abstract | Publisher Full Text OpenURL

  78. Carlsen B, Aakvik A: Patient involvement in clinical decision making: the effect of GP attitude on patient satisfaction.

    Health Expect 2006, 9:148-157. PubMed Abstract | Publisher Full Text OpenURL

  79. Frosch DL, Kaplan RM: Shared decision making in clinical medicine: past research and future directions.

    Am J Prev Med 1999, 17:285-294. PubMed Abstract | Publisher Full Text OpenURL

  80. Williams RM, Zincke NL, Turner RO, Davis JL, Davis KM, Schwartz MD, et al.: Prostate cancer screening and shared decision-making preferences among African-American members of the Prince Hall Masons.

    Psychooncology 2008, 17:1006-1013. PubMed Abstract | Publisher Full Text OpenURL

  81. Woolf SH, Krist AH, Johnson RE, Stenborg PS: Unwanted control: how patients in the primary care setting decide about screening for prostate cancer.

    Patient Educ Couns 2005, 56:116-124. PubMed Abstract | Publisher Full Text OpenURL

  82. National Center for Health Statistics, U.S.Department of Health and Human Services: Health, United States, 2007 with Chartbook on Trends in the Health of Americans. [http://www.cdc.gov/nchs/data/hus/hus07.pdf] webcite

    DHHS publication 2007-1232. Hyattsville, MD OpenURL

  83. Gann PH, Hennekens CH, Stampfer MJ: A prospective evaluation of plasma prostate- specific antigen for detection of prostatic cancer.

    JAMA 1995, 273(4):289-94. PubMed Abstract | Publisher Full Text OpenURL

  84. Labrie F, Dupont A, Suburu R, Cusan L, Tremblay M, Gomez JL, Emond J: Serum prostate specific antigen as pre-screening test for prostate cancer.

    J Urol 1992, 147(3 Pt 2):846-51. PubMed Abstract OpenURL

  85. Mettlin C, Murphy GP, Babaian RJ, Chesley A, Kane RA, Littrup PJ, Mostofi FK, Ray PS, Shanberg AM, Toi A: The results of a five-year early prostate cancer detection intervention. Investigators of the American Cancer Society National Prostate Cancer Detection Project.

    Cancer 1996, 77(1):150-9. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6947/10/12/prepub