Email updates

Keep up to date with the latest news and content from BMC Public Health and BioMed Central.

Open Access Correspondence

Reusable design: A proposed approach to Public Health Informatics system design

Blaine Reeder1*, Rebecca A Hills2, George Demiris12, Debra Revere3 and Jamie Pina2

Author Affiliations

1 Biobehavioral Nursing and Health Systems, School of Nursing, Box 359442, University of Washington, Seattle, WA 98195, USA

2 Medical Education and Biomedical Informatics, School of Medicine, Box 357240, University of Washington, Seattle, WA 98195, USA

3 Department of Health Services, School of Public Health, Box 354943, University of Washington, Seattle, WA 98195, USA

For all author emails, please log on.

BMC Public Health 2011, 11:116  doi:10.1186/1471-2458-11-116

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2458/11/116


Received:25 May 2010
Accepted:18 February 2011
Published:18 February 2011

© 2011 Reeder et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Since it was first defined in 1995, Public Health Informatics (PHI) has become a recognized discipline, with a research agenda, defined domain-specific competencies and a specialized corpus of technical knowledge. Information systems form a cornerstone of PHI research and implementation, representing significant progress for the nascent field. However, PHI does not advocate or incorporate standard, domain-appropriate design methods for implementing public health information systems. Reusable design is generalized design advice that can be reused in a range of similar contexts. We propose that PHI create and reuse information design knowledge by taking a systems approach that incorporates design methods from the disciplines of Human-Computer Interaction, Interaction Design and other related disciplines.

Discussion

Although PHI operates in a domain with unique characteristics, many design problems in public health correspond to classic design problems, suggesting that existing design methods and solution approaches are applicable to the design of public health information systems. Among the numerous methodological frameworks used in other disciplines, we identify scenario-based design and participatory design as two widely-employed methodologies that are appropriate for adoption as PHI standards. We make the case that these methods show promise to create reusable design knowledge in PHI.

Summary

We propose the formalization of a set of standard design methods within PHI that can be used to pursue a strategy of design knowledge creation and reuse for cost-effective, interoperable public health information systems. We suggest that all public health informaticians should be able to use these design methods and the methods should be incorporated into PHI training.

Background

To understand the need for adoption of standard Public Health Informatics (PHI) design methods requires a brief background of PHI, the environment in which public health information systems are used and the unique challenges encountered in designing information systems for use in public health practice.

The unique field of Public Health Informatics: population-focused and diverse

Public Health Informatics is the "systematic application of information and computer science and technology to public health practice, research, and learning that integrates public health and information technology"[1]. And, as stated by Yasnoff et al.[2], PHI needs to use a "systematic and informed approach to the application of information science and technology in order to take full advantage of its potential to enhance and facilitate public health activities." Such activities include:

• Promotion of the health of populations as "opposed to the health of specific individuals."

• Prevention of disease and injury "by altering the conditions or the environment that put populations of individuals at risk."

• Prevention at all vulnerable points in the "causal chains leading to disease, injury, or disability ... not restricted to particular social, behavioral, or environmental contexts."

• Reflection of the "governmental context in which public health is practiced "[2].

In the application of information science and technology to population health, the challenges of PHI are unique. For example, unlike clinical informatics, PHI design activities cannot simply focus on an individual's data in an Electronic Health Record (EHR), the transmission of a specific patient visit in a data stream between a health care provider organization and public health agency or an intervention targeted to an individual patient. Instead, PHI design activities must take a more systemic approach that allows access to population-level data with functionality tailored to a variety of uses by different groups of practitioners. Instead of individual patient data, public health information systems need to include and manage entire datasets of patient encounters. Supporting prevention-centered activities moves the focus further up the causal chain of health and is less likely to manifest in an individual patient visit, but might instead be seen as a population-level prevention intervention, e.g., a city-wide anti-tobacco campaign. These prevention activities take place in diverse environments since the interventions may be social, behavioral, environmental or individual interventions. In addition, public health informaticians must always consider the governmental context in which these population-level prevention activities take place. Understanding the health services structure and how that structure affects the work done by public health practitioners is an important step in creating systems that will function within that context.

Diversity in public health practice presents challenges for public health informaticians. A perceived lack of standard work practices across local health jurisdictions on the part of practitioners and administrators complicates public health information system design activities. If each state or local jurisdiction has unique information needs and business processes, then each must make individual design decisions to ensure that their needs are met. Recent efforts have been undertaken to create standards for business processes in the nation's local health jurisdictions. These efforts have uncovered unexpected commonalities[3] as well as developed a taxonomy of common public health work tasks, knowledge and resources[4]. Yet it has been argued that there is a great deal of variability in local health jurisdictions[5] and further research is necessary to document the needs and tasks of public health practitioners within specific local health jurisdictions to design technology to support these needs and tasks[6].

Adding to this diversity of practice and settings is the diversity of national and international settings in which these activities take place. The globalization of public health necessitates a globalization of PHI to address the challenges of disparate data, tools and services within and across nations--both resource-rich and -constrained. Issues of conflicting data standards, the need for interoperable tools for exchanging and sharing data and the need for innovative solutions to address integrated disease surveillance, among many other issues, are driving forces to formalize design strategies in PHI.

The development of public health information systems requires an understanding of the principles, practices, structures and settings in which these systems operate. Although this combination of factors presents unique challenges, PHI is at a point in its evolution as a discipline that public health informaticians can learn from the design theories and experiences of other fields to address these challenges.

Evolution of public health information systems in the US and Europe: three waves

According to Lumpkin, federal-state public health information systems in the United States have been developed in three "waves"[7]. The first wave began with the independent development of state and federal systems which could not exchange data; the second wave, supported by federal funding to develop state level systems capable of exchanging data using standards in building independent--and therefore costly--state systems[7]; and the third wave which focused on reducing costs through the integration of "the benefits of state-level system development with the tools of software reuse" and a requirement that "each system that is developed must be standards based"[7].

Similarly, in Europe, public health information systems developed in three comparable waves[8]: a first generation of systems focused on collecting basic data on a population and/or the health of a population (for example, birth and death data); a second generation of systems that combined stratifications of time-series data and international comparative data as seen in comparisons of age-standardized breast cancer incidence rates by sex over time and country; and the third generation in the present, with the public health information system that is made possible by information technology advances and is referred to as an ''integrated knowledge system'' in its integration of data, descriptive and analytical information, and evidence-based knowledge[8].

In both the European and US contexts, this current third wave of public health information systems utilizes electronic data exchanges and standards to solve the information needs of public health workers at different organizational levels, across organizations and with various health care and government stakeholders--thus addressing the challenges of population focus and diversity discussed above. While a common approach to this third wave presumes that system designers both have sufficient knowledge of the work of public health practitioners and can systematically integrate this knowledge into system design, past technology failures suggest that this is not the case and numerous studies have underscored the fact that a system will not be used by health professionals in everyday practice unless the system is usable. While a literature review on challenges to adopting or deploying health information systems is beyond the scope of this paper, these challenges are pertinent to the topic of design and PHI. The reader is referred to the work of Kushniruk et al.[9] and Peute et al.[10] for additional information.

Complex problems and design challenges in public health

Ignoring the user experience has led to a literature replete with numerous examples of health information systems being "turned off" or rejected by health professionals because these systems were developed without an understanding of the information needs, workflow, or architecture needs of system users[11,12]. As previously noted, public health processes and practices can be difficult to define, developing clear descriptions of this work requires concerted effort[13], and a public health information system that meets the needs of one group may simultaneously create more work for other groups of public health practitioners[14].

The focus of public health agencies on the development and implementation of information systems is a relatively new phenomenon. Public health informaticians face significant challenges in designing and implementing flexible, interoperable, usable systems to meet the needs of public health practice. Recommendations for a national agenda for PHI in the United States were not formally outlined until 2001[15] and competencies for public health informaticians that include "expertise in both public health programs and information systems to help design, implement, and manage computer applications that support public health goals"[16] were only finalized in 2009. The outcome is that many public health information systems often came into existence through an ad hoc and informal design and development process[17,18] yet the public health domain represents a complex design setting.

Complex design problems of the type encountered in the public health domain are not new. Following World War II, Weaver defined problems of disorganized complexity and organized complexity[19]. Weinberg discusses problems of disorganized complexity as large, random populations that are subject to statistical treatment while individual problem cases are members of small, structured populations that are subject to individual analysis[20]. Information design in PHI addresses a problem area of organized complexity that is subject to neither individual nor statistical analysis.

Rittel and Webber frame their design discussion by enumerating a list of problems and claim that defining what systems do and planning what they should do in terms of desired outcomes can be difficult, if not impossible in large, societal systems[21]. Buchanan holds that "the problem for designers is to conceive and plan what does not yet exist and this occurs in the context of the indeterminancy of wicked problems" and this "indeterminancy implies there are no definitive conditions of limits to design problems"[22]. Nevertheless, public health practice hinges on information that is managed by information systems and those systems must be designed. Our proposed approach for PHI is not to specify design solutions in advance but to specify a flexible process that involves public health practitioners to design solutions for public health systems of organized complexity. This approach is supported by the writings of Cross who summarizes forty years of design and notes that the "wicked problems" characterized by Rittel are more appropriately satisfied by "an 'argumentative', participatory process in which designers are partners with the problem 'owners'" rather than by a rigid, step-wise process[23].

Problem representation in the design of complex systems requires reflection. Simon explicated the formidable task of representing new problems that do not fit with previously known patterns[24] while Lawson reflects on the need for a process that allows problems and solutions to emerge simultaneously and reflect each other[25]. Numerous design thinkers cite the contribution of Donald Schön's model of the "reflective practitioner" and a model of inquiry that relies on interactive problem framing [23,25-27]. In formalizing his approach to scenario-based design, John M. Carroll has built on Schön's metaphor of design as a conversation[28].

We propose that PHI can benefit from design theories and methods developed in other disciplines to improve public health information systems by addressing the unique work of public health practitioners. In the next section we describe six general design problems as defined by Carroll[29] and provide examples of how those problems express themselves in the unique context of the public health domain. We then present a strategy for creating reusable design knowledge using established participatory and scenario-based design methodologies. Finally, we address some potential challenges to the approach we propose.

Discussion

The overarching challenges associated with system design within the public health context can be described, in part, as traditional design problems. As mentioned previously, Carroll uses a "design as conversation" metaphor for interactive problem-framing and -solving. Carroll and his collaborators, long-time proponents of design methods in Human-Computer Interaction, formalized this approach in scenario-based design and described six general problems in design work[29]. While the philosophy and practice of modern design have a well-documented history[22-24,26,27,30-32] that dates back to John Dewey in the early part of the last century[33,34], we believe that Carroll's approach is a simple way to highlight the main categories of design challenges for public health information systems. To demonstrate how traditional design problems play out in the public health context, in Table 1 we have mapped Carroll's six design problems to public health information examples.

Table 1. Design problems and solutions in the public health context

Patel and Kaufman frame informatics as a "local science of design"[43], and make the case for the incorporation of design methods from other disciplines to solve practical problems in informatics and set the stage for development of specific guidelines for design within informatics specialties. Although they caution against generalizing widely in the abstract, we believe, as they do, that principles of usability and design can be incorporated within specific domains once a domain has been defined. The strategy we propose is in concert with the development of PHI as a maturing domain in which to incorporate design methods from other disciplines. Specifically, we propose participatory design and scenario-based design as key components in a reusable design strategy. In the following section, we propose a unified strategy for public health information system design based on methods that have been developed in other disciplines.

Participatory design in health care settings

Participatory design aims to actively engage all stakeholders in the design process to ensure that the system meets their needs and expectations, and ultimately is adopted by the target practitioners. This approach represents a departure from traditional approaches to information system design in that it promotes rapid prototyping and iterative approaches to implementation rather than segregated phases of design and technical production. The concept of participatory design originated in the Scandinavian countries where research projects on user participation and involvement date back to the early 1970s [44]. These early projects focused primarily on empowering workers in actively participating in the design and implementation of systems and workflow processes to improve working conditions. Some of the early work also focused specifically on health care. The Florence project[45] followed a participatory design approach to empower nurses to play an active role in the development of work processes and information technology applications in hospitals.

The participatory design approach began a slow adoption process in the US in the late 80s and early 90s, however it has not been extensively employed in health care settings[46]. Case studies and small scale efforts demonstrate its potential; Sainfort et al.[47] point out how user involvement can ensure four specific qualities for information system interfaces that are appropriate for clinical providers and patients, namely multimodal, personalized, context aware and adaptive. Involving practitioners in the early design stages can maximize these qualities as a system prototype is developed and ultimately implemented. As Pilemalm and Timpka point out, participatory design methods in the disciplines of health informatics have been mainly applied to the development of small-scale systems with homogeneous user groups in local settings[48]. They present a participatory design framework for large-scale system design. The proposed framework was designed and validated within a PHI project aimed at developing a system for 175,000 users.

Scenario-based design

Scenario-based design is a methodology that places the focus of system design on the activities of the people who use an information system rather than the system itself or the capabilities of technology[28,49,50]. It is a participatory method in that it solicits the needs and values of work practitioners by bringing them directly into the design process. Scenarios are stories that use everyday language to describe people and their work activities[28]. These narratives can be used to communicate with laypersons who may lack technology or software design training[51]. The use of everyday language to describe narratives of use makes scenario-based design a practical methodology when applied in a variety of contexts, including that of public health.

Reusable design knowledge in the public health context

Reusable design knowledge is design advice that is "generalized so it can be reused in a wide range of contexts"[52]. Reusable design knowledge can come in the form of data standards for information storage and exchange[40,53-57], software design patterns used by programmers when they develop a system[58-63] or installable software that is implemented in multiple settings[64]. However, this discussion pertains to design methods and the designed activities and workflows that result from those methods.

Whittaker et al. propose the notion of shared tasks called "reference tasks" for use by designers in different application domains and state "[t]he goal of reference tasks is to capture and share knowledge and focus attention on common problems"[65]. Scenario-based design is one means to accomplish the goal of creating reference tasks in the public health domain as Carroll asserts that "[s]cenarios can also be abstracted and categorized, helping designers to recognize, capture and reuse generalizations"[28]. In addition, Wahid has proposed the reuse of positive and negative claims about particular design moves used to weigh trade-offs in scenario-based design[66] while Sutcliffe has done considerable work to advance the effective reuse of scenarios[52,67,68]. Within the context of public health we propose using scenario-based design to describe the tasks and activities necessary to deliver public health activities and to "jointly identify reference tasks, collect data, analyze the tasks, and disseminate and make use of the results"[65]. We believe that these processes and the resulting products will facilitate the reuse of design knowledge and resource savings in the public health domain.

While there is growing work in identifying and documenting information needs for public health practitioners[69], we propose that the next steps in formalizing this documentation and transforming it into reusable design knowledge should include the development of scenarios of use to inform the design of information systems. Collaboration and practitioner involvement are two important aspects of developing useful scenarios. Our experiences have shown that public health practitioners are enthusiastic participants in the scenario development process[14,70]. Scenarios can be developed in a participatory fashion using data collected from interviews, focus groups, surveys and the review of artifacts such as paper documents and electronic files.

The dissemination of reusable design knowledge is important if the goal of reducing work across public health jurisdictions is to be realized. Therefore a plan for taking advantage of existing public health groups and communities of practice should be considered as part of a formal dissemination strategy. By making scenarios available through existing information dissemination channels, public health informaticians and system designers could pick and choose scenarios tailored to the work practices of particular roles and the size of a local health jurisdiction.

Scenario-based design has the potential to offer great improvement in the information systems developed for public health. Aside from encouraging the development of more useful systems, scenario-based design also offers savings in time and resources. Reusing design knowledge can make systems less expensive to develop and offers a potential reduction in failed and resource intensive one-off development projects.

Potential challenges to the approach

Regardless of size, available resources, or geographic location, each public health organization addresses the most pressing population health concerns of its community--which may explain the variety of public health information systems[69]. As previously discussed, public health organizations also maintain unique work practices that fulfill the requirements of their policy makers, and honor the organizational culture of the individual group. Before widespread Internet access provided a mechanism for public health agencies to exchange and report information electronically, efforts to standardize information systems across local health jurisdictions were limited. Now, as the argument for electronic information exchange becomes more compelling, there is a need to reevaluate the design of information systems in public health.

The approach to information system design within different communities of practice has, so far, reflected the disparate organization of local and state public health agencies. With few means to acquire information systems that have been validated for interoperability, and facing an obligation to optimally address public health concerns despite this gap, public health organizations have found information management solutions through independent development, or through the purchase of commercially available systems. In either case, information management systems are designed to interact with a very limited scope of external entities, thereby reducing the value of important public health data. Without a concerted effort to integrated formal design principles into public health, this trend will continue.

While this paper has focused largely on Public Health Informatics efforts in the United States, it addresses concerns of system design that are relevant to international public health efforts. Public Health Informatics efforts must be informed by the governmental context in which they operate and the environment that obtains in the United States is but one example in the set of all international examples. Working directly with each community of practice, and building a knowledgebase of activities in each, is an essential component of the reusable design approach we propose, regardless of public health environment. For example, in developing countries where resources and capacity are limited, there are several initiatives using participatory design methods to understand the information needs of users as well as the scalability and sustainability of national information systems for providing access to information and supporting the collection, handling and dissemination of health data[71,72].

Summary

While the technical capacity to develop robust information systems has existed for many years, we have yet to identify the consummate model of public health information processes and develop systems to support those processes. Public Health Informatics can play a role in helping to resolve public health policy challenges, and in the process, define the necessary systems to promote population health, improve PHI as a discipline, and advance all the disciplines of biomedical and health informatics.

The major public health challenges in the coming decade will be solved with the help of policy changes. Information systems are technology artifacts that implement the processes defined by policy. We believe that the policies described in the "National Agenda for Public Health Informatics"[15] should be supported with even more specific policies related to design methods. Additionally, we assert that a policy failing to describe well-tested processes will result in an information system that fails to make optimal use of the information that public health practitioners carefully collect and analyze. Policy should promote the use (and reuse) of design for the development of information systems grounded in public health practice.

Policy changes in the Unites States are already transforming the health IT landscape. The information designs that result in response to these changes will contribute to the global health informatics conversation. Financial incentives for meaningful use of EHR technology reinforce the importance of health information exchange between providers and public health organizations. As policy changes place a greater emphasis on the design and use of effective health IT, the need for systematic design approaches should increase. In the case of compliance with meaningful use criteria, methods for design reuse can facilitate work that has already begun for the exchange of health information within and between provider and public health systems[73]. The resulting design knowledge should include specification of how, and with whom, systems interoperate.

As we have suggested throughout this paper, identifying the information needs of public health practitioners is a foundational step toward developing a design strategy for PHI. There are many examples of information system failure since the advent of computing systems in the workplace when target audiences are excluded from the design process. Scenario-based design is a proven methodology for information system design but has not been applied widely within the public health domain. When coupled with methods of design-based inquiry and practitioner participation, it can be a powerful tool to move quickly and efficiently from needs and task documentation to prototypes to implemented systems.

Working directly with each community of practice and building a knowledgebase of activities in each is essential. By including practitioners in a reusable design strategy for public health, we aim to increase the likelihood of future information system adoption in public health practice and, by extension, increase the likelihood of quality public health service delivery. We suggest, as part of the PHI reusable design effort, that information needs studies and technology use cases should be regularly documented and indexed for ready access by informaticians and others. Future work toward a reusable design strategy will include a survey of public health practitioners about their willingness and the ways they would like to participate in design work and a systematic review of design methods used within the specialized corpus of public health technology knowledge.

We believe that the identification and consistent use of rigorous methods for system design will help move the discipline of Public Health Informatics forward. Toward this end, we believe that the design methods outlined in this paper fit into the applied, empirical and theoretical areas that should be incorporated into PHI practice and curricula for professional training at the undergraduate and graduate levels.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

BR conceived the idea for the manuscript, participated in coordination of research and writing of all manuscript revisions. RH participated in coordination of research and writing of all manuscript revisions. GD contributed material on participatory design and participated in writing of all manuscript revisions. DR contributed material on socio-technical and international issues and participated in writing of final manuscript revisions. JP participated in coordination of research and writing of manuscript revisions. All authors read and approved the final manuscript.

Acknowledgements

This project was funded in part by the National Library of Medicine Medical Informatics Training Grant T15 LM007442-07. The authors would like to thank Jacob O. Wobbrock for information about disciplines related to Human-Computer Interaction, the two reviewers whose suggestions and comments made this manuscript much stronger and the generous support of the Division of Biomedical and Health Informatics in the Department of Medical Education and Biomedical Informatics at the University of Washington.

References

  1. O'Carroll PW, Yasnoff WA, Ward ME, Ripp LH, Martin EL, Ross DA: Public Health Informatics and Information Systems. NY: Springer; 2002. OpenURL

  2. Yasnoff WA, O Carroll PW, Koo D, Linkins RW, Kilbourne EM: Public health informatics: improving and transforming public health in the information age.

    J Public Health Manag Pract 2000, 6:67-75. PubMed Abstract OpenURL

  3. Public Health Informatics Institute National Association of County and City Health Officials: Taking Care of Business: A Collaboration to Define Local Health Department Business Processes. Atlanta, GA: Public Health Informatics Institute; 2006:84.

    pp. 84.

  4. Merrill J, Keeling J, Gebbie K: Toward standardized, comparable public health systems data: A taxonomic description of essential public health work.

    Health Serv Res 2009, 44:1818-1841. PubMed Abstract | Publisher Full Text OpenURL

  5. Menkens AJ, Stone D, Wood BW, Reed JF: Local public health department accreditation: thoughts from North Carolina.

    J Public Health Manag Pract 2009, 15:443-445. PubMed Abstract | Publisher Full Text OpenURL

  6. Turner AM, Ramey J, Lee S: Connecting public health IT systems with enacted work: report of an ethnographic study.

    AMIA Annu Symp Proc 2008, 737-741. PubMed Abstract | PubMed Central Full Text OpenURL

  7. Lumpkin JR: History and significance of information systems and public health. In Public Health Informatics and Information Systems. Edited by O Carroll PW, Yasnoff WA, Ward ME, Ripp LH, Martin EL, Ross DA. NY: Springer; 2003:16-38. Publisher Full Text OpenURL

  8. Kamper-Jørgensen F: Public health information systems--and EUPHIX.

    Scand J Public Health 2008, 36:673-675. PubMed Abstract OpenURL

  9. Kushniruk A, Borycki E, Kuo MH, Kuwata S: Integrating technology-centric and user-centric system testing methods: ensuring healthcare system usability and safety.

    Stud Health Technol Inform 2010, 157:181-186. PubMed Abstract | Publisher Full Text OpenURL

  10. Peute LW, Spithoven R, Bakker PJ, Jaspers MW: Usability studies on interactive health information systems; where do we stand?

    Stud Health Technol Inform 2008, 136:327-332. PubMed Abstract | Publisher Full Text OpenURL

  11. Borycki E, Kushniruk A: Identifying and preventing technology-induced error using simulations: Application of usability engineering techniques.

    Healthc Q 2005, 8:99-105. PubMed Abstract | Publisher Full Text OpenURL

  12. Heeks R: Health information systems: failure, success and improvisation.

    Int J Med Inform 2006, 75:125-137. PubMed Abstract | Publisher Full Text OpenURL

  13. Littlejohns P, Wyatt JC, Garvican L: Evaluating computerised health information systems: hard lessons still to be learnt.

    Br Med J 2003, 326:860-863. Publisher Full Text OpenURL

  14. Pina J, Turner A, Kwan-Gett T, Duchin J: Task analysis in action: the role of information systems in communicable disease reporting.

    AMIA Annu Symp Proc 2009, 2009:531-535. PubMed Abstract | PubMed Central Full Text OpenURL

  15. Yasnoff WA, Overhage JM, Humphreys BL, LaVenture M, Goodman KW, Gatewood L, Ross DA, Reid J, Hammond WE, Dwyer D, et al.: A national agenda for public health informatics.

    J Public Health Manag Pract 2001, 7:1-21. PubMed Abstract OpenURL

  16. Centers for Disease Control and Prevention and University of Washington's Center for Public Health Informatics. Competencies for Public Health Informaticians Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention; 2009.

  17. Child Profile [http://www.doh.wa.gov/cfh/childprofile/] webcite

  18. PHRED - Public Health Reporting of Electronic Data [http://www.doh.wa.gov/EHSPHL/Informatics/phred.htm] webcite

  19. Weaver W: Science and complexity.

    American scientist 1948, 36:536-544. PubMed Abstract OpenURL

  20. Weinberg GM: An introduction to general systems thinking. New York: Wiley; 1975. OpenURL

  21. Rittel HWJ, Webber MM: Dilemmas in a general theory of planning.

    Policy Sci 1973, 4:155-169. Publisher Full Text OpenURL

  22. Buchanan R: Wicked problems in design thinking.

    Design Issues 1992, 8:5-21. Publisher Full Text OpenURL

  23. Cross N: Forty years of design research.

    Design Studies 2007, 28:1-4. Publisher Full Text OpenURL

  24. Simon HA: The sciences of the artificial. Cambridge, Mass.: MIT Press; 1996. OpenURL

  25. Lawson B: How Designers Think: The Design Process Demystified. Boston Architectural Press; 1997. OpenURL

  26. Krippendorff K: A Trajectory of Artificiality and New Principles of Design for the Information Age. In Design in the Age of Information, A Report to the National Science Foundation (NSF). National Science Foundation; 1997:5.

    pp. 5:

    OpenURL

  27. Purgathofer P: Is informatics a design discipline?

    Poiesis & Praxis 2006, 4:303-314. OpenURL

  28. Carroll JM: Five reasons for scenario-based design.

    Interacting with computers 2000, 13:43-60. Publisher Full Text OpenURL

  29. Carroll JM: Making Use: Scenario-based Design of Human-Computer Interactions. Cambridge, MA: MIT Press; 2000. OpenURL

  30. Norman DA: The psychology of everyday things. New York: Basic Books; 1988. OpenURL

  31. Rittel HWJ, Webber MM: Dilemmas in a General Theory of Planning.

    Policy Sciences 1973, 4:155-169. Publisher Full Text OpenURL

  32. Schön DA: The reflective practitioner : how professionals think in action. New York: Basic Books; 1983. OpenURL

  33. Dewey J: Logic, the theory of inquiry. New York: H. Holt and Company; 1938. OpenURL

  34. Dewey J, Boydston JA, Simon HF, Toulmin S: John Dewey, the later works, 1925-1953 : volume 4 : 1929. Carbondale, Ill.: Southern Illinois University; 1988. OpenURL

  35. Revere D, Turner AM, Madhavan A, Rambo N, Bugni PF, Kimball A, Fuller SS: Understanding the information needs of public health practitioners: a literature review to inform design of an interactive digital knowledge management system.

    J Biomed Inform 2007, 40:410-421. PubMed Abstract | Publisher Full Text OpenURL

  36. Friedman DJ, Anderka M, Krieger JW, Land G, Solet D: Accessing population health information through interactive systems: lessons learned and future directions.

    Public Health Rep 2001, 116:132-147. PubMed Abstract | PubMed Central Full Text OpenURL

  37. Schuler D, Namioka A: Participatory Design: Principles and Practices. Hillsdale, NJ: L Erlbaum; 1993. OpenURL

  38. Wells S, Bullen C: A near miss: the importance of context in a public health informatics project in a New Zealand case study.

    J Am Med Inform Assoc 2008, 15:701-704. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  39. Bravata DM, McDonald KM, Smith WM, Rydzak C, Szeto H, Buckeridge DL, Haberland C, Owens DK: Systematic review: surveillance systems for early detection of bioterrorism-related diseases.

    Ann Intern Med 2004, 140:910-922. PubMed Abstract OpenURL

  40. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN: Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group.

    MMWR Recomm Rep 2001, 50:1-35.

    quiz CE31-37.

    PubMed Abstract OpenURL

  41. Savitz DA, Poole C, Miller WC: Reassessing the role of epidemiology in public health.

    Am J Public Health 1999, 89:1158-1161. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  42. Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH: The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry.

    Journal of the American Medical Informatics Association : JAMIA 2007, 14:415. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  43. Patel VL, Kaufman DR: Science and practice: a case for medical informatics as a local science of design.

    J Am Med Inform Assoc 1998, 5:489-492. PubMed Abstract | PubMed Central Full Text OpenURL

  44. Bødker K, Kensing F, Simonsen J: Participatory IT design : designing for business and workplace realities. Cambridge, Mass.: MIT Press; 2004. OpenURL

  45. Bjerknes G, Bratteteig T: Florence in wonderland : system development with nurses. In Computers and democracy. Edited by Bjerknes G, Ehn P, Kyng M, Nygaard K. Aldershot [Hants, England]; Brookfield [Vt.], USA: Avebury; 1987. OpenURL

  46. Rifkin SB: Lessons from community participation in health programmes.

    Health Policy Plan 1986, 1:240-249. Publisher Full Text OpenURL

  47. Sainfort F, Jacko JA, Booske BC: Human-computer interaction in health care. In The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications. Edited by Jacko JA, Sears A. L Erlbaum Associates Inc; 2003:808-822. OpenURL

  48. Pilemalm S, Timpka T: Third generation participatory design in health informatics--Making user participation applicable to large-scale information system projects.

    Journal of biomedical informatics 2008, 41:327. PubMed Abstract | Publisher Full Text OpenURL

  49. Carroll JM: Scenario-based design : envisioning work and technology in system development. New York: Wiley; 1995. OpenURL

  50. Carroll C, Marsden P, Soden P, Naylor E, New J, Dornan T: Involving users in the design and usability evaluation of a clinical decision support system.

    Comput Methods Programs Biomed 2002, 69:123-135. PubMed Abstract | Publisher Full Text OpenURL

  51. Filippidou D: Designing with scenarios: A critical review of current research and practice.

    Requirements Engineering 1998, 3:1-22. Publisher Full Text OpenURL

  52. Sutcliffe A: On the effective use and reuse of HCI knowledge.

    ACM Trans Comput-Hum Interact 2000, 7:197-221. Publisher Full Text OpenURL

  53. Fitzmaurice JM: A new twist in US health care data standards development: adoption of electronic health care transactions standards for administrative simplification.

    Int J Med Inform 1998, 48:19-28. PubMed Abstract | Publisher Full Text OpenURL

  54. Chute CG, Koo D: Public health, data standards, and vocabulary: crucial infrastructure for reliable public health surveillance.

    J Public Health Manag Pract 2002, 8:11-17. PubMed Abstract | Publisher Full Text OpenURL

  55. Hammond WE: The making and adoption of health data standards.

    Health Aff (Millwood) 2005, 24:1205-1213. PubMed Abstract | Publisher Full Text OpenURL

  56. Orlova AO, Dunnagan M, Finitzo T, Higgins M, Watkins T, Tien A, Beales S: Electronic health record - public health (EHR-PH) system prototype for interoperability in 21st century healthcare systems.

    AMIA Annu Symp Proc 2005, 575-579. PubMed Abstract | PubMed Central Full Text OpenURL

  57. Richesson RL, Krischer J: Data standards in clinical research: gaps, overlaps, challenges and future directions.

    J Am Med Inform Assoc 2007, 14:687-696. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  58. Gamma E: Design patterns : elements of reusable object-oriented software. Reading, Mass.: Addison-Wesley; 1995. OpenURL

  59. Cooper JW: USING DESIGN PATTERNS.

    Communications of the ACM 1998, 41:65-68. Publisher Full Text OpenURL

  60. Borchers JO, Thomas JC: Patterns: what's in it for HCI? In CHI '01 extended abstracts on Human factors in computing systems. Seattle, Washington: ACM; 2001. OpenURL

  61. Fowler M: Patterns [software patterns].

    Software, IEEE 2003, 20:56-57. Publisher Full Text OpenURL

  62. Landay JA, Borriello G: Design patterns for ubiquitous computing.

    Computer 2003, 36:93-95. Publisher Full Text OpenURL

  63. Timpka T, Eriksson H, Ludvigsson J, Ekberg J, Nordfeldt S, Hanberger L: Web 2.0 systems supporting childhood chronic disease management: a pattern language representation of a general architecture.

    BMC medical informatics and decision making 2008., 8 PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  64. Were MC, Emenyonu N, Achieng M, Shen C, Ssali J, Masaba JPM, Tierney WM: Evaluating a scalable model for implementing electronic health records in resource-limited settings.

    Journal of the American Medical Informatics Association : JAMIA 2010, 17:237. PubMed Abstract | Publisher Full Text OpenURL

  65. Whittaker S, Terveen L, Nardi BA: Let's Stop Pushing the Envelope and Start Addressing It: A Reference Task Agenda for HCI.

    Human-Computer Interaction 2000, 15:75-106. Publisher Full Text OpenURL

  66. Wahid S: Investigating design knowledge reuse for interface development. In Proceedings of the 6th conference on Designing Interactive systems. University Park, PA, USA: ACM; 2006. OpenURL

  67. Sutcliffe A: Symbiosis and synergy? scenarios, task analysis and reuse of HCI knowledge.

    Interacting with Computers 2003, 15:245-263. Publisher Full Text OpenURL

  68. Sutcliffe AG, Carroll JM: Designing claims for reuse in interactive systems design.

    International Journal of Human-Computer Studies 1999, 50:213-241. Publisher Full Text OpenURL

  69. Burke M, Evans WD: Information Technology Survey Report for the Turning Point National Excellence Collaborative for Information Technology. Seattle, WA: Trning Point National Program Office; 2003.

  70. Reeder B, Demiris G: Building the PHARAOH framework using scenario-based design: a set of pandemic decision-making scenarios for continuity of operations in a large municipal public health agency.

    J Med Syst 2010, 34:735-739. PubMed Abstract | Publisher Full Text OpenURL

  71. Asangansi I, Braa K: The emergence of mobile-supported national health information systems in developing countries.

    Stud Health Technol Inform 2010, 160:540-544. PubMed Abstract | Publisher Full Text OpenURL

  72. Wilkins K, Nsubuga P, Mendlein J, Mercer D, Pappaioanou M: The data for decision making project: assessment of surveillance systems in developing countries to improve access to public health information.

    Public Health 2008, 122:914-922. PubMed Abstract | Publisher Full Text OpenURL

  73. Hills RA, Lober WB, Painter IS: Biosurveillance, case reporting, and decision support: public health interactions with a health information exchange. In Biosurveillance and Biosecurity: International Workshop, BioSecure 2008. Volume 5354. Edited by Zeng D, Chen H, Rolka H, Lober B. Berlin: Springer-Verlag; 2008::10-21. Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2458/11/116/prepub