Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Highly Accessed Research article

Data Linkage: A powerful research tool with potential problems

Megan A Bohensky1*, Damien Jolley1, Vijaya Sundararajan2, Sue Evans1, David V Pilcher3, Ian Scott4 and Caroline A Brand1

Author Affiliations

1 Centre of Research Excellence in Patient Safety, Dept of Epidemiology & Preventive Medicine, School Public Health & Preventive Medicine, Monash University, Melbourne, Victoria, Australia, 3181 http://www.crepatientsafety.org.au

2 Department of Health Victoria, 50 Lonsdale Street, Melbourne Victoria, Australia 3000

3 Australian & New Zealand Intensive Care Society, Centre for Outcomes and Resource Evaluation, 10 Ievers Terrace, Carlton Victoria, Australia 3053

4 Department of Internal Medicine, Princess Alexandra Hospital, Brisbane, Queensland, Australia 4102

For all author emails, please log on.

BMC Health Services Research 2010, 10:346  doi:10.1186/1472-6963-10-346


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/10/346


Received:31 May 2010
Accepted:22 December 2010
Published:22 December 2010

© 2010 Bohensky et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Policy makers, clinicians and researchers are demonstrating increasing interest in using data linked from multiple sources to support measurement of clinical performance and patient health outcomes. However, the utility of data linkage may be compromised by sub-optimal or incomplete linkage, leading to systematic bias. In this study, we synthesize the evidence identifying participant or population characteristics that can influence the validity and completeness of data linkage and may be associated with systematic bias in reported outcomes.

Methods

A narrative review, using structured search methods was undertaken. Key words "data linkage" and Mesh term "medical record linkage" were applied to Medline, EMBASE and CINAHL databases between 1991 and 2007. Abstract inclusion criteria were; the article attempted an empirical evaluation of methodological issues relating to data linkage and reported on patient characteristics, the study design included analysis of matched versus unmatched records, and the report was in English. Included articles were grouped thematically according to patient characteristics that were compared between matched and unmatched records.

Results

The search identified 1810 articles of which 33 (1.8%) met inclusion criteria. There was marked heterogeneity in study methods and factors investigated. Characteristics that were unevenly distributed among matched and unmatched records were; age (72% of studies), sex (50% of studies), race (64% of studies), geographical/hospital site (93% of studies), socio-economic status (82% of studies) and health status (72% of studies).

Conclusion

A number of relevant patient or population factors may be associated with incomplete data linkage resulting in systematic bias in reported clinical outcomes. Readers should consider these factors in interpreting the reported results of data linkage studies.

Background

Reports in the United States [1], Canada [2], United Kingdom [3] and Australia [4] have recommended increasing the use of existing data, such as administrative and clinical registry data, to provide comparative clinical performance data to health services, hospitals, clinical units and clinicians via internal channels and to consumers via publicly accessible media. Although a limited number of patient outcomes, such as in-hospital mortality, complication and re-admission rates are currently available from some administrative data sources, obtaining data from several different databases pertaining to the one individual or participant using data linkage is often necessary to ensure adequate risk-adjustment and examine a more comprehensive range of outcomes for comparison between organisations.

Data or record linkage has been defined as "a process of pairing records from two files and trying to select the pairs that belong to the same entity [5]." Linkage may be conducted between two distinct data sources or within a single data-set to identify multiple entries (e.g. re-admissions) for one person or record unit. The various uses of linked data in clinical research and the types of data linkage that can be deployed are briefly described in additional file 1. In the United Kingdom, 47% of multicentre clinical databases surveyed in 2003 by Black et al reported that they undertook routine data linkage to other databases [6]. A review by Evans et al reported that 68% of Australian clinical registries routinely undertook some form of data linkage to obtain outcome information, such as death or disease status, and to assess data quality [7]. The use of data linkage in research studies has increased almost 6 fold within the last two decades. A search by one of the authors (MAB) of the term "data linkage" and of the heading "medical record linkage" in study abstracts and titles on Medline identified only 161 studies between 1992 and 1997, compared to 951 studies between 2002 and 2007. This proliferation of data linkage is reflected in the establishment of data linkage research centres and initiatives in Australia [8,9], North America [10,11] and the United Kingdom [12,13].

Additional file 1. Linkage methods. A description of the principles of data linkage and the methods commonly undertaken.

Format: DOC Size: 29KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

While data linkage is an important tool in observational research, it may be associated with various types of error. When linking two data-sets, there is a proportion of cases that will match and a proportion that will remain unmatched. Error arises if data sources do not consistently capture the same cases, records that correspond to the same person do not link due to missing or inaccurate data (false negatives), or unrelated records are mistakenly linked (false positives).

It is often difficult to assess the quality of a linkage when the patient outcome which is being linked to other variables is unknown or there is not an expected one-to-one relationship between one variable and another. For example, when linking records to a death registry to determine a patient's survival status, it is difficult to know which matches have been missed if it is unknown whether the patient is alive or dead. A systematic review of probabilistic linkage accuracy identified only six articles that had complete data on summary measures of linkage quality and found the sensitivity of linkage (ie the proportion of truly matched records detected) to range from 74% to 98% and specificity (ie the proportion of truly unmatched records detected) to range from 99 to 100% [14]. In the studies with lower sensitivity, findings may be biased leaving the results and their interpretation open to question.

There is a need for clinicians and policymakers to understand the limitations of linkage for outcome measurement. Methods for evaluating the quality of existing data sources and operating data linkage services have been previously reported [15-18]. While these publications offer a framework for evaluating existing data sources and managing data linkage services, there is a paucity of literature that discusses the quality and limitations of research using linked data.

The purpose of this study was to synthesize the evidence through a structured narrative review of patient or population characteristics that may be associated with changes in sensitivity and specificity of data linkage, thereby introducing systematic bias into reported outcomes.

Methods

A structured, narrative review of the literature was considered appropriate for this form of observational research. Medline, EMBASE and CINAHL databases were search using the search strategies reported below:

• MEDLINE

"data linkage" as keywords in title, abstract, name of substance word, subject heading word

"medical record linkage"[Mesh]

Limited to years 1991-2007, the English Language and studies involving humans.

• CINAHL

Data linkage OR Medical record linkage

Limited to years 1991-2007, the English Language and studies involving humans

• EMBASE

Data AND Linkage

Medical AND Record AND Linkage

Limited to years 1991-2007, the English Language and studies involving humans, excluding letters, notes, commentaries and editorials.

A priori criteria for abstract inclusion were that the article empirically evaluated methodological issues relating to data linkage and reported on patient characteristics in matched versus unmatched records. Articles were excluded if they did not involve data linkage, such as a discussion of another form of health information technology; if they did not involve data, such as a commentary, letter or discussed a data linkage methodology without an empirical evaluation or if they presented a linkage project without comparing characteristics in matched and unmatched records. We excluded studies with an area of focus in genetics from our EMBASE search, as our search term was detecting genome linkage projects. We reviewed a subset of these studies (n = 105, 10%) to determine if any of these articles met our study inclusion criteria and confirmed they did not.

Study titles, abstracts and full articles were screened and the review and evaluation of the studies were performed by one researcher (MAB). Participant characteristics influencing the completeness of data linkage were grouped thematically after reviewing studies that met the inclusion criteria. As no quality grading tool exists for studies utilising linked data, we assessed the quality of the studies by examining the participant characteristics that were assessed and the methods used for evaluating potential sources of bias.

Results

Using the search strategy described above, the search of Medline identified 1451 articles, CINAHL identified 317 articles and EMBASE identified 42 articles not identified in the MEDLINE searches. Of the 1810 studies identified in the search, 1416 abstracts (78.2% of all studies) were screened. Of these, 33 (1.8%) articles met the inclusion criteria (see Figure 1 for search process). A review of the references of the included studies did not identify any additional articles meeting our inclusion criteria. All articles were grouped thematically according to patient or population characteristics that were compared in matched and unmatched records (listed in additional file 2). Below, we describe characteristics of the identified studies and present a qualitative synthesis of the differences in matching rates according to each of the identified patient or population characteristics: age, sex, ethnic/racial group, geographical/hospital site, socio-economic status and health status. Selected case study descriptions are provided in additional file 3.

thumbnailFigure 1. Flow diagram of included and excluded studies.

Additional file 2. Selected Case Studies. Several studies are highlighted to demonstrate how linkage error can influence findings when applied to health services research.

Format: DOC Size: KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Additional file 3. Summary of Study characteristics associated with unmatched data linkage cases. A table of each study included in the review and how selected population characteristics were influenced by unmatched records.

Format: DOC Size: KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Study characteristics

While a number of studies used data linkage methods (n = 612), we identified only 33 studies that examined characteristics of matched versus unmatched records. Identified studies were from a range of countries (12 from the United States, 8 from Australia, 5 from the United Kingdom, 4 from Canada and 1 each from the Netherlands, New Zealand, Switzerland and Taiwan) demonstrating the increasing popularity of these methods. Among the included studies, there was broad heterogeneity of reported characteristics. Some studies only reported one patient characteristic while others reported up to six. The methods for assessing the completeness of linkage were also inconsistent. Some studies compared proportions of different patient characteristics among matched and unmatched records, while others examined the odds of a successful match using regression analysis. The influence of missed links on the measure of association between exposure and outcome is difficult to quantify where data are unlinked (i.e. if the data with the exposure measure are not linked to the corresponding data with the outcome of interest). However, some studies did attempt to account for this through a sensitivity analysis of possible outcomes. Common reasons for the linkage errors have been categorised in additional file 4 along with a framework for potential reporting items that can assist in developing greater standardisation in this area.

Additional file 4. A framework for evaluating data linkage studies. Reasons for unlinked records and suggested reporting items for studies utilising data linkage to identify potential quality issues.

Format: DOC Size: 37KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Age

Eighteen studies looked at the relationship between participants' age and linkage rate. Five of these studies found that no significant relationship between age and linkage errors [19-23]. There was a trend for older participants to be less likely to consent to record linkage [24-26]. Where consent was not sought, the association between age group and correctly matched records was less clear with both younger and older participants having lower linkage rates [27-35]. Adams et al found that mothers aged under 18 years were more likely than other age groups to have missing social security numbers (21.4% vs 3.2% for 25-29 year olds; p < 0.00), which was a key linkage variable used to match their records to their child's birth records [27]. As younger maternal age has been associated with greater risk of adverse pregnancy outcomes, the higher potential for missed linkage when relying on social security number could underestimate this as a risk factor.

Gender

Ten of the identified articles compared gender in linked and unlinked records. In five of these articles, the relationship was not found to be significant [19,21,22,25,31]. In three studies, males had lower linkage rates [24,28,29] and in two studies women had lower linkage rates [34,35]. Males were found to be less likely to consent to record linkage in one study [24]. As women's names are more likely to change over their lifespan, linkage relying on surnames may explain the discrepancy in at least one of the studies [34]. In the other study, the linkage utilised participants' social security numbers, which more women than men may not have if they have never been employed [35].

Ethnic/racial groups

Differences in linkage rates among ethnic or racial groups were examined in fourteen studies with five finding no variations in rates of linkage error according to ethnic group [21,23,25,34,36]. In seven studies, it was found that people in minority groups had lower linkage rates [26,27,35,37-40]. Several studies offered reasons for this finding including subjects in minority groups being treated at facilities with less complete data [38], a lower rate of migrants reporting accidents to the police [40], higher rates of non-consent to data linkage [26] and lower likelihood of having social security numbers recorded [35]. Conversely, in one Australian study, Australian-born mothers had lower linkage rates due to more frequent treatment in private hospitals which lacked data on mothers' full names [20]. The remaining study found that estimations of death varied for ethnic groups depending on the linkage method [30].

Geographical/hospital sites

As data collection practices and training are likely to vary between sites, 13 of 14 identified studies found a relationship between the quality of linkage at different geographic or hospital sites [25-27,29,33,34,38,40-45] with only one study finding no relationship [21]. Darlymple et al examined the use of a record linkage system to track and identify treatment patterns of patients with psychiatric conditions in Ontario, Canada. It was found that the prevalence of linkage error in the community health sector was five times that of psychiatric hospitals, possibly due to a higher turnover of data entry staff with less training [42]. Within community agencies, misidentification by unique identifier code was approximately 22% compared to 0.5% for psychiatric hospitals, making it difficult to accurately track utilisation patterns of patients treated outside of psychiatric hospitals.

Socio-economic status

Eleven articles examined socio-economic status, and other proxy measures of social deprivation (assessed by income level, car availability and insurance status) and linkage rates. Two studies did not find a relationship [23,41], while nine studies found people in lower socio-economic groups and with lower levels of educational attainment were less likely to have matched records [21,25-27,32,34,37,46,47]. The differences were mainly attributed to lower consent rates for linkage [21,25,26,47,48] and less complete data and reporting for people in lower socio-economic categories [36,49].

Health status

Eighteen studies were identified that examined health status in matched and unmatched records. Five of the eighteen studies that examined the relationship between health status or condition severity found that differences in health status were evenly distributed between matched and unmatched records [19,25,39,50,51]. Tromp et al found that twin births with multiple readmissions had errors in the linkage of readmission records due to inaccuracies in twin rank data [51]. Generally, people with poorer health tended to have higher rates of consent for record linkage [21,24,47] and five studies found that pre-term and low birth weight children tended to be under-reported or have less accurate data [20,36,45,49,52,53]. Three studies found patients with greater illness or injury severity had better quality data, as a result of being treated in hospital as opposed to lower acuity health services [31,40,42]. Kariminia et al found that the sensitivity of reporting drug-related deaths and suicides was lower compared to other causes of death [54], while Magliano et al found that reporting of cancer-related deaths was higher than deaths due to cardiovascular disease [55].

Discussion

The results of this review have identified a number of participant characteristics (age, gender, race, setting, socioeconomic and health status) that are associated with incomplete data linkage and potential for systematic bias in reported outcomes. As demonstrated in additional file 2 there is heterogeneity of reported patient characteristics and methods for assessing and reporting these differences, which highlights the lack of standardisation in this area. To our knowledge, this is the first study to synthesize the literature on assessing quality of data linkage and suggests how it may influence the validity of research results. For many variables examined in the reported studies, the evidence for an association between the variable and rates of data linkage was inconsistent. This may reflect differences in sampled populations and other contextual factors.

The reasons for different rates of completeness in data linkage are varied but can be broadly grouped into the methods of linkage, governance issues, such as requiring consent for linkage, and the accuracy and completeness of the data within each data source. These may be general issues related to the linkage variables, such as differences in linkage rates by gender resulting from female's changing their names, or contextual issues related to a specific study or setting, for example the use of social security numbers as a linkage variable in the United States. In countries that lack a national health identifier, data linkage commonly relies on names or medical record numbers, and these may be collected with varying degrees of accuracy and completeness across hospital sites, as was identified in the study by Ford et al [20].

This study has limitations that should be noted. There is currently no grading system available to assess studies utilizing linked data. Existing critical appraisal tools, such as the STROBE guidelines[56], do not address issues of bias associated with data linkage. Consequently, we were unable to apply a validated, standardized tool to assess the quality of these studies. However, this review was intended to be an exploratory discussion of potential sources of bias to highlight these issues for researchers and encourage more systematic assessment and reporting of linkage methods in the future. In addition, a proportion of articles (52%) were excluded after reviewing the abstracts, as they did not appear to discuss data linkage (e.g. articles about electronic medical records, e-health) or they commented on methodological issues related to data linkage without an empirical study. This may mean that some articles meeting the inclusion criteria were missed if the abstract lacked detail. However, full articles were sought for all articles where the study title and available information appeared to be related to data linkage but lacked a detailed abstract.

When linking existing data sources to measure outcomes of care, such as mortality rates, differences such as those described above could underestimate mortality for participants in any of the groups identified, thereby skewing perceptions of quality of care. Linkage issues may be compounded by broader data quality issues, such as a lack of standardised data definitions and inconsistent coding practices [57], which will also compromise quality of measurement. While this paper has focused on data linkage, it is important to consider the influence of data linkage in the broader context of other data quality issues when using existing data to monitor quality of care.

To accurately assess for bias due to errors in linkage, characteristics of unmatched records and a measure of the quality of linkage, such as the rates of false positives and false negatives, need to be routinely measured and reported. Depending on the research question and outcomes under study, potential bias in study results needs to be assessed on a case-by-case basis. Biased estimation of outcomes in either direction will have negative consequences for measuring, and therefore improving, the quality of health care. Furthermore, unreliable and invalid data will continue to undermine the confidence of clinicians and other stakeholders in measurement systems relying on existing data sources.

As a way forward, in additional file 4 we have presented the different reasons for unlinked records and suggested some factors that should be considered in the evaluation of studies using linked data in assessing the quality of data linkage. Studies should clearly describe the data-sets being used, the linkage variables and process and an assessment of the quality of the linked data-sets to identify potential sources of bias. Even where unique identifiers exist, cases may not link due to missing or inaccurate data or inconsistent data definitions, inclusion criteria or coding practices. It can be difficult to determine the impact of these issues when the quantity of missing data and unlinked records are not reported. An appropriately validated quality assessment tool specific to data linkage studies would help to systematically identify and review the specific sources of bias discussed in this paper. Such a tool would assist clinicians and policy-makers in interpreting the findings of clinical research studies based on data linkage and encourage more consistent reporting by researchers.

Conclusions

Studies reliant on linked data may yield biased findings due to errors in data linkage which relate to specific characteristics of patients and clinical settings. Such errors may not be readily apparent due to inconsistencies in the way researchers evaluate and report them. If existing data sources and linkage processes are to be used for assessing quality of care, it is important that clinicians and policymakers recognise their limitations in order to avoid misinterpreting their findings. Reporting and appraising results based on linked data in a transparent and consistent manner will help to highlight limitations of current healthcare data sources and assist in improving data collection, coding practices and linkage processes.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MAB conducted the searches, analysed the data and wrote the article, CAB supervised data analysis and reviewed the article, DJ, VS, SE, DVP and IS, supervised and reviewed the article. All authors read and approved the final manuscript.

Acknowledgements

The authors gratefully acknowledge their colleagues Dr Adam Elshaug, Dr Sacha Höttje and Dr Cameron Willis for their thoughtful review and feedback on drafts of this manuscript. Megan Bohensky receives funding through an Australian Postgraduate Award scholarship at Monash University.

References

  1. Institute of Medicine Committee on Quality of Health in America: Crossing the Quality Chasm: A New Health System for the 21st Century. Washington DC: National Academies Press; 2001:1-337.

  2. Canadian Institute for Health Information: Health Care In Canada 2004. Ottawa, CA: CIHI; 2004.

  3. The Bristol Royal Infirmary Inquiry: The Report of the Public Inquiry into children's heart surgery at the Bristol Royal Infirmary1984-1995.

    London, U.K 2001. OpenURL

  4. National Health and Hospitals Reform Commission (Australia). Australia. Dept. of Health and Ageing: A healthier future for all Australians final report June 2009. Canberra, A.C.T.: Dept. of Health and Ageing; 2009.

  5. Winglee M, Valliant R, Scheuren F: A case study in record linkage.

    Survey Methodology 2005, 31(1):3-11. OpenURL

  6. Black N, Barker M, Payne M: Cross sectional survey of multicentre clinical databases in the United Kingdom.

    Br Med J 2004, 328(7454):1478. Publisher Full Text OpenURL

  7. Evans SM, Bohensky M, Cameron PA, McNeil JJ: A survey of Australian clinical registries: can quality of care be measured?

    Intern Med J 2009. OpenURL

  8. Holman CDA, Bass AJ, Rouse IL, Hobbs MST: Population-based linkage of health records in Western Australia: development of a health services research linked database.

    Aust N Z J Public Health 1999, 23(5):453-459. PubMed Abstract | Publisher Full Text OpenURL

  9. Centre for Health Record Linkage: Guide to health record linkage services version 1.3. undated

  10. Chamberlayne R, Green B, Barer ML, Hertzman C, Lawrence WJ, Sheps SB: Creating a population-based linked health database: a new resource for health services research.

    Can J Public Health 1998, 89(4):270-273. PubMed Abstract OpenURL

  11. Roos NP, Black CD, Frohlich N, Decoster C, Cohen MM, Tataryn DJ, Mustard CA, Toll F, Carriere KC, Burchill CA, et al: A population-based health information system.

    Med Care 1995, 33(12 Suppl):DS13-20. PubMed Abstract | Publisher Full Text OpenURL

  12. Acheson ED: The Oxford Record Linkage Study: A Review of the Method with Some Preliminary Results.

    Proc R Soc Med 1964, 57:269-274. PubMed Abstract | PubMed Central Full Text OpenURL

  13. Kendrick S, Clarke J: The Scottish Record Linkage System.

    Health Bull (Edinb) 1993, 51(2):72-79. PubMed Abstract OpenURL

  14. Silveira DP, Artmann E: Accuracy of probabilistic record linkage applied to health databases: systematic review.

    Rev Saude Publica 2009, 43(5):875-882. PubMed Abstract | Publisher Full Text OpenURL

  15. Black N, Payne M: Directory of clinical databases: improving and promoting their use.

    Qual Saf Health Care 2003, 12(5):348-352. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Kelman CW, Bass AJ, Holman CD: Research use of linked health data--a best practice protocol.

    Aust N Z J Public Health 2002, 26(3):251-255. PubMed Abstract | Publisher Full Text OpenURL

  17. National Community Services Information Management Group: Statistical Data Linkage in Community Services Data Collection. Canberra Australian Institute of Health and Welfare; 2004.

  18. Sorensen HT, Sabroe S, Olsen J: A Framework for Evaluation of Secondary Data Sources for Epidemiological Research.

    Int J Epidemiol 1996, 25(2):435-442. PubMed Abstract | Publisher Full Text OpenURL

  19. Baker R, Shiels C, Stevenson K, Fraser R, Stone M: What proportion of patients refuse consent to data collection from their records for research purposes?

    Br J Gen Pract 2000, 50(457):655-656. PubMed Abstract | PubMed Central Full Text OpenURL

  20. Ford JB, Roberts CL, Taylor LK: Characteristics of unmatched maternal and baby records in linked birth records and hospital discharge data.

    Paediatric and Perinatal Epidemiology 2006, 20(4):329-337. PubMed Abstract | Publisher Full Text OpenURL

  21. Harris T, Cook DG, Victor C, Beighton C, Dewilde S, Carey I: Linking questionnaires to primary care records: factors affecting consent in older people.

    J Epidemiol Community Health 2005, 59(4):336-338. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  22. Sundararajan V, Bunker SJ, Begg S, Marshall R, Burney H: Attendance rates and outcomes of cardiac rehabilitation in Victoria, 1998.

    Med J Aust 2004, 180(6):268-271. PubMed Abstract | Publisher Full Text OpenURL

  23. Waller DK, Lustig LS, Cunningham GC, Feuchtbaum LB, Hook EB: The association between maternal serum alpha-fetoprotein and preterm birth, small for gestational age infants, preeclampsia, and placental complications.

    Obstet Gynecol 1996, 88(5):816-822. PubMed Abstract | Publisher Full Text OpenURL

  24. Dunn KM, Jordan K, Lacey RJ, Shapley M, Jinks C: Patterns of consent in epidemiologic research: evidence from over 25,000 responders.

    Am J Epidemiol 2004, 159(11):1087-1094. PubMed Abstract | Publisher Full Text OpenURL

  25. Huang N, Shih S-F, Chang H-Y, Chou Y-J: Record linkage research and informed consent: who consents?

    BMC Health Serv Res 2007, 7:18. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  26. Tate AR, Calderwood L, Dezateux C, Joshi H: Mother's consent to linkage of survey data with her child's birth records in a multi-ethnic national cohort study.

    Int J Epidemiol 2006, 35(2):294-298. PubMed Abstract | Publisher Full Text OpenURL

  27. Adams MM, Wilson HG, Casto DL, Berg CJ, McDermott JM, Gaudino JA, McCarthy BJ: Constructing Reproductive Histories by Linking Vital Records.

    Am J Epidemiol 1997, 145(4):339-348. PubMed Abstract | Publisher Full Text OpenURL

  28. Blakely T, Salmond C: Probabilistic record linkage and a method to calculate the positive predictive value.

    Int J Epidemiol 2002, 31(6):1246-1252. PubMed Abstract | Publisher Full Text OpenURL

  29. Bopp M, Minder CE: Mortality by education in German speaking Switzerland, 1990-1997: Results from the Swiss National Cohort.

    Int J Epidemiol 2003, 32(3):346-354. PubMed Abstract | Publisher Full Text OpenURL

  30. Buescher PA: Method of linking Medicaid records to birth certificates may affect infant outcome statistics.

    Am J Public Health 1999, 89(4):564-566. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  31. Cryer PC, Westrup S, Cook AC, Ashwell V, Bridger P, Clarke C: Investigation of bias after data linkage of hospital admissions data to police road traffic crash reports.

    Inj Prev 2001, 7(3):234-241. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  32. Holian J: Client and Birth Record Linkage: A Method, Biases, and Lessons.

    American Journal of Evaluation 1996, 17(3):227-235. Publisher Full Text OpenURL

  33. Jebamani LS, Burchill CA, Martens PJ: Using data linkage to identify First Nations Manitobans: technical, ethical, and political issues.

    Can J Public Health 2005, 96(Suppl 1):S28-32. PubMed Abstract OpenURL

  34. Maizlish NA, Herrera L: A record linkage protocol for a diabetes registry at ethnically diverse community health centers.

    J Am Med Inform Assoc 2005, 12(3):331-337. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  35. Zingmond DS, Ye Z, Ettner SL, Liu H: Linking hospital discharge and death records--accuracy and sources of bias.

    J Clin Epidemiol 2004, 57(1):21-29. PubMed Abstract | Publisher Full Text OpenURL

  36. Holian J: Live birth and infant death record linkage: methodological and policy issues.

    J Health Soc Policy 2000, 12(1):1-10. PubMed Abstract | Publisher Full Text OpenURL

  37. Blakely T, Woodward A, Salmond C: Anonymous linkage of New Zealand mortality and Census data.

    Aust N Z J Public Health 2000, 24(1):92-95. PubMed Abstract | Publisher Full Text OpenURL

  38. Gyllstrom ME, Jensen JL, Vaughan JN, Castellano SE, Oswald JW: Linking birth certificates with Medicaid data to enhance population health assessment: methodological issues addressed.

    J Public Health Manag Pract 2002, 8(4):38-44. PubMed Abstract | Publisher Full Text OpenURL

  39. Ringland C, Correll PK, Lim K, Williamson M, Marks GB: Hospital readmissions for asthma: a feasibility study comparing strategies for linking hospital morbidity data.

    Aust N Z J Public Health 2006, 30(5):435-439. PubMed Abstract | Publisher Full Text OpenURL

  40. Rosman DL, Knuiman MW: A comparison of hospital and police road injury data.

    Accid Anal Prev 1994, 26(2):215-222. PubMed Abstract | Publisher Full Text OpenURL

  41. Nitsch D, Morton S, DeStavola BL, Clark H, Leon DA: How good is probabilistic record linkage to reconstruct reproductive histories? Results from the Aberdeen Children of the 1950 s study.

    BMC Med Res Methodol 2006, 6:15. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  42. Dalrymple AJ, Lahti LS, Hutchinson LJ, O'Doherty JJ: Record linkage in a regional mental health planning study: accuracy of unique identifiers, reliability of sociodemographics, and estimating identification error.

    J Ment Health Adm 1994, 21(2):185-192. PubMed Abstract | Publisher Full Text OpenURL

  43. Cote TR, O'Brien TR, Ward JW, Wilson SE, Blattner WA: AIDS and cancer registry linkage: measurement and enhancement of registry completeness. The National AIDS/Cancer Match Study Group.

    Prev Med 1995, 24(4):375-377. PubMed Abstract | Publisher Full Text OpenURL

  44. Hoving JL, Monaco A, MacFarlane E, Fritschi L, Benke G, McKenzie D, Sim M: Methodological issues in linking study participants to Australian cancer registries using different methods: lessons from a cohort study.

    Aust N Z J Public Health 2005, 29(4):378-382. PubMed Abstract | Publisher Full Text OpenURL

  45. Sunderam S, Schieve LA, Cohen B, Zhang Z, Jeng G, Reynolds M, Wright V, Johnson C, Macaluso M: Linking birth and infant death records with assisted reproductive technology data: Massachusetts, 1997-1998.

    Matern Child Health J 2006, 10(2):115-125. PubMed Abstract | Publisher Full Text OpenURL

  46. Young AF, Dobson AJ, Byles JE: Health services research using linked records: who consents and what is the gain?

    Aust N Z J Public Health 2001, 25(5):417-420. PubMed Abstract OpenURL

  47. Klassen AF, Lee SK, Barer M, Raina P: Linking survey data with administrative health information: characteristics associated with consent from a neonatal intensive care unit follow-up study.

    Can J Public Health 2005, 96(2):151-154. PubMed Abstract OpenURL

  48. Young AF, Dobson AJ, Byles JE: Health services research using linked records: who consents and what is the gain?[see comment].

    Aust N Z J Public Health 2001, 25(5):417-420. PubMed Abstract | Publisher Full Text OpenURL

  49. Adams MM, Kirby RS: Measuring the accuracy and completeness of linking certificates for deliveries to the same woman.

    Paediatr Perinat Epidemiol 2007, 21(s1):58-62. PubMed Abstract | Publisher Full Text OpenURL

  50. Herrchen B, Gould JB, Nesbitt TS: Vital statistics linked birth/infant death and hospital discharge record linkage for epidemiological studies.

    Comput Biomed Res 1997, 30(4):290-305. PubMed Abstract | Publisher Full Text OpenURL

  51. Tromp M, Reitsma JB, Ravelli ACJ, Méray N, Bonsel GJ: Record Linkage: Making the Most Out of Errors in Linking Variables.

    AMIA Annu Symp Proc 2006, 779-783. PubMed Abstract | PubMed Central Full Text OpenURL

  52. Grace KR, Waters G, Huether CA, Edmonds LD, McClain P: Evaluating a new algorithm for linking maternal and newborn medical records.

    Genet Epidemiol 1995, 12(4):361-369. PubMed Abstract | Publisher Full Text OpenURL

  53. Liu S: Development of record linkage of hospital discharge data for the study of neonatal readmission.

    Chronic Dis Can 1999, 20(2):77-81. PubMed Abstract OpenURL

  54. Kariminia A, Butler T, Corben S, Kaldor J, Levy M, Law M: Mortality among prisoners: How accurate is the Australian Nationa Death Index?

    Aust N Z J Public Health 2005, 29(6):572-575. PubMed Abstract | Publisher Full Text OpenURL

  55. Magliano D, Liew D, Pater H, Kirby A, Hunt D, Simes J, Sundararajan V, Tonkin A: Accuracy of the Australian National Death Index: comparison with adjudicated fatal outcomes among Australian participants in the Long-term Intervention with Pravastatin in Ischaemic Disease (LIPID) study.

    Aust N Z J Public Health 2003, 27(6):649-653. PubMed Abstract | Publisher Full Text OpenURL

  56. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.

    Lancet 2007, 370(9596):1453-1457. PubMed Abstract | Publisher Full Text OpenURL

  57. Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ, Lilford RJ: Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals.

    BMJ 2009, 338:b780. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  58. Williams T, Dobb G, Finn J, Knuiman M, Lee K, Geelhoed E, Webb S: Data linkage enables evaluation of long-term survival after intensive care.

    Anaesth Intensive Care 2006, 34(3):307-315. PubMed Abstract OpenURL

  59. Hernandez AF, Hammill BG, Peterson ED, Yancy CW, Schulman KA, Curtis LH, Fonarow GC: Relationships between emerging measures of heart failure processes of care and clinical outcomes.

    Am Heart J 159(3):406-413. PubMed Abstract | Publisher Full Text OpenURL

  60. Zhang M, Holman CD, Preen DB, Brameld K: Repeat adverse drug reactions causing hospitalization in older Australians: a population-based longitudinal study 1980-2003.

    Br J Clin Pharmacol 2007, 63(2):163-170. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/10/346/prepub