Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Software

Merging microsatellite data: enhanced methodology and software to combine genotype data for linkage and association analysis

Angela P Presson1, Eric M Sobel2, Paivi Pajukanta2, Christopher Plaisier2, Daniel E Weeks34, Karolina Åberg4 and Jeanette C Papp2*

Author Affiliations

1 Department of Biostatistics, University of California, Los Angeles, CA, 90095, USA

2 Department of Human Genetics, University of California, Los Angeles, CA, 90095, USA

3 Department of Biostatistics, University of Pittsburgh, Pittsburgh, PA, 15261, USA

4 Department of Human Genetics, University of Pittsburgh, Pittsburgh, PA, 15261, USA

For all author emails, please log on.

BMC Bioinformatics 2008, 9:317  doi:10.1186/1471-2105-9-317

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/9/317


Received:17 March 2008
Accepted:21 July 2008
Published:21 July 2008

© 2008 Presson et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Correctly merged data sets that have been independently genotyped can increase statistical power in linkage and association studies. However, alleles from microsatellite data sets genotyped with different experimental protocols or platforms cannot be accurately matched using base-pair size information alone. In a previous publication we introduced a statistical model for merging microsatellite data by matching allele frequencies between data sets. These methods are implemented in our software MicroMerge version 1 (v1). While MicroMerge v1 output can be analyzed by some genetic analysis programs, many programs can not analyze alignments that do not match alleles one-to-one between data sets. A consequence of such alignments is that codominant genotypes must often be analyzed as phenotypes. In this paper we describe several extensions that are implemented in MicroMerge version 2 (v2).

Results

Notably, MicroMerge v2 includes a new one-to-one alignment option that creates merged pedigree and locus files that can be handled by most genetic analysis software. Other features in MicroMerge v2 enhance the following aspects of control: 1) optimizing the algorithm for different merging scenarios, such as data sets with very different sample sizes or multiple data sets, 2) merging small data sets when a reliable set of allele frequencies are available, and 3) improving the quantity and 4) quality of merged data. We present results from simulated and real microsatellite genotype data sets, and conclude with an association analysis of three familial dyslipidemia (FD) study samples genotyped at different laboratories. Independent analysis of each FD data set did not yield consistent results, but analysis of the merged data sets identified strong association at locus D11S2002.

Conclusion

The MicroMerge v2 features will enable merging for a variety of genotype data sets, which in turn will facilitate meta-analyses for powering association analysis.

Background

Association studies for complex diseases can require thousands of samples to detect genes with small effect [1]. A minimum of 1000 to 1500 samples have been suggested for genes conferring a 1–8% increase in susceptibility to a disease, and the failure of many complex disease studies has been attributed to insufficient sample size [1-3]. As increasing the sample size for a genetic analysis improves the statistical power and therefore the ability to detect a genetic effect, complex disease studies are increasingly employing collaboration. Collaborative genetic studies often distribute genotyping among several different laboratories. If the genotyping for a family-based linkage study is distributed by assigning complete families to each laboratory (ie, all DNA samples for a particular family are genotyped at the same laboratory), logarithm of the odds (lod) scores can be computed for each data set separately and then simply added to achieve a combined lod score for the linkage study. While the analysis for distributed genotyping is often manageable for family-based linkage studies, there is no straightforward method to combine multiple association results. Consequently, an association study is best powered by combining data sets prior to analysis. If combining data sets is attempted manually without the aid of a merging algorithm, it is cumbersome at best and subject to error.

In a previous publication we described statistical methodology, implemented in our software MicroMerge, for aligning microsatellite and multiallelic marker data sets [4]. MicroMerge v1 has been successfully applied by Chen et al. (2006) to linkage data [5]. MicroMerge aligns data sets marker by marker, matching each marker's allele frequencies while preserving size order. Figure 1 illustrates this alignment concept for a marker X that was genotyped on two different sets of DNA samples (data sets). An allele frequency histogram is shown for each data set, where the x-axis indicates the allele size in base-pairs, and the y-axis gives the frequency of each allele within the relevant data set. Note that seven unique alleles were observed in each data set, and the alleles had similar frequencies. We conclude that the alleles match consecutively, that is the smallest allele in data set one is the same as the smallest allele in data set two, and so on. However, in addition to allele frequency similarity, this conclusion relies on both data sets meeting the following criteria. First, each data set must consist of samples from the same ethnic group, as allele frequencies may vary among populations. Second, the sample size of each data set must be large enough to obtain accurate allele frequency estimates. In our experience, matching consecutive alleles with similar frequencies between data sets is an effective strategy for increasing genetic analysis power if the aforementioned criteria are met.

thumbnailFigure 1. Allele frequency histograms for the same marker X typed at different laboratories on two similar sets of samples (Data set 1 and Data set 2).

The concept of aligning microsatellite marker alleles based on frequency information rather than size (in base-pairs) was first proposed by Dorr et al. in 1997 [6]. In 2002, Weeks et al. illustrated the danger of aligning data sets using base-pair size information alone by sending the same set of DNA samples to two different genotyping facilities [7]. When these two data sets were merged marker by marker, according to allele sizes, the resulting merged data set had a genotype error rate of 16.8%. This is because allele sizes are only estimates that can differ between laboratories, instruments or experimental protocols. The consistency of estimating allele size within a particular facility, platform and protocol enables precise grouping of similarly-sized DNA fragments into a 'bin', which represents an allele. There are multiple methods for defining these bins, so that different grouping strategies can alter allele names for the same raw genotype data [8]. For a more thorough discussion of the difficulties of merging microsatellite data and prior research in this area, we refer the reader to our previous MicroMerge publication [4].

For reasons mentioned above, allele calls may only approximate the true alleles present in a set of DNA samples. MicroMerge uses a Bayesian model to align the observed bins to a proposed set of true theoretical alleles, where the number of theoretical alleles is estimated from the model. For clarity we will use the term 'bin' to distinguish an observed data set allele from an actual theoretical allele. MicroMerge uses MCMC methods to sample from the posterior distribution of possible alignments given the genotype data. Each MicroMerge alignment is characterized by three parameters (1) the number of theoretical alleles, (2) the theoretical allele frequencies, and (3) the partition. Figure 2 gives an example of a partition aligning bins from two data sets to four theoretical alleles. The vertical bars in this figure indicate correspondence between the data set bins and theoretical alleles. For example, bin A in data set 1 aligns with theoretical allele 1, and bin C' in data set 2 aligns with both theoretical alleles 3 and 4. On each iteration of the MCMC chain a change is proposed to one of the three alignment parameters, and the proposal is accepted or rejected by comparing the likelihoods of the proposed and current states.

thumbnailFigure 2. Example of a MicroMerge alignment for two data sets. Data set 1 has four bins, data set 2 has three bins and the data sets are aligned to four theoretical alleles (TA).

The focus of this paper, like our previous MicroMerge paper, is on merging multiallelic marker data (where microsatellite markers are the most common type of multiallelic markers). Merging multiallelic marker data sets is more challenging than merging SNP data sets because multiallelic markers may have ten or more alleles of varying fragment lengths. In comparison, a SNP marker usually has only two alleles whose identities are often known. In the Conclusions section we describe how MicroMerge might be applied to SNP data sets. But, in spite of the increasing popularity of SNP data, multiallelic markers continue to be widely used for genetic analysis. In a survey of annual publication records in the NCBI PubMed database http://www.pubmed.gov webcite since the year 2000 there have consistently been more than 3600 articles per year containing keywords pertaining to multiallelic markers (microsatellite marker, di/tri/tetranucleotide repeat, short tandem repeat, variable number tandem repeat and their plural and acronym forms). In comparison, the number of articles in a single year containing keywords pertaining to SNP markers (SNP, single nucleotide polymorphism and their plural forms) did not exceed 3600 articles until 2005. In the last three years (2005–2007) there were 5657, 5825 and 5745 annual multiallelic marker articles, and 4287, 5180 and 6508 SNP articles. While there is clearly an increasing trend in the number of SNP articles, the multiallelic marker articles have been holding constant over the past three years and have only been outnumbered by SNP articles in the past year. As a result, the importance of this marker type should not be discounted by the increasing interest in SNP data.

While MicroMerge v1 was able to successfully merge and create output files which could be analyzed by some programs such as Mendel, we realized a need for more flexible merging options [9]. MicroMerge v2 includes seven new features that significantly extend the capabilities of v1. In the next sections we describe these features and present results from both simulated and real data sets. Finally, we show how MicroMerge can increase the statistical power of a genetic analysis by comparing association results from three separately analyzed familial dyslipidemia data sets to the association result obtained from analyzing the combined data sets.

Methods

Before describing the new MicroMerge features and their underlying methodologies, we define some terminology and introduce the data sets used to test MicroMerge. "Overlap" and "distance" are two measures of alignment accuracy that were described in our previous publication [4]. Overlap is a measure that quantifies the certainty of each bin pair within an alignment. A bin i defined by lab 1 and a bin j defined by lab 2 overlap if they both align with one or more of the same theoretical alleles. The overlap probability for this pair oij can be approximated by the fraction of the sampled alignments where overlap occurs. The "average overlap" for an alignment A is just the average of the overlap probabilities for each bin pair within the alignment.

"Distance" quantifies the accuracy of a MicroMerge alignment in relation to a manually obtained alignment. Each manual merge was obtained by aligning data set bins marker by marker using frequencies, relative base-pair size differences, eight samples common to both data sets, and aligning the data by eye. Consider a binary indicator overlap matrix L for an alignment A, where the dimensions are defined by the number of bins in each data set. Unit entries lij in L indicate whether bins i and j overlap in alignment A.

The distance between a MicroMerge alignment A and manual alignment M, is given by

<a onClick="popup('http://www.biomedcentral.com/1471-2105/9/317/mathml/M1','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/9/317/mathml/M1">View MathML</a>

Note that we only report alignment accuracy (distance) results when a reference alignment is available. The MicroMerge v1 algorithm ascribed differences in observed bins for a particular marker between data sets typed at different laboratories to allele-calling differences. This assumption often produces 'lumped' alignments where a bin from one data set may align with more than one bin in another data set. While it is more flexible than forcing a bin from one data set to align with only one bin in another data set, or creating a 'one-to-one' alignment, the resulting merged data files pose a problem to most genetic analysis programs. This is because if a bin in data set 1 aligns with two bins in data set 2, their relationship is coded as a phenotype in the merged locus and pedigree files. In order to generalize the output files so that they can be understood by the majority of genetic analysis programs, we include an option to create merged files with one-to-one alignments. Interpretations of the two alignment types are described in the following two sections.

Lumped alignment

A lumped alignment assumes that for a particular marker all of the same unique bins exist in both data sets, but that genotyping differences or genotyping errors may have caused the reported number of unique bins to differ between the data sets. For example, data set 1 in Figure 2 observes four bins, but data set 2 observes only three bins because theoretical alleles 3 and 4 are lumped into bin C'. In the pedigree file for the above example, the C'/C' genotype in data set 2 would be coded as a phenotype 2: C' + C', where "2" corresponds to data set 2, and the bin names are included for clarity. The 2: C' + C' phenotype would be consistent with any of the following genotypes: 3/4, 3/3, and 4/4, and this correspondence would be included in the locus file. The data set resulting from this alignment includes genotypes expressed as non-codominant phenotypes, and must be analyzed by capable software such as Mendel [9].

One-to-one alignment

The one-to-one alignment format explains discrepant numbers of bins between data sets for a particular marker by assuming that an allele observed in one data set is missing from the other data set. Figure 3 shows a one-to-one alignment similar to the lumped alignment from Figure 2, except that C' in data set 2 was paired with only theoretical allele 3, and thus with only bin C in data set 1. The zero indicates that bin D in data set 1 was not present in the data set 2 DNA samples, and there were no '4' alleles observed in that sample. The C = C genotype in data set 2 would correspond to a single genotype 3/3 in the merged locus and pedigree files, hence the merged one-to-one format data can be analyzed by any program that handles genotype data such as GENEHUNTER [10], MERLIN [11] and LINKAGE [12]. We detail how the one-to-one alignment is translated from a lumped alignment after describing the test data sets.

thumbnailFigure 3. Example of a one-to-one MicroMerge v2 alignment for the data sets in Figure 2. In this case C' in data set 2 corresponds only with bin C in data set 1. TA is an abbreviation for "theoretical alleles".

Test data sets

We tested the accuracy of our new MicroMerge v2 features on both simulated data and the real genotype data that was described in our previous publication, which we refer to as the 'real data project' [4]. In the following Methods and Results and Discussion subsections the test data was simulated unless otherwise noted.

The real data project consisted of a pair of data sets with approximately 87 and 333 samples, typed with 50 microsatellite markers. The correct alignment between these data sets was known for 48 of the markers based on a manual merge, where each manual alignment was obtained by eye without the aid of a computer or merging algorithm (as previously described). In order to assess the accuracy of both lumped and one-to-one alignment formats, a corresponding one-to-one reference alignment was manually translated from each lumped manual merge alignment. "Bin spacing" information refers to the base-pair differences between bins of consecutive size. While the actual base-pair size is unreliable, generally genotyping is consistent within a laboratory. For example, a dinucleotide marker typically has bins spaced in increments (or multiples) of approximately two base-pairs.

The lumped and one-to-one alignments require different manually obtained alignments. After manually obtaining a lumped alignment by eye, we then manually selected the corresponding one-to-one alignment with the best allele frequency match between the data sets. In a few cases it was difficult to determine the best manual alignments. For example, if the number of unique alleles differed by ≥ 2 alleles between data sets.

We use a familial dyslipidemia study sample containing dinucleotide repeat microsatellite genotypes from chromosome 11 markers to illustrate MicroMerge v2's ability to improve association analysis. The familial dyslipidemia study sample consists of Dutch (Dutch) and two Finnish (Finn1 and Finn2) data sets genotyped with the Weber screening set version 6 for the purpose of studying familial dyslipidemia (FD) [13,14]. The Dutch data set consisted of 275 samples genotyped on Applied Biosystems' ABI PRISM® 377 platform. The Finn1 data set comprised 228 samples genotyped at the UCLA Genotyping and Sequencing Core on LI-COR 4200 DNA Analyzers. Finn2 consisted of 248 samples genotyped at the National Public Health Institute of Finland on Applied Biosystems' ABI PRISM® 377 platform. We considered a set of ten markers D11S1984, D11S2362, D11S1999, D11S1981, D11S1392, D11S2002, D11S2000, D11S1998, D11S4464 and D11S912 that were genotyped on all three data sets. The range for the number of unique bins per marker in the Dutch data set was 6–18 (with an average of 8.9 bins per marker), 6–13 (with an average of 7.9 bins per marker) in the Finn1 data set and 6–17 (with an average of 8.8 bins per marker) in the Finn2 data set. On average the number of unique bins per marker differed by one between data sets. Marker D11S200 had the greatest difference in number of unique bins observed among the data sets with 18 unique bins in the Dutch data set, 13 unique bins in Finn1 and 17 in Finn2.

Now that we have covered some terminology and described the test data sets, we move to details of the MicroMerge v2 features. In the remainder of this section and in the following Results and Discussion section, each new MicroMerge v2 feature is numbered and titled for clarity. To assist the reader, we have also summarized these features and their usage in Table 1.

Table 1. Overview of the new features incorporated into MicroMerge v2 and guidelines for when to use them

Feature 1: One-to-one alignment format

To retrieve a one-to-one MicroMerge v2 alignment, the original MicroMerge algorithm is preserved, but the lumped alignments are translated to one-to-one alignments. In both Micromerge versions lumped alignments are saved every 1,000 iterations after a burn-in period, and a default value of 1,000 alignments are saved to determine the alignment(s) between the data sets. When the user selects the one-to-one alignment option, each lumped alignment is translated to all possible corresponding one-to-one alignments. The default setting chooses the one-to-one alignment with the highest likelihood to represent the lumped alignment. The likelihood is computed from the product of the data set genotype frequencies, where the genotype frequencies are computed assuming Hardy-Weinberg equilibrium values and the bin frequencies are obtained from the theoretical allele frequencies. The frequency of each zeroed theoretical allele is divided among the remaining alleles. Figure 4 shows an example of the two one-to-one alignments corresponding to a lumped alignment with three theoretical alleles.

thumbnailFigure 4. Example of a lumped MicroMerge alignment and its corresponding one-to-one alignments, where TA = theoretical alleles, DS1 = data set 1 bins, and DS2 = data set 2 bins.

Feature 2: Controlling one-to-one alignment translation

The default setting for the one-to-one alignment option selects the most probable one-to-one alignment translation for each lumped alignment. We allow some control over this translation process to offer flexibility when a lumped alignment has many one-to-one translations with competing likelihoods. In the case where X one-to-one alignment translations are saved for each lumped alignment, each one-to-one alignment t is weighted by its likelihood with weight <a onClick="popup('http://www.biomedcentral.com/1471-2105/9/317/mathml/M2','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/9/317/mathml/M2">View MathML</a>. Lt is the likelihood of alignment t and for each set of X alignments <a onClick="popup('http://www.biomedcentral.com/1471-2105/9/317/mathml/M3','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/9/317/mathml/M3">View MathML</a> so that for each lumped alignment the count of saved one-to-one alignments is incremented by one.

Feature 3: Re-merging markers with low posterior probabilities

A limitation of MicroMerge v1 was that about 20% of markers had low posterior probability alignments, and we recommended against analyzing the merged results for these markers. These low posterior probabilities were often due to frequency differences among rare bins. To see how this problem could arise, consider a rare bin occurring once in one data set, and twice in another data set of the same size. While this could easily happen by chance, bin frequencies differing by a multiple of two or more are considered to be substantially different. In this case the presence of one or two rare alleles can result in a low posterior probability, rejection of the alignment, and the loss of data for an entire marker.

In MicroMerge v2 we developed a method for zeroing rare bins and re-merging the data sets for qualifying markers. When a marker's top alignment posterior probability falls below a threshold, it is considered for re-merging. Then if a pair of aligned bins (or set of aligned bins in the case where more than two data sets are merged) has an overlap probability below a threshold value and its corresponding theoretical allele frequency qualifies as rare, the theoretical allele is zeroed. Zeroing a theoretical allele means that all corresponding data set bins with only one instance in the alignment (ie, bins having a one-to-one correspondence with the zeroed theoretical allele) are zeroed in their pedigree files. The data for this marker are then re-merged.

Table 2 shows an example of executing this method for marker D4S291 from the real data project. MicroMerge v2 had aligned D4S291 correctly based on a manually obtained alignment but had rejected it for merging due to a low alignment posterior probability. Imposing a minimum overlap probability of 0.85 and minimum theoretical allele frequency of 0.015, the theoretical alleles 5, 6 and 8 are zeroed. These theoretical alleles correspond to E', F' and H' in data set 2 and bins E and F in data set 1. The data set 2 bins all align uniquely to the zeroed theoretical alleles. As a result, all genotypes containing either E', F' or H' are removed from the data set 2 pedigree file. Since there are multiple instances of both E and F in the data set 1 alignment, there is no change to the data set 1 pedigree file. Marker D4S291 is then re-merged to achieve a more confident alignment. We demonstrate this option on the 48 real data markers and simulated data sets for both lumped and one-to-one alignment formats.

Table 2. Example of a top alignment for marker D4S291 with low posterior probability 0.235 due to four consecutive low frequency alleles (theoretical alleles 5–8).

Feature 4: Adjusting the prior on the theoretical allele number

Another enhancement of MicroMerge v2 is an option allowing control over the number of theoretical alleles. This is useful for situations where data set bin frequencies do not match well, but it is expected that the same bins have been observed within each data set. For example, if one data set is several times larger than the other, it seems likely that the larger data set would observe all bins present in the smaller data set. In this scenario, it may be useful to put stronger emphasis on alignments with fewer theoretical alleles. The number of theoretical alleles n is allowed to vary between the maximum number of unique bins observed in a single data set (nmin = maxi|Bi|, where |Bi| is the number of unique bins observed in data set i) to the sum of all unique data set bins (<a onClick="popup('http://www.biomedcentral.com/1471-2105/9/317/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/9/317/mathml/M4">View MathML</a>). The geometric prior distribution of n with success probability τ

<a onClick="popup('http://www.biomedcentral.com/1471-2105/9/317/mathml/M5','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/9/317/mathml/M5">View MathML</a>

encourages smaller values. In MicroMerge v2 the user can adjust the default value for τ within a reasonable range. While all allowable values for τ emphasize alignments with a small number of theoretical alleles, this option allows control over the strength of this emphasis.

We test this option on the real data, and present results for several selected markers. Results are reported for markers with a) top alignments containing potentially excess theoretical alleles (n = nmin + 1), b) similar posterior probabilities among the top alignments and c) incorrect alignments. The idea behind this test was to show that while the minimum value might increase the posterior probability of set b) and increase the accuracy of set c), it could weaken results for set a).

Feature 5: Using population allele frequencies to align data

If a data set is too small to obtain accurate estimates of bin frequencies, the user can now merge the data using specified allele frequencies rather than allele frequencies estimated from the data set. When reliable allele frequencies of ethnically matched populations are available, these population frequencies can be substituted for the calculated bin frequencies of any data set(s) to be merged. We implement this feature by listing population frequencies in the locus file(s) and alerting MicroMerge v2 with an option in the control file to use these frequencies. These population frequencies are then used to generate a pedigree file that is used in place of the original pedigree file to align the data sets. Once the optimal alignment is known, the original pedigree files are merged. This feature would also be useful for users who wish to simulate pedigree files based on a given sample size and locus file.

MicroMerge v2 allows some control over the construction of the generated pedigree file. The default sample size is equal to the average size of the other data sets (with a minimum value of 200 samples), but the user can specify an alternative sample size using this Feature 5 option. In addition to choosing the sample size(s) the user also has a choice between two different data generating schemes. The nearly exact number of genotypes can be computed from the predicted genotype frequencies under Hardy-Weinberg equilibrium (HWE), or each genotype can be sampled according to the HWE genotype frequencies. The data generating process is controlled by an option in the control file, where the default method is to sample from the genotype frequencies.

This option was tested for the one-to-one alignment format on six real data markers. Half of these markers had incorrect alignments when the bin frequencies were estimated from the pedigree files. The larger data set bin frequencies were used as population frequencies for the smaller data set to demonstrate the utility of this option.

Feature 6: Aligning multiple data sets

In the case where there are more than two data sets, MicroMerge v2 is able to merge them simultaneously (whereas MicroMerge v1 had to align them in a pair-wise fashion). Simulated data sets were used to test the success of aligning multiple data sets simultaneously. Table 3 shows the population bin frequencies that were used to create the three simulated data sets Da, Db, and Dc. Da consisted of 100 samples and observed all four population bins. Db and Dc both had a sample size of 50 and were missing one bin each. We tested the multiple data set alignment feature by first merging Db with Dc, merging the resulting data set with Da, and then contrasting this alignment result with the simultaneous alignment of data sets Da, Db, and Dc. This test was conducted on both the lumped and one-to-one alignment options.

Table 3. Three simulated data sets each consisting of Ni genotype samples from the given distribution of population allele frequencies.

Feature 7: Likelihood ratio test for assessing alignment quality

Three alignment quality assessment measures were presented in the first MicroMerge release: posterior probability, average overlap, and the difference between the posterior probabilities of the top two alignments. We include an additional score in MicroMerge v2, based on a maximum likelihood criterion. We implement a likelihood ratio test by comparing (1) the likelihood computed using sample counts as the bin frequency estimates to (2) the merged data likelihood, where the data set bin frequencies are derived from the theoretical allele frequencies. The likelihood ratio statistic [15] is 2ln(Q0/Q1), where Q0 is the merged data likelihood and Q1 is the original data likelihood. This statistic follows the chi-square distribution χv, with degrees of freedom v equal to the difference in the number of independent parameters between the two models <a onClick="popup('http://www.biomedcentral.com/1471-2105/9/317/mathml/M6','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/9/317/mathml/M6">View MathML</a> (where d is the number of data sets and |Bj| is one less than the number of unique bins in data set j, and n is the number of theoretical alleles).

Association analysis of familial dyslipidemia study sample

We illustrate MicroMerge's utility for association analysis using the familial dyslipidemia (FD) study samples. For both lumped and one-to-one formats, we created merged data sets for all three FD data sets and all pair-wise combinations of the FD data sets, resulting in a total of eight different merged data sets. We then ran Mendel's Option 8 gamete competition analysis [9] on each data set independently and on the eight combinations of merged data sets. The gamete competition option was selected for its ability to handle the phenotype data generated by bin lumping.

Results and discussion

For the results presented here, Feature 3: re-merging markers with low posterior probabilities was run in combination with each of the other MicroMerge v2 features. This option creates the standard set of output files as well as an additional set of files for any markers that were re-merged. Because Feature 3 expands MicroMerge v2's merged data output, we recommend using a more conservative posterior probability threshold of 0.425 with this option (for lumped alignments) rather than the previously published 0.3 threshold for MicroMerge v1. Both of these thresholds were empirically determined based on the accuracy of the real data project alignments in comparison to the manually-obtained alignments. The results described below are based on this more conservative threshold for defining acceptable alignments.

Feature 1: One-to-one alignment format

In order to test the success of the one-to-one alignment format, we compared the accuracy results for both the one-to-one and lumped formats for the 48 real data project markers. Plots of the top alignment posterior probabilities versus the number of unique data set bins are shown in Figure 5 for both formats, where markers with top alignments in disagreement with the manual alignment are indicated with white circles. The lumped alignment format resulted in eight markers with discrepancies between the MicroMerge and manual alignments (Figure 5a), whereas the one-to-one format had only three (Figure 5b). The 0.425 posterior probability threshold discarded ten markers in the lumped format of which only six had alignments in disagreement with the manual alignment. This threshold also failed to flag two markers with small distances of one and two from the manual alignment. The 0.425 threshold discarded all three one-to-one format alignments that conflicted with the manual alignment. While the one-to-one format performed better for this data set in terms of the number of accurately aligned markers, the lumped alignment distance was lower on average (3.5/marker versus 6.7/marker in the one-to-one format).

thumbnailFigure 5. Accuracy of MicroMerge v2 alignments for the 48 real data project markers, as compared to a manually obtained reference alignment for the lumped alignment format (a) and the one-to-one format (b). The manual alignment was obtained by eye (without the aid of a merging program) by using bin frequencies, relative base-pair size differences, and eight samples common to both data sets. Each plot shows the posterior probability of each marker plotted against its number of unique bins (summed from both data sets), where a black circle indicates agreement between the MicroMerge v2 alignment and its corresponding reference alignment and a white circle indicates disagreement. The horizontal line at 0.425 represents the same acceptance threshold for comparison between the methods. For the real data project the one-toone alignment format (b) is more accurate than the lumped alignment (a) because all correct MicroMerge v2 alignments had posterior probabilities above the threshold and only three markers were misaligned. In comparison the lumped format had four correctly aligned markers with posterior probabilities that fell below the threshold and eight markers total were misaligned.

Feature 2: Controlling one-to-one alignment translation

As mentioned in the Method's section, the one-to-one alignment is translated from the lumped alignment, and each lumped alignment may have many possible one-to-one alignment translations. The default setting is to choose the highest likelihood translation, but we allow the user to save more than one translation per lumped alignment.

We tested this option by saving the top three (X = 3) one-to-one alignment translations from each lumped alignment for the real data project markers. The alignment for D4S3042 was marginally improved from a distance of 10 to 8, but this alignment also had a low posterior probability, so this improvement could be due to chance. While saving only one one-to-one alignment per lumped alignment performed best on our test data sets, the user has the option of testing this feature.

Feature 3: Re-merging markers with low posterior probabilities

Table 4 shows the results for re-merging the lumped alignments from the real data project. Ao refers to the top 'original' alignment result for the first merge and Ad is the top alignment result for the re-merged data. Since data set bins were zeroed before re-merging, accuracy was gauged using a manual alignment with the same bins zeroed Md.

Table 4. MicroMerge v2 lumped alignment results for nine poorly aligned markers before and after remerging.

Ten markers were rejected due to low alignment posterior probabilities (< 0.425). Nine of these markers also had at least one rare theoretical allele (with a frequency < 0.015). MicroMerge v2 zeroed the data set bins corresponding to these low frequency theoretical allele(s) if the overlap probability was also low (< 0.85). After re-merging, seven markers had top alignment posterior probabilities exceeding the minimum threshold of 0.425 (see unshaded markers in Table 4). In all cases, the MicroMerge v2 alignment agreement with the manual alignment either improved (five markers) or remained the same (four markers). Only two markers continued to have alignment posterior probabilities below the default threshold (shaded grey in Table 4). The re-merge option improved the yield of merged bins from 75% to 88%, with only a 1% reduction in accuracy to 98.5% (where accuracy was defined as the percentage of correctly aligned bins in comparison to a manually obtained alignment). For comparison, merging all of the data had an accuracy of 96.2%.

While this feature worked well for lumped alignments, it was less successful for the one-to-one format. According to the same lumped format criteria, three low posterior probability markers in the one-to-one alignment format were eligible for re-merging. D4S1637 and D4S3042 were re-merged correctly with posterior probabilities greater than 0.6 (where about 20% of bins were zeroed in both cases), but D4S2380 was less accurate after re-merging. The distance for this marker increased from 10 to 13, while the posterior probability also increased from 0.149 to 0.471. If the re-merging option is selected for the one-to-one alignment format, it may be useful to raise the accuracy threshold to about 0.5. In the real genotype data project the one-to-one format aligned 90.4% of bins with 100% accuracy, outperforming the lumped alignment format which aligned 88% of bins with 98.5% accuracy. When all data is merged with the one-to-one method, the overall accuracy is still high at 97.3%.

Feature 4: Adjusting the prior on the theoretical allele number

To offer some control over the prior distribution on the number of theoretical alleles without risking much accuracy we allow a range of values for τ [0.05,0.3]. Table 5 indicates how the default (0.2), minimum (0.05) and maximum (0.3) τ values affect results for the one-to-one alignment format using the real data project markers. Results are presented for four sets of real data project markers with the following attributes under the default τ a) top alignment A1 having n = nmin + 1 theoretical alleles, b) the second best alignment A2 having a competitive posterior probability to A1 and n = nmin + 1 theoretical alleles, c) incorrect alignments, and d) a marker with a correct alignment under the default τ that sometimes had an inaccurate alignment for the minimum τ.

Table 5. Results for ten markers aligned with the one-to-one format for three different priors on the number of theoretical alleles.

The results in Table 5 show that the group a) markers with a top alignment containing nmin + 1 alleles, were virtually unaffected by different τ values. The markers in group b) benefited from smaller τ values because their competing alignments A2 consisted of nmin + 1 alleles. This trend was also true for many other real data markers (not shown). The incorrectly aligned markers had slightly varying alignment accuracy for different τ's, but this could be attributed to chance as the low posterior probability alignments have variable top alignment accuracies for different start seeds.

Feature 5: Using population allele frequencies to align data sets

Since there were no population allele frequencies available to test this feature, we constructed the following test scenario based on six real data project markers D4S1560, D4S2966, D4S406, D4S3042, D4S1637 and D4S2380 (where the first three were aligned correctly and the latter were incorrectly aligned with the one-to-one format). We selected the larger of the two real data project data sets to represent the population allele frequencies for each marker. When feature 5 is selected, MicroMerge v2 uses the allele frequencies provided in the locus file rather than estimating bin frequencies from the pedigree file. The locus file frequencies were used to generate a simulated pedigree file, and the simulated pedigree file was used in place of the original small data set pedigree file in the merging algorithm. Once the alignments were obtained, the two original data files were combined to produce a merged pedigree file.

We used the larger data set's bin frequencies as population frequencies for the smaller data set. The result was a high posterior probability with perfect alignment in each case (not shown). This was expected because the smaller data set's locus file and simulated pedigree file consisted of the same set of unique bins with very similar frequencies to the larger data set. While this example is admittedly simplistic, it illustrates the potential of this feature. If a set of population allele frequencies for a small data set is similar to the allele frequencies of a larger data set, we can expect that MicroMerge v2 will find an accurate, high posterior probability alignment.

Feature 6: Aligning multiple data sets

Results for aligning three simulated data sets are shown in Figure 6. Data set a (Da) has two rare bins, 1 and 2, and the two smaller data sets Db and Dceach observed one of these bins. When the three data sets were aligned in one MicroMerge v2 run (Figure 6a), the correct alignment was obtained with an acceptable posterior probability. Figure 6b shows that if the data sets were merged using two MicroMerge runs, ie first merging Db and Dc and then merging this result Dbc with Da, the resulting alignment would be incorrect. This is because merging Db with Dc ignores the information available in Da. These results show that aligning three or more data sets in one MicroMerge v2 run has the potential to achieve a more accurate alignment than conducting a series of pairwise merges.

thumbnailFigure 6. The multiple data set alignment feature was tested by comparing a) the simultaneous alignment of the three simulated data sets in Table 3, to b) the result from merging data set b (Db) and c (Dc) and then merging this result with the largest data set a (Da). The theoretical allele frequencies "Freq." and overlap probabilities "Overlap" are provided for each alignment, where bin i from lab 1 and a bin j from lab 2 overlap if they both align with one or more of the same theoretical alleles. Their overlap probability oij can be estimated by the fraction of the sampled alignments where overlap occurs. This figure illustrates the importance of merging all data sets simultaneously rather than conducting a series of pair-wise merges. (a) Simultaneous alignment of all three data sets gave the correct alignment with posterior probability 0.55. This posterior probability is lower than the posterior probability for the alignment presented in part b) shown below because the posterior probability of the alignment of Db with Da was low (0.509). (b) The alignment of data set b with data set c was incorrect, but MicroMerge finds a high posterior probability for their alignment (0.997) because the bin frequencies match well. Since this alignment Dbc was not accurate, the alignment of Dbc with Da was also inaccurate (posterior probability 0.697).

Feature 7: Likelihood ratio test for assessing alignment quality

The likelihood ratio (LR) test result was useful for the lumped alignment format to evaluate genotype data quality and alert the user to control file problems. This statistic tested the null hypothesis that the unmerged model fit the data equally as well as the merged model. There are three columns in the output summary file related to this statistic. For each marker, the actual LR test statistic is reported, along with the chi-square test statistic for the 0.01 significance level, and then a column indicating rejection (1) or failure to reject (0) the null hypothesis. While posterior probability was generally the best quality measure for individual markers in the real data project, the LR statistic correctly flagged marker D4S1517 as incorrect.

The LR statistic gives a useful indication that the alignment process has run smoothly. In a successful set of MicroMerge v2 runs using default parameters for our 48 real data project markers, 92% had alignments that rejected the null hypothesis. When we ran this same set of markers with 30,000 iterations (where the default run length was 1,000,000), drawing 500 samples (default = 1,000) and the maximum τ, only 85% of alignments rejected the null hypothesis. Under these same sampling conditions, but now setting τ to the minimum value, the percentage rejecting the null dropped to 75%. As the new MicroMerge v2 features enable more control over the alignment algorithm, it is useful to have additional assurance from the likelihood ratio test that the specified alignment options are appropriate.

Association analysis of familial dyslipidemia study samples

Table 6 shows the results for Mendel's gamete competition analysis for the 10 chromosome 11 microsatellite markers from the familial dyslipidemia study samples: Dutch, Finn1 and Finn2, where the data sets were analyzed separately and combined. MicroMerge v2 was used to merge all pair-wise combinations and then all three data sets together in both the a.) lumped and b.) one-to-one alignment formats. Table 6 shows that for the individual analyses of the Finnish data sets markers D11S2002 (Finn2 P-value = 0.038) and D11S1998 (Finn1 P-value = 0.016) were moderately significant. The one-to-one format is generally preferable for data sets with the same ethnicity and reliable genotyping because its assumption that each unobserved allele is missing (as opposed to being lumped into an adjacent allele) is justified in this case. When the two Finnish data sets were merged using the one-to-one alignment format, the D11S2002 association improved from a P-value of 0.038 in Finn2 to a merged Finn1 - Finn2 P-value of 0.011 while the D11S1998 association diminished from a P-value of 0.016 in Finn1 to a merged Finn1 - Finn2 P-value of 0.273. It appears that the significance of the D11S2002 association is largely attributed to its significance in the Finn2 data set, as the Finn1 P-value for this marker was 0.987. This result illustrates the power gained to detect an association when data sets are merged prior to analysis. Because MicroMerge aligns data sets based on allele frequencies, we have more confidence in MicroMerge's ability to align the two Finnish data sets than to align the Finnish data sets with the Dutch data set where the allele frequencies may be more variable. In the lumped format of the two merged Finnish data sets the D11S2002 association was lower (P-value = 0.109) in comparison to the single data set analysis of Finn2 (P-value = 0.038), but it still had the highest association among the ten markers. As a result, D11S2002 appeared to be the best candidate for familial dyslipidemia association among these markers.

Table 6. Mendel's gamete competition analysis P-values for three data sets (Dutch, Finn1 and Finn2) analyzed separately and combined using the a) one-to-one and b) lumped alignment formats.

Interestingly, for the pairwise alignments between the Dutch and Finnish data sets (Dutch - Finn1 and Dutch - Finn2) the D11S2002 association was stronger for the lumped alignment format (P-values = 0.264 and 0.020) than the one-to-one format (P-values = 0.468 and 0.032). One explanation is that the differences in allele frequencies between the Dutch and Finnish ethnic groups is more consistent with the lumped format theory. That is, rather than unobserved alleles being missing, they are explained by genotyping differences. These results indicate that the lumped format may be desirable for combining data sets of differing ethnicity.

In practice, it is best to use MicroMerge to align data sets containing samples from the same ethnic group. However, MicroMerge v2's Feature 5: Using population allele frequencies to align data sets can offer an effective solution if the appropriate population allele frequencies are available. Furthermore, the posterior probability can alert the user to alignment errors.

Conclusion

Tools for increasing power in association analysis are becoming increasingly important for complex disease research. MicroMerge software enables a higher-powered analysis of multiallelic marker data projects containing genotype data generated from different laboratories, platforms or protocols. Here we describe extensions to MicroMerge that increase its flexibility and accuracy for merging genotype data sets. We added seven new features to MicroMerge v2. Feature 1: One-to-one alignment format creates output files analyzable by most genetic analysis software. While in the real data project the one-to-one format had fewer alignment errors than the lumped alignment format, this is likely because it was a more appropriate format for this test data. Both data sets had fewer than 300 samples, and one data set was about 60% smaller than the other data set. As a result, differences in observed bins between these data sets was likely due to missing alleles in the smaller data set. We recommend using the lumped format if the user intends to analyze the resulting data sets with Mendel software and the data sets meet one of the following four criteria: 1.) only a small percentage (<5–10%) of unique data set bins have rare frequencies, where we define a rare bin as having five or fewer instances in any one data set; 2.) most of the markers have different numbers (differing by two or more) of unique bins between any pair of data sets; 3.) genotyping was done on platforms with different resolving power and 4.) other situations where bin frequencies do not match well. Otherwise we recommend using the MicroMerge v2 default one-to-one alignment format as it performed better on our test data sets and produces more flexible output files.

Feature 3: Re-merging markers with low posterior probabilities identifies low confidence regions of an alignment, zeroes rare bins within these regions, and re-merges the adjusted pedigree files. This feature recovers data from markers that might otherwise be discarded due to low confidence alignments because low posterior probability alignments are typically due to a few rare bins.

For markers where the expected alignment should contain n = nmin alleles, the user can quantify this preference using Feature 4: Adjusting the prior on the theoretical allele number, which allows adjustment of the n prior parameter τ. This feature may be useful when one data set is several times larger than the other data set(s), as the larger data set likely observes all alleles that were present in the smaller data set. Also, in a mixed data set containing both multiallelic and SNP markers this option could obviously be useful for the SNP markers since two alleles are expected. Adjusting the prior to strengthen emphasis on fewer theoretical alleles would improve alignment posterior probability in the case where a particular SNP marker's minor allele frequencies differed by several-fold between data sets.

Feature 5: Using population allele frequencies to align data sets should be useful for situations where bin frequencies estimated from the data are unreliable. This feature could be used for small data sets, family data, or to align data sets typed on different ethnic groups. For example, consider a genotyping laboratory X with data available on both ethnic groups A and B for the same marker set. If a research project had genotyped samples with ethnicity A at laboratory X and wished to combine these samples with a set of ethnicity B genotyped at another laboratory Y, the X laboratory might be able to provide the ethnicity B bin frequencies corresponding to ethnicity A's bins. Using the B frequencies to represent the A pedigree file data would likely improve the alignment of these data sets.

Association analysis of two merged Finnish data sets gave stronger evidence for association than tests conducted on each data set individually. Marker D11S2002 had a moderately significant P-value of 0.038 in Finn1 and a P-value of 0.011 in the combined Finnish data sets under the one-to-one alignment option. Indeed, linkage near this locus was found recently in a fine-mapping study (unpublished results). The association test P-value for the lumped alignment merge of the two data sets was 0.109, which was the most significant P-value among the ten markers. Since the one-to-one alignment format uses more information and we were confident in the allele frequency agreement between the two Finnish data sets, it is reasonable that the one-to-one format outperforms the lumped alignment format in this case.

Table 6 indicates that merge iii) combining data sets Dutch and Finn1 and merge iv) combining Dutch and Finn2 data sets had more significant P-values for marker D11S2002 associations in the lumped format (P-values = 0.264 and 0.020) than the one-to-one format (P-values = 0.468 and 0.032). Since it is likely that allele frequencies will differ more between the Finnish and Dutch data than the two Finnish data sets, in this case a more conservative alignment format may be appropriate. However, it is better to avoid merging data sets that contain samples with different ethnic origins unless population allele frequencies are available for each group (as described in the Feature 5: Using population allele frequencies to align data sets subsections). Even then one must carefully check and correct for any population stratification in the resulting merged data set prior to conducting an association analysis.

MicroMerge was designed to merge data sets of multiallelic markers, which are more difficult to align than SNP data sets due to the greater number of alleles. The MicroMerge alignment algorithm preserves the allele fragment size order indicated in each locus file, which is not directly applicable to SNP data. However, MicroMerge can be used to merge SNP data sets if the major and minor alleles are ordered in the same way in both sets. The correspondence between the alleles of two data sets for a SNP marker is usually known, since the markers are designed to detect specific nucleotides. However, there are several situations in which the application of MicroMerge to SNP data would be of value. I. Merging recoded alleles: The most common SNP markers are biallelic, with the two possible nucleotide substitutions known. The SNP allele can be reported as the nucleotide base observed. However, SNP data may be recoded in a variety of ways. SNPs in taqman data files are often coded by the SNP probe dye label, e.g., FAM or VIC, which may need to be aligned to nucleotide codes from another data set. In addition, if primer probes for a SNP are redesigned during the course of a study, it is possible that the dye label may be assigned to the opposite allele in the new probe. Another common coding system is using 0, 1, and 2 to designate the major allele homozygote, the minor allele homozygote, and the heterozygote, not always in the same combination. A third difference in SNP allele calling in different labs could be a result of differences in primer design. If the SNP primer in one lab is designed to anneal to the opposite DNA strand, the resulting SNP nucleotide will be the base complementary to the nucleotide on the strand in the original design. In any of these cases, where the alleles are called correctly but named differently in the two data sets, it is a fairly straightforward task to use the allele frequencies to identify the corresponding major and minor alleles between the two datasets. However MicroMerge can simplify and streamline this task, particularly for large SNP data sets which can number in the hundreds of thousands to millions of SNP markers. II. Error detection/quality control: Because MicroMerge gives an alignment posterior probability for every merged allele, using MicroMerge to merge SNP data sets even when it is believed that the correspondence between the alleles is known can identify errors or poor quality data. Because MicroMerge uses allele frequencies to merge alleles, and assigns a confidence for each merge, any problems in the data that result in poorly matched frequencies between the data sets would give low posterior probabilities. These problems could include the following: 1) genotype miscalls, for example those due to errors in clustering by allele calling software allele, 2) different naming schemes between the datasets, for example due to primers designed to opposite strands or probes labeled with different dyes, 4) population stratification between or within data sets. MicroMerge can be applied as a quality control step within a lab, to check between data sets generated at different times or on different platforms. While testing Hardy-Weinberg equilibrium would catch many of these frequency errors, errors might escape detection in the case where a small data set is merged with a large data set. In this situation, the large data set's allele frequencies would likely mask any frequency errors from detection by Hardy-Weinberg analysis performed on the merged data set. MicroMerge would flag frequency differences between the data sets as alignments with poor posterior probabilities. Error detection at each marker is particularly critical for association analysis since a true signal will often not extend beyond a single marker. We plan to illustrate the value of MicroMerge for merging large-scale SNP data sets and flagging potential errors in a future publication.

We have added seven useful new features to MicroMerge v2, and tested them on real and simulated data. In addition, we have used MicroMerge v2 to merge three previously published familial dyslipidemia study samples that were analyzed separately for association. MicroMerge confirmed a genetic association with familial dyslipidemia in the FD study sample. These results show that MicroMerge can effectively increase statistical power in genetic association analysis. MicroMerge v2 software can be run with a simple command line interface. It is available with supporting documentation at http://www.genetics.ucla.edu/software/micromerge webcite [see Additional file 1].

Additional file 1. MicroMerge v2 software for Windows. This file contains a copy of MicroMerge v2 software for Windows (Win2K+) on Intel. Versions of MicroMerge v2 developed for Linux and Macintosh systems, as well as current releases of MicroMerge can be found here: http://www.genetics.ucla.edu/software/ webcite.

Format: ZIP Size: 500KB Download fileOpen Data

Availability and requirements

Project name: MicroMerge

Project home page: http://www.genetics.ucla.edu/software/micromerge webcite

Operating system(s): Linux (any version) on Intel and Windows (Win2K+) on Intel

Programming language: Fortran 90

Other requirements: none

License: none

Any restrictions to use by non-academics: none

Authors' contributions

APP, EMS and JCP conceived of and developed most of the MicroMerge v2 features. DEW and KÅ developed the one-to-one alignment method and debugged the software. PP and CP provided the familial dyslipidemia data. The manuscript was written by APP and all authors revised and approved the manuscript.

Acknowledgements

We would like to thank Marja-Riitta Taskinen, Leena Peltonen and Tjerk de Bruin for the familial dyslipidemia sample collection, the previously published genotype data of which was used to develop this software. We would like to thank the UCLA GenoSeq Core http://www.genoseq.ucla.edu for the Finn2 raw data.

References

  1. Ioannidis JP: Genetic associations: false or true?

    Trends Mol Med 2003, 9(4):135-8.

    [1471-4914 (Print) Journal Article Review]

    PubMed Abstract | Publisher Full Text OpenURL

  2. Burgner D, Jamieson SE, Blackwell JM: Genetic susceptibility to infectious diseases: big is beautiful, but will bigger be even better?

    Lancet Infect Dis 2006, 6(10):653-63.

    [1473-3099 (Print) Journal Article Research Support, Non-U.S. Gov't Review]

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Freimer N, Sabatti C: The use of pedigree, sib-pair and association studies of common diseases for genetic mapping and epidemiology.

    Nat Genet 2004, 36(10):1045-51.

    [1061-4036 (Print) Journal Article Review]

    PubMed Abstract | Publisher Full Text OpenURL

  4. Presson AP, Sobel E, Lange K, Papp JC: Merging microsatellite data.

    J Comput Biol 2006, 13(6):1131-47.

    [1066-5277 (Print) Journal Article]

    PubMed Abstract | Publisher Full Text OpenURL

  5. Chen GK, Slaten E, Ophoff RA, Lange K: Accommodating chromosome inversions in linkage analysis.

    Am J Hum Genet 2006, 79(2):238-51.

    [Chen, Gary K Slaten, Erin Ophoff, Roel A Lange, Kenneth GM068875/GM/United States NIGMS GM53275/GM/United States NIGMS MH59490/MH/United States NIMH T32 HG02536/HG/United States NHGRI Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't United States American journal of human genetics Am J Hum Genet. 2006 Aug;79(2):238–51. Epub 2006 Jun 6.]

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  6. Dorr DA, Rice JP, Armstrong C, Reich T, Blehar M: A meta-analysis of chromosome 18 linkage data for bipolar illness.

    Genet Epidemiol 1997, 14(6):617-22.

    [Dorr, D A Rice, J P Armstrong, C Reich, T Blehar, M MH31302/MH/United States NIMH MH37685/MH/United States NIMH Meta-Analysis Research Support, U.S. Gov't, P.H.S. United states Genetic epidemiology Genet Epidemiol. 1997;14(6):617–22.]

    PubMed Abstract | Publisher Full Text OpenURL

  7. Weeks DE, Conley YP, Ferrell RE, Mah TS, Gorin MB: A tale of two genotypes: consistency between two high-throughput genotyping centers.

    Genome Res 2002, 12(3):430-5.

    [1088-9051 (Print) Comparative Study Journal Article Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, P.H.S.]

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  8. Idury RM, Cardon LR: A simple method for automated allele binning in microsatellite markers.

    Genome Res 1997, 7(11):1104-9.

    [Idury, R M Cardon, L R United states Genome research Genome Res. 1997 Nov;7(11):1104–9.]

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Lange K, Cantor R, Horvath S, Perola M, Sabatti C, Sinsheimer J, Sobel E: Mendel version 4.0: A complete package for the exact genetic analysis of discrete traits in pedigree and population data sets.

    Am J Hum Genet 2001, 69(supplement):A1886. OpenURL

  10. Kruglyak L, Daly MJ, Reeve-Daly MP, Lander ES: Parametric and nonparametric linkage analysis: a unified multipoint approach.

    Am J Hum Genet 1996, 58(6):1347-63.

    [0002-9297 (Print) Comparative Study Journal Article Research Support, U.S. Gov't, P.H.S.]

    PubMed Abstract | PubMed Central Full Text OpenURL

  11. Abecasis GR, Cherny SS, Cookson WO, Cardon LR: Merlin-rapid analysis of dense genetic maps using sparse gene flow trees.

    Nat Genet 2002, 30:97-101.

    [1061-4036 (Print) Comparative Study Journal Article Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, P.H.S.]

    PubMed Abstract | Publisher Full Text OpenURL

  12. Lathrop GM, Lalouel JM, Julier C, Ott J: Strategies for multilocus linkage analysis in humans.

    Proc Natl Acad Sci USA 1984, 81(11):3443-6.

    [0027-8424 (Print) Journal Article]

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  13. Sheffield VC, Weber JL, Buetow KH, Murray JC, Even DA, Wiles K, Gastier JM, Pulido JC, Yandava C, Sunden SL, et al.: A collection of tri- and tetranucleotide repeat markers used to generate high quality, high resolution human genome-wide linkage maps.

    Hum Mol Genet 1995, 4(10):1837-44.

    [Sheffield, V C Weber, J L Buetow, K H Murray, J C Even, D A Wiles, K Gastier, J M Pulido, J C Yandava, C Sunden, S L P50HG00835/HG/United States NHGRI Research Support, U.S. Gov't, P.H.S. England Human molecular genetics Hum Mol Genet. 1995 Oct;4(10):1837–44.]

    PubMed Abstract | Publisher Full Text OpenURL

  14. Pajukanta P, Allayee H, Krass KL, Kuraishy A, Soro A, Lilja HE, Mar R, Taskinen MR, Nuotio I, Laakso M, Rotter JI, de Bruin TW, Cantor RM, Lusis AJ, Peltonen L: Combined analysis of genome scans of dutch and finnish families reveals a susceptibility locus for high-density lipoprotein cholesterol on chromosome 16q.

    Am J Hum Genet 2003, 72(4):903-17.

    [Pajukanta, Paivi Allayee, Hooman Krass, Kelly L Kuraishy, Ali Soro, Aino Lilja, Heidi E Mar, Rebecca Taskinen, Marja-Riitta Nuotio, Ilpo Laakso, Markku Rotter, Jerome I de Bruin, Tjerk W A Cantor, Rita M Lusis, Aldons J Peltonen, Leena 5-t32-gm08243-15/gm/nigms Hl-28481/hl/nhlbi Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, P.H.S. United States American journal of human genetics Am J Hum Genet. 2003 Apr;72(4):903–17. Epub 2003 Mar 12.]

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Neyman J, Pearson E: On the Problem of the Most Efficient Tests of Statistical Hypotheses.

    Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character 1933, 231:289-337. Publisher Full Text OpenURL