Maximum likelihood estimates of two-locus recombination fractions under some natural inequality restrictions

1471-2156-9-1 1471-2156 Methodology article Maximum likelihood estimates of two-locus recombination fractions under some natural inequality restrictions Zhou Ying zhouy577@yahoo.com.cn Shi Ning-Zhong shinz@nenu.edu.cn Fung Wing-Kam wingfung@hku.hk Guo Jianhua jhguo@nenu.edu.cn

Key Laboratory for Applied Statistics of MOE and School of Mathematics and Statistics, Northeast Normal University, Changchun 130024, P. R. China

Department of Statistics and Actuarial Science, The University of Hong Kong, Hong Kong, P. R. China

BMC Genetics 1471-2156 2008 9 1 1 http://www.biomedcentral.com/1471-2156/9/1 18173855 10.1186/1471-2156-9-1 11 9 2007 04 1 2008 04 1 2008 2008 Zhou et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The goal of linkage analysis is to determine the chromosomal location of the gene(s) for a trait of interest such as a common disease. Three-locus linkage analysis is an important case of multi-locus problems. Solutions can be found analytically for the case of triple backcross mating. However, in the present study of linkage analysis and gene mapping some natural inequality restrictions on parameters have not been considered sufficiently, when the maximum likelihood estimates (MLEs) of the two-locus recombination fractions are calculated.

Results

In this paper, we present a study of estimating the two-locus recombination fractions for the phase-unknown triple backcross with two offspring in each family in the framework of some natural and necessary parameter restrictions. A restricted expectation-maximization (EM) algorithm, called REM is developed. We also consider some extensions in which the proposed REM can be taken as a unified method.

Conclusion

Our simulation work suggests that the REM performs well in the estimation of recombination fractions and outperforms current method. We apply the proposed method to a published data set of mouse backcross families.

Background

Molecular genetics has made much progress in recent years, among which linkage analysis fulfills an important role. Genetic linkage refers to the ordering of genetic loci on a chromosome and to estimating genetic distances among them, where these distances are determined on the basis of a statistical phenomenon. Statistical machinery has been used to analyze family data and to detect linkage 1234. The degree of linkage can be measured by recombination fraction. The proportion of recombinant haplotypes (or offspring) potentially produced by a doubly heterozygous parent is called recombination fraction, which is also the probability of occurrence of a recombination. Many map functions under different assumptions have been derived 567, from which the genetic distance and the recombination fraction can be mutually transformed. Human gene mapping is now an important field of science. A critical first step in finding gene loci that contribute to a genetic trait is to demonstrate linkage with a gene of known location (marker). So estimating the recombination fractions is important in linkage analysis.

In several respects, three-locus analysis yields more information than does two-locus analysis 891011. Three-locus linkage analysis is also an important case of multi-locus problems. Methods for detecting multilocus linkage in humans and estimation of recombination have been proposed by Lathrop et al. 12, and Lathrop 13. More recently, Ott 3 has considered the estimation of two-locus recombination fractions for phase-unknown triple backcross families with two offspring in each family. The author gave the presentations of the estimates of the two-locus recombination fractions. Wu et al. 9 considered simultaneous estimation of linkage and linkage phases in outcrossing species. However, as mentioned in Ott 3, the estimates suggested by the author may not satisfy some natural restrictions which two-locus recombination fractions should satisfy in fact. One may not obtain a reasonable interpretation on the recombination phenomenon among loci based on the estimates. Furthermore, illegimate estimates of recombination fractions may also reduce the power to detect linkage which can provide irresponsible evidence to the researchers. In addition, the restrictions on recombination fractions given in the context are necessary in linkage analysis. For example, they can be applied to determine the locus order on the chromosome 91011.

This estimation problem of two-locus recombination fractions in three-locus linkage analysis belongs to the constrained parameter problems which are not only important but also appear in many areas. The reader is referred to 14151617. However, the methods provided in the literatures cannot be directly applied to the above genetics problem.

Motivated by this unsolved problem that the restrictions on recombination fractions have not been considered sufficiently, in this paper, we consider the estimation of the two-locus recombination fractions under some natural and necessary restrictions. We develop a restricted EM algorithm, called REM, which gives estimating results through taking account of the natural inequality restrictions on the two-locus recombination fractions, and the algorithm has been implemented by computer. Moreover, this algorithm can be easily generalized to other cases, and the REM performs well as a unified approach. Simulation studies show that our new method works well in each scenario and has advantages over current method, in other words, the major advantages of our method is its robustness and efficiency. An example is used to validate the application of our method to linkage analysis.

Methods

Consider three biallele marker loci, where alleles are designed as A, a; B, b; C, c at loci A, B, C, respectively, with the order of loci being A-B-C. Assume a triply homozygous parent abc/abc, and a triply heterozygous parent (A/a, B/b, C/c). For the latter, there are four possible phases: (I) ABC/abc, (II) ABc/abC, (III) AbC/aBc, (IV) Abc/aBC. As Ott 3 pointed out, under regular conditions (linkage equilibrium), each of these phases occurs with probability 1/4. When it is not the case, we let the prior probability be h_i(i = 1, 2, 3, 4) in a later section, and give corresponding feasible approach.

Each offspring only receives haplotype abc from the triply homozygous parent, but receives one of the eight possible kinds of haplotypes from the heterozygous parent, which can be seen at the second column of Table 1. The last four columns of Table 1 give the conditional probabilities with which the offspring phenotypes occur given the parental phase, and the first column presents the code for each haplotype that we will use. For the phase-unknown triple backcross, each haplotype symbol listed in Table 1 just corresponds to one offspring phenotype of the markers.

Table 1

Conditional haplotype probabilities given phase produced by a triply heterozygous parent

Phase

Haplotype

III

ABC

g₀₀/2

g₀₁/2

g₁₁/2

g₁₀/2

ABc

g₀₁/2

g₀₀/2

g₁₀/2

g₁₁/2

AbC

g₁₁/2

g₁₀/2

g₀₀/2

g₀₁/2

Abc

g₁₀/2

g₁₁/2

g₀₁/2

g₀₀/2

aBC

g₁₀/2

g₁₁/2

g₀₁/2

g₀₀/2

aBc

g₁₁/2

g₁₀/2

g₀₀/2

g₀₁/2

abC

g₀₁/2

g₀₀/2

g₁₀/2

g₁₁/2

abc

g₀₀/2

g₀₁/2

g₁₁/2

g₁₀/2

Total

g₀₀, g₀₁, g₁₀and g₁₁denote joint recombination fractions, where the subscript 1 represents recombination, and 0 represents nonrecombination.

Let θ_AB, θ_BCand θ_AC, respectively denote two-locus recombination fractions between loci A and B, between loci B and C, and between loci A and C; g₀₀, g₀₁, g₁₀and g₁₁denote joint recombination fractions, where the subscript 1 represents recombination, and 0 represents non-recombination, e.g., g₁₀is the probability of single recombinant with a recombination for loci A and B but none for loci B and C. So it is clear that the following equations hold:

θ_AB= g₁₁+ g₁₀, θ_BC= g₁₁+ g₀₁, θ_AC= g₁₀+ g₀₁.

Ott 3 groups all possible two-offspring haplotype pairs into four phenotype classes with probability p_k(k = 1, 2, 3, 4) according to linkage analysis regulation. These classes are reproduced in Table 2, in which the second column represents two-offspring haplotype pairs, corresponding to two phenotypes. Taking (i, j) = (5, 6) as an example, we say one of the sib pair expresses phenotype aa/Bb/Cc, and the other expresses phenotype aa/Bb/cc. There is no order relationship between i and j. The probabilities of occurrence for all 8 × 9/2 = 36 possible pairs of offspring's phenotypes can be calculated easily, e.g., the joint probability of occurrence of phenotypes aa/Bb/Cc and aa/Bb/cc (diplotypes aBC/abc and aBc/abc) is (g₁₁g₁₀+ g₀₁g₀₀)/4. It then turns out that, among the 36 probabilities, only four different values occur so that phenotypes with the same probabilities may be combined a single class and four classes are obtained.

Table 2

Phenotype classes for phase-unknown triple backcross families with two offspring

(i, j)^a

p _k

(1,1), (2,2), (3,3), (4,4), (5,5), (6,6) (7,7), (8,8), (4,5), (3,6), (2,7), (1,8)

g 11 2 + g 10 2 + g 01 2 + g 00 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabigdaXiabigdaXaqaaiabikdaYaaakiabgUcaRiabdEgaNnaaDaaaleaacqaIXaqmcqaIWaamaeaacqaIYaGmaaGccqGHRaWkcqWGNbWzdaqhaaWcbaGaeGimaaJaeGymaedabaGaeGOmaidaaOGaey4kaSIaem4zaC2aa0baaSqaaiabicdaWiabicdaWaqaaiabikdaYaaaaaa@3FE7@

(1,2), (3,4), (3,5), (1,7), (4,6), (2,8), (5,6), (7,8)

2(g₁₁g₁₀+ g₀₁g₀₀)

(2,3), (1,4), (1,5), (2,6), (3,7), (4,8), (6,7), (5,8)

2(g₁₁g₀₁+ g₁₀g₀₀)

(1,3), (2,4), (2,5), (1,6), (4,7), (3,8), (5,7), (6,8)

2(g₁₁g₀₀+ g₁₀g₀₁)

Total

^a(i, j): i and j refer to the code of haplotype in Table 1, corresponding to a phenotype each.

Let the total number of families (or sib pairs) observed be n, and the number of families which are grouped into class k be n_k(k = 1, 2, 3, 4). Then (n₁, n₂, n₃, n₄) is multinomial distributed with probability (p₁, p₂, p₃, p₄), and ∑k=14nk=n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaabCaeaacqWGUbGBdaWgaaWcbaGaem4AaSgabeaakiabg2da9iabd6gaUbWcbaGaem4AaSMaeyypa0JaeGymaedabaGaeGinaqdaniabggHiLdaaaa@37C5@. The MLEs of p_k's are p^k=nkn MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGafmiCaaNbaKaadaWgaaWcbaGaem4AaSgabeaakiabg2da9KqbaoaalaaabaGaemOBa42aaSbaaeaacqWGRbWAaeqaaaqaaiabd6gaUbaaaaa@34CF@ (k = 1, 2, 3, 4). Using the function relationships given in equations (1) and Table 2, as well as the property of MLE, the MLEs of θ_AB, θ_BCand θ_ACcan be obtained as Ott 3. We call this method the unrestricted method that gives unrestricted estimates, and let θ^U=(θ^ABU,θ^BCU,θ^ACU) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaakiabg2da9maabmaabaGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaemOqaieabaGaemyvaufaaOGaeiilaWIaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemyvaufaaOGaeiilaWIaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemyvaufaaaGccaGLOaGaayzkaaaaaa@4328@ denote the unrestricted MLE, where

θ ^ A B U = { 1 / 2 − 1 / 2 1 − 2 ( p ^ 3 + p ^ 4 ) , 1 / 2 , if p ^ 3 + p ^ 4 < 1 / 2 , otherwise, θ ^ B C U = { 1 / 2 − 1 / 2 1 − 2 ( p ^ 2 + p ^ 4 ) , 1 / 2 , if p ^ 2 + p ^ 4 < 1 / 2 , otherwise, θ ^ A C U = { 1 / 2 − 1 / 2 1 − 2 ( p ^ 2 + p ^ 3 ) , 1 / 2 , if p ^ 2 + p ^ 3 < 1 / 2 , otherwise . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaqbaeaabmGaaaqaaGGaciqb=H7aXzaajaWaa0baaSqaaiabdgeabjabdkeacbqaaiabdwfavbaakiabg2da9maaceqabaqbaeaabiqaaaqaaiabigdaXiabc+caViabikdaYiabgkHiTiabigdaXiabc+caViabikdaYmaakaaabaGaeGymaeJaeyOeI0IaeGOmaiJaeiikaGIafmiCaaNbaKaadaWgaaWcbaGaeG4mamdabeaakiabgUcaRiqbdchaWzaajaWaaSbaaSqaaiabisda0aqabaGccqGGPaqkaSqabaGccqGGSaalaeaacqaIXaqmcqGGVaWlcqaIYaGmcqGGSaalaaaacaGL7baaaeaafaqaaeGabaaabaGaeeyAaKMaeeOzayMaeeiiaaIafmiCaaNbaKaadaWgaaWcbaGaeG4mamdabeaakiabgUcaRiqbdchaWzaajaWaaSbaaSqaaiabisda0aqabaGccqGH8aapcqaIXaqmcqGGVaWlcqaIYaGmcqGGSaalaeaacqqGVbWBcqqG0baDcqqGObaAcqqGLbqzcqqGYbGCcqqG3bWDcqqGPbqAcqqGZbWCcqqGLbqzcqqGSaalaaaabaGaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemyvaufaaOGaeyypa0ZaaiqabeaafaqaaeGabaaabaGaeGymaeJaei4la8IaeGOmaiJaeyOeI0IaeGymaeJaei4la8IaeGOmaiZaaOaaaeaacqaIXaqmcqGHsislcqaIYaGmcqGGOaakcuWGWbaCgaqcamaaBaaaleaacqaIYaGmaeqaaOGaey4kaSIafmiCaaNbaKaadaWgaaWcbaGaeGinaqdabeaakiabcMcaPaWcbeaakiabcYcaSaqaaiabigdaXiabc+caViabikdaYiabcYcaSaaaaiaawUhaaaqaauaabaqaceaaaeaacqqGPbqAcqqGMbGzcqqGGaaicuWGWbaCgaqcamaaBaaaleaacqaIYaGmaeqaaOGaey4kaSIafmiCaaNbaKaadaWgaaWcbaGaeGinaqdabeaakiabgYda8iabigdaXiabc+caViabikdaYiabcYcaSaqaaiabb+gaVjabbsha0jabbIgaOjabbwgaLjabbkhaYjabbEha3jabbMgaPjabbohaZjabbwgaLjabbYcaSaaaaeaacuWF4oqCgaqcamaaDaaaleaacqWGbbqqcqWGdbWqaeaacqWGvbqvaaGccqGH9aqpdaGabeqaauaabaqaceaaaeaacqaIXaqmcqGGVaWlcqaIYaGmcqGHsislcqaIXaqmcqGGVaWlcqaIYaGmdaGcaaqaaiabigdaXiabgkHiTiabikdaYiabcIcaOiqbdchaWzaajaWaaSbaaSqaaiabikdaYaqabaGccqGHRaWkcuWGWbaCgaqcamaaBaaaleaacqaIZaWmaeqaaOGaeiykaKcaleqaaOGaeiilaWcabaGaeGymaeJaei4la8IaeGOmaiJaeiilaWcaaaGaay5EaaaabaqbaeaabiqaaaqaaiabbMgaPjabbAgaMjabbccaGiqbdchaWzaajaWaaSbaaSqaaiabikdaYaqabaGccqGHRaWkcuWGWbaCgaqcamaaBaaaleaacqaIZaWmaeqaaOGaeyipaWJaeGymaeJaei4la8IaeGOmaiJaeiilaWcabaGaee4Ba8MaeeiDaqNaeeiAaGMaeeyzauMaeeOCaiNaee4DaCNaeeyAaKMaee4CamNaeeyzauMaeeOla4caaaaaaaa@D701@

Natural inequality restrictions on parameters

In parameter estimation, not only the data structure but also the restrictions on the parameters should be considered, otherwise the MLEs obtained may be unreasonable. For two-locus recombination fractions, the following inequality restrictions: θ_AB≤ θ_BC+ θ_AC, θ_BC≤ θ_AB+ θ_AC, θ_AC≤ θ_AB+ θ_BC, and 0 ≤ θ_AB, θ_BC, θ_AC≤ 1/2 must be considered. For the given order of loci A-B-C, additional restrictions: θ_AB≤ θ_ACand θ_BC≤ θ_ACare required. Combining all these inequalities, the following equivalent restrictions are obtained:

{ θ A B ≤ θ A C , θ B C ≤ θ A C , θ A C ≤ θ A B + θ B C , θ A C ≤ 1 / 2. MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeabbaaaaeaaiiGacqWF4oqCdaWgaaWcbaGaemyqaeKaemOqaieabeaakiabgsMiJkab=H7aXnaaBaaaleaacqWGbbqqcqWGdbWqaeqaaOGaeiilaWcabaGae8hUde3aaSbaaSqaaiabdkeacjabdoeadbqabaGccqGHKjYOcqWF4oqCdaWgaaWcbaGaemyqaeKaem4qameabeaakiabcYcaSaqaaiab=H7aXnaaBaaaleaacqWGbbqqcqWGdbWqaeqaaOGaeyizImQae8hUde3aaSbaaSqaaiabdgeabjabdkeacbqabaGccqGHRaWkcqWF4oqCdaWgaaWcbaGaemOqaiKaem4qameabeaakiabcYcaSaqaaiab=H7aXnaaBaaaleaacqWGbbqqcqWGdbWqaeqaaOGaeyizImQaeGymaeJaei4la8IaeGOmaiJaeiOla4caaaGaay5Eaaaaaa@5B62@

These restrictions are natural and necessary.

Proposed algorithm

In this section, we propose an approach to calculate MLEs of two-locus recombination fractions under restriction (2), which works well in application. From equations (1) and Table 2, p_k's are functions of independent parameters g₁₀, g₀₁and g₁₁, and also functions of θ_AB, θ_BCand θ_AC, so the log-likelihood function can be written as the following form

l ( θ | { n k } ) = ∑ k = 1 4 n k ln ⁡ ( p k ( θ A B , θ B C , θ A C ) ) , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiBaWMaeiikaGccciGae8hUdeNaeiiFaWNaei4EaSNaemOBa42aaSbaaSqaaiabdUgaRbqabaGccqGG9bqFcqGGPaqkcqGH9aqpdaaeWbqaaiabd6gaUnaaBaaaleaacqWGRbWAaeqaaOGagiiBaWMaeiOBa4MaeiikaGIaemiCaa3aaSbaaSqaaiabdUgaRbqabaGccqGGOaakcqWF4oqCdaWgaaWcbaGaemyqaeKaemOqaieabeaakiabcYcaSiab=H7aXnaaBaaaleaacqWGcbGqcqWGdbWqaeqaaOGaeiilaWIae8hUde3aaSbaaSqaaiabdgeabjabdoeadbqabaGccqGGPaqkcqGGPaqkaSqaaiabdUgaRjabg2da9iabigdaXaqaaiabisda0aqdcqGHris5aOGaeiilaWcaaa@5ACD@

where θ = (θ_AB, θ_BC, θ_AC). Our goal is to find θ^R=(θ^ABR,θ^BCR,θ^ACR) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaakiabg2da9maabmaabaGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaemOqaieabaGaemOuaifaaOGaeiilaWIaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemOuaifaaOGaeiilaWIaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemOuaifaaaGccaGLOaGaayzkaaaaaa@4310@, such that l(θ^R|{nk})=max⁡θl(θ|{nk}) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiBaWMaeiikaGccciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaakiabcYha8jabcUha7jabd6gaUnaaBaaaleaacqWGRbWAaeqaaOGaeiyFa0NaeiykaKIaeyypa0ZaaCbeaeaacyGGTbqBcqGGHbqycqGG4baEaSqaaiab=H7aXbqabaGccqWGSbaBcqGGOaakcqWF4oqCcqGG8baFcqGG7bWEcqWGUbGBdaWgaaWcbaGaem4AaSgabeaakiabc2ha9jabcMcaPaaa@4CEF@ under restriction (2), where θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ denotes the restricted MLE of θ.

We propose our restricted EM algorithm (REM) on the basis of the EM algorithm of Dempster et al. 18 as follows:

Augment the observed data {n_k, k = 1, 2, 3, 4} by latent variables {n_kl, k, l = 1, 2, 3, 4} to obtain a complete data set, where nk=∑l=14nkl MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemOBa42aaSbaaSqaaiabdUgaRbqabaGccqGH9aqpdaaeWbqaaiabd6gaUnaaBaaaleaacqWGRbWAcqWGSbaBaeqaaaqaaiabdYgaSjabg2da9iabigdaXaqaaiabisda0aqdcqGHris5aaaa@3AA8@, and {n_kl, k, l = 1, 2, 3, 4} is multinomial distributed with probability {p_kl, k, l = 1, 2, 3, 4}. Here, p_klare components of p_kin Table 2 with p11=g002,p12=g012,p13=g102,p14=g112 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiCaa3aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGH9aqpcqWGNbWzdaqhaaWcbaGaeGimaaJaeGimaadabaGaeGOmaidaaOGaeiilaWIaemiCaa3aaSbaaSqaaiabigdaXiabikdaYaqabaGccqGH9aqpcqWGNbWzdaqhaaWcbaGaeGimaaJaeGymaedabaGaeGOmaidaaOGaeiilaWIaemiCaa3aaSbaaSqaaiabigdaXiabiodaZaqabaGccqGH9aqpcqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeGOmaidaaOGaeiilaWIaemiCaa3aaSbaaSqaaiabigdaXiabisda0aqabaGccqGH9aqpcqWGNbWzdaqhaaWcbaGaeGymaeJaeGymaedabaGaeGOmaidaaaaa@5201@; p₂₁= g₀₀g₀₁, p₂₂= g₀₀g₀₁, p₂₃= g₁₀g₁₁, p₂₄= g₁₀g₁₁; p₃₁= g₀₀g₁₀, p₃₂= g₀₀g₁₀, p₃₃= g₀₁g₁₁, p₃₄= g₀₁g₁₁; p₄₁= g₀₀g₁₁, p₄₂= g₀₀g₁₁, p₄₃= g₀₁g₁₀, p₄₄= g₀₁g₁₀. n_klhave its interpretation, for example, n₁₁can be interpreted as the number of the families: (phase I → (1,1) or (8,8) or (1,8)), or (phase II → (2,2) or (7,7) or (2,7)), or (phase III → (4,4) or (5,5) or (4,5)), or (phase IV → (3,3) or (6,6) or (3,6)), where (phase I → (1,1)) denotes the event that the families have phase I, and the haplotype pairs of their offspring are (1,1), and other notations are analogous to interpret.

Because parameters θ_AB, θ_BC, and θ_ACare equivalent to independent parameters g₁₀, g₀₁and g₁₁, we still consider parameters g₁₀, g₀₁and g₁₁here, and restriction (2) is equivalent to the following restriction (3):

{ g 11 ≤ g 01 , g 11 ≤ g 10 , g 11 ≥ 0 , g 01 + g 10 ≤ 1 / 2. MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeabbaaaaeaacqWGNbWzdaWgaaWcbaGaeGymaeJaeGymaedabeaakiabgsMiJkabdEgaNnaaBaaaleaacqaIWaamcqaIXaqmaeqaaOGaeiilaWcabaGaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGHKjYOcqWGNbWzdaWgaaWcbaGaeGymaeJaeGimaadabeaakiabcYcaSaqaaiabdEgaNnaaBaaaleaacqaIXaqmcqaIXaqmaeqaaOGaeyyzImRaeGimaaJaeiilaWcabaGaem4zaC2aaSbaaSqaaiabicdaWiabigdaXaqabaGccqGHRaWkcqWGNbWzdaWgaaWcbaGaeGymaeJaeGimaadabeaakiabgsMiJkabigdaXiabc+caViabikdaYiabc6caUaaaaiaawUhaaaaa@5440@

Thus, finding MLE g^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2E9A@ (the restricted MLE of g = (g₁₀, g₀₁, g₁₁), such that l(g^R|{nk})=max⁡gl(g|{nk}) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiBaWMaeiikaGccbeGaf83zaCMbaKaadaahaaWcbeqaaiabdkfasbaakiabcYha8jabcUha7jabd6gaUnaaBaaaleaacqWGRbWAaeqaaOGaeiyFa0NaeiykaKIaeyypa0ZaaCbeaeaacyGGTbqBcqGGHbqycqGG4baEaSqaaiab=DgaNbqabaGccqWGSbaBcqGGOaakcqWFNbWzcqGG8baFcqGG7bWEcqWGUbGBdaWgaaWcbaGaem4AaSgabeaakiabc2ha9jabcMcaPaaa@4BD3@) under restriction (3) implies finding MLE θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ of θ under (2). The complete data log-likelihood function can be written as

l ( g | { n k l } ) = ∑ k = 1 4 ∑ l = 1 4 n k l ln ⁡ ( p k l ( g ) ) , k , l = 1 , 2 , 3 , 4 , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaqbaeqabeGaaaqaaiabdYgaSjabcIcaOGqabiab=DgaNjabcYha8jabcUha7jabd6gaUnaaBaaaleaacqWGRbWAcqWGSbaBaeqaaOGaeiyFa0NaeiykaKIaeyypa0ZaaabCaeaadaaeWbqaaiabd6gaUnaaBaaaleaacqWGRbWAcqWGSbaBaeqaaOGagiiBaWMaeiOBa4MaeiikaGIaemiCaa3aaSbaaSqaaiabdUgaRjabdYgaSbqabaGccqGGOaakcqWFNbWzcqGGPaqkcqGGPaqkaSqaaiabdYgaSjabg2da9iabigdaXaqaaiabisda0aqdcqGHris5aaWcbaGaem4AaSMaeyypa0JaeGymaedabaGaeGinaqdaniabggHiLdGccqGGSaalaeaacqWGRbWAcqGGSaalcqWGSbaBcqGH9aqpcqaIXaqmcqGGSaalcqaIYaGmcqGGSaalcqaIZaWmcqGGSaalcqaI0aancqGGSaalaaaaaa@64AE@

where p_kl's are functions of g as given above. The conditional expectation of l(g|{n_kl}) when the sth step parameter values g^(s)are given is

Q ( g | g ( s ) , { n k } ) = 2 [ a 1 ( s + 1 ) l n ( 1 − g 01 − g 10 − g 11 ) + a 2 ( s + 1 ) l n ( g 01 ) + a 3 ( s + 1 ) l n ( g 10 ) + a 4 ( s + 1 ) l n ( g 11 ) ] , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemyuaeLaeiikaGccbeGae83zaCMaeiiFaWNae83zaC2aaWbaaSqabeaacqGGOaakcqWGZbWCcqGGPaqkaaGccqGGSaalcqGG7bWEcqWGUbGBdaWgaaWcbaGaem4AaSgabeaakiabc2ha9jabcMcaPiabg2da9iabikdaYiabcUfaBjabdggaHnaaDaaaleaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqWGSbaBcqWGUbGBcqGGOaakcqaIXaqmcqGHsislcqWGNbWzdaWgaaWcbaGaeGimaaJaeGymaedabeaakiabgkHiTiabdEgaNnaaBaaaleaacqaIXaqmcqaIWaamaeqaaOGaeyOeI0Iaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGGPaqkcqGHRaWkcqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemiBaWMaemOBa4MaeiikaGIaem4zaC2aaSbaaSqaaiabicdaWiabigdaXaqabaGccqGGPaqkcqGHRaWkcqWGHbqydaqhaaWcbaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemiBaWMaemOBa4MaeiikaGIaem4zaC2aaSbaaSqaaiabigdaXiabicdaWaqabaGccqGGPaqkcqGHRaWkcqWGHbqydaqhaaWcbaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemiBaWMaemOBa4MaeiikaGIaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGGPaqkcqGGDbqxcqGGSaalaaa@8D1B@

where

a 1 ( s + 1 ) = n 1 ( g 00 ( s ) ) 2 p 1 ( s ) + n 2 g 00 ( s ) g 01 ( s ) p 2 ( s ) + n 3 g 00 ( s ) g 10 ( s ) p 3 ( s ) + n 4 g 00 ( s ) g 11 ( s ) p 4 ( s ) , a 2 ( s + 1 ) = n 1 ( g 01 ( s ) ) 2 p 1 ( s ) + n 2 g 00 ( s ) g 01 ( s ) p 2 ( s ) + n 3 g 01 ( s ) g 11 ( s ) p 3 ( s ) + n 4 g 01 ( s ) g 10 ( s ) p 4 ( s ) , a 3 ( s + 1 ) = n 1 ( g 10 ( s ) ) 2 p 1 ( s ) + n 2 g 11 ( s ) g 10 ( s ) p 2 ( s ) + n 3 g 00 ( s ) g 10 ( s ) p 3 ( s ) + n 4 g 01 ( s ) g 10 ( s ) p 4 ( s ) , a 4 ( s + 1 ) = n 1 ( g 11 ( s ) ) 2 p 1 ( s ) + n 2 g 11 ( s ) g 10 ( s ) p 2 ( s ) + n 3 g 01 ( s ) g 11 ( s ) p 3 ( s ) + n 4 g 00 ( s ) g 11 ( s ) p 4 ( s ) . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaqbaeaabqqaaaaabaGaemyyae2aa0baaSqaaiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabd6gaUnaaBaaaleaacqaIXaqmaeqaaKqbaoaalaaabaGaeiikaGIaem4zaC2aa0baaeaacqaIWaamcqaIWaamaeaacqGGOaakcqWGZbWCcqGGPaqkaaGaeiykaKYaaWbaaeqabaGaeGOmaidaaaqaaiabdchaWnaaDaaabaGaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaaaakiabgUcaRiabd6gaUnaaBaaaleaacqaIYaGmaeqaaKqbaoaalaaabaGaem4zaC2aa0baaeaacqaIWaamcqaIWaamaeaacqGGOaakcqWGZbWCcqGGPaqkaaGaem4zaC2aa0baaeaacqaIWaamcqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaabaGaemiCaa3aa0baaeaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaaaiabgUcaRiabd6gaUnaaBaaabaGaeG4mamdabeaadaWcaaqaaiabdEgaNnaaDaaabaGaeGimaaJaeGimaadabaGaeiikaGIaem4CamNaeiykaKcaaiabdEgaNnaaDaaabaGaeGymaeJaeGimaadabaGaeiikaGIaem4CamNaeiykaKcaaaqaaiabdchaWnaaDaaabaGaeG4mamdabaGaeiikaGIaem4CamNaeiykaKcaaaaacqGHRaWkcqWGUbGBdaWgaaqaaiabisda0aqabaWaaSaaaeaacqWGNbWzdaqhaaqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabcMcaPaaacqWGNbWzdaqhaaqaaiabigdaXiabigdaXaqaaiabcIcaOiabdohaZjabcMcaPaaaaeaacqWGWbaCdaqhaaqaaiabisda0aqaaiabcIcaOiabdohaZjabcMcaPaaaaaGaeiilaWcakeaacqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyypa0JaemOBa42aaSbaaSqaaiabigdaXaqabaqcfa4aaSaaaeaacqGGOaakcqWGNbWzdaqhaaqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabcMcaPaaacqGGPaqkdaahaaqabeaacqaIYaGmaaaabaGaemiCaa3aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaaaOGaey4kaSIaemOBa42aaSbaaSqaaiabikdaYaqabaqcfa4aaSaaaeaacqWGNbWzdaqhaaqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabcMcaPaaacqWGNbWzdaqhaaqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabcMcaPaaaaeaacqWGWbaCdaqhaaqaaiabikdaYaqaaiabcIcaOiabdohaZjabcMcaPaaaaaGaey4kaSIaemOBa42aaSbaaeaacqaIZaWmaeqaamaalaaabaGaem4zaC2aa0baaeaacqaIWaamcqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaGaem4zaC2aa0baaeaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaabaGaemiCaa3aa0baaeaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaaaiabgUcaRiabd6gaUnaaBaaabaGaeGinaqdabeaadaWcaaqaaiabdEgaNnaaDaaabaGaeGimaaJaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaiabdEgaNnaaDaaabaGaeGymaeJaeGimaadabaGaeiikaGIaem4CamNaeiykaKcaaaqaaiabdchaWnaaDaaabaGaeGinaqdabaGaeiikaGIaem4CamNaeiykaKcaaaaacqGGSaalaOqaaiabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpcqWGUbGBdaWgaaWcbaGaeGymaedabeaajuaGdaWcaaqaaiabcIcaOiabdEgaNnaaDaaabaGaeGymaeJaeGimaadabaGaeiikaGIaem4CamNaeiykaKcaaiabcMcaPmaaCaaabeqaaiabikdaYaaaaeaacqWGWbaCdaqhaaqaaiabigdaXaqaaiabcIcaOiabdohaZjabcMcaPaaaaaGccqGHRaWkcqWGUbGBdaWgaaWcbaGaeGOmaidabeaajuaGdaWcaaqaaiabdEgaNnaaDaaabaGaeGymaeJaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaiabdEgaNnaaDaaabaGaeGymaeJaeGimaadabaGaeiikaGIaem4CamNaeiykaKcaaaqaaiabdchaWnaaDaaabaGaeGOmaidabaGaeiikaGIaem4CamNaeiykaKcaaaaacqGHRaWkcqWGUbGBdaWgaaqaaiabiodaZaqabaWaaSaaaeaacqWGNbWzdaqhaaqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabcMcaPaaacqWGNbWzdaqhaaqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabcMcaPaaaaeaacqWGWbaCdaqhaaqaaiabiodaZaqaaiabcIcaOiabdohaZjabcMcaPaaaaaGaey4kaSIaemOBa42aaSbaaeaacqaI0aanaeqaamaalaaabaGaem4zaC2aa0baaeaacqaIWaamcqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaGaem4zaC2aa0baaeaacqaIXaqmcqaIWaamaeaacqGGOaakcqWGZbWCcqGGPaqkaaaabaGaemiCaa3aa0baaeaacqaI0aanaeaacqGGOaakcqWGZbWCcqGGPaqkaaaaaiabcYcaSaGcbaGaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabd6gaUnaaBaaaleaacqaIXaqmaeqaaKqbaoaalaaabaGaeiikaGIaem4zaC2aa0baaeaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaGaeiykaKYaaWbaaeqabaGaeGOmaidaaaqaaiabdchaWnaaDaaabaGaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaaaakiabgUcaRiabd6gaUnaaBaaaleaacqaIYaGmaeqaaKqbaoaalaaabaGaem4zaC2aa0baaeaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaGaem4zaC2aa0baaeaacqaIXaqmcqaIWaamaeaacqGGOaakcqWGZbWCcqGGPaqkaaaabaGaemiCaa3aa0baaeaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaaaiabgUcaRiabd6gaUnaaBaaabaGaeG4mamdabeaadaWcaaqaaiabdEgaNnaaDaaabaGaeGimaaJaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaiabdEgaNnaaDaaabaGaeGymaeJaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaaqaaiabdchaWnaaDaaabaGaeG4mamdabaGaeiikaGIaem4CamNaeiykaKcaaaaacqGHRaWkcqWGUbGBdaWgaaqaaiabisda0aqabaWaaSaaaeaacqWGNbWzdaqhaaqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabcMcaPaaacqWGNbWzdaqhaaqaaiabigdaXiabigdaXaqaaiabcIcaOiabdohaZjabcMcaPaaaaeaacqWGWbaCdaqhaaqaaiabisda0aqaaiabcIcaOiabdohaZjabcMcaPaaaaaGaeiOla4caaaaa@A3CB@

Then the restricted estimating problem may be written as

Max Q(g|g^(s), {n_k}), subject to g satisfies restriction (3).

The Hessian matrix of Q(g|g^(s), {n_k}) for g₁₀, g₀₁and g₁₁is negative definite, so Q(g|g^(s), {n_k}) is strictly concave for g₁₀, g₀₁and g₁₁. This implies that there exists one unique point g˜(s+1)=(g˜10(s+1),g˜01(s+1),g˜11(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaGaadaahaaWcbeqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabcIcaOiqbdEgaNzaaiaWaa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSiqbdEgaNzaaiaWaa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSiqbdEgaNzaaiaWaa0baaSqaaiabigdaXiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcMcaPaaa@502D@ satisfying Q(g˜(s+1)|g(s),{nk})=max⁡gQ(g|g(s),{nk}) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemyuaeLaeiikaGccbeGaf83zaCMbaGaadaahaaWcbeqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYha8jab=DgaNnaaCaaaleqabaGaeiikaGIaem4CamNaeiykaKcaaOGaeiilaWIaei4EaSNaemOBa42aaSbaaSqaaiabdUgaRbqabaGccqGG9bqFcqGGPaqkcqGH9aqpdaWfqaqaaiGbc2gaTjabcggaHjabcIha4bWcbaGae83zaCgabeaakiabdgfarjabcIcaOiab=DgaNjabcYha8jab=DgaNnaaCaaaleqabaGaeiikaGIaem4CamNaeiykaKcaaOGaeiilaWIaei4EaSNaemOBa42aaSbaaSqaaiabdUgaRbqabaGccqGG9bqFcqGGPaqkaaa@5A42@. Following some calculation, it is easy to obtain that g˜10(s+1)=a3(s+1)/n,g˜01(s+1)=a2(s+1)/n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGafm4zaCMbaGaadaqhaaWcbaGaeGymaeJaeGimaadabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyypa0Jaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabc+caViabd6gaUjabcYcaSiqbdEgaNzaaiaWaa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdggaHnaaDaaaleaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGVaWlcqWGUbGBaaa@5301@ and g˜11(s+1)=a4(s+1)/n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGafm4zaCMbaGaadaqhaaWcbaGaeGymaeJaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyypa0Jaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabc+caViabd6gaUbaa@3EFF@. If g˜(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaGaadaahaaWcbeqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@325F@ satisfies restriction (3), then g(s+1)=g˜(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGae83zaC2aaWbaaSqabeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpcuWFNbWzgaacamaaCaaaleqabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaaa@39E2@ in the (s + 1)th iteration for EM algorithm, otherwise, we use the Kuhn-Tucker conditions 1920 to deal with problem (5). Thus, we can still find a unique point ̌g(s+1)=(̌g10(s+1),̌g01(s+1),̌g11(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWeuvgwd1KuV1wyUbqegmwBYfdmaGabbiadaciKaaaa=XWa3Iqabiab+DgaNnaaCaaaleqabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyypa0JaeiikaGcceaGamaiGqca9=3hddCRaem4zaC2aa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSiadaciNaq==9XWa3kabdEgaNnaaDaaaleaacqaIWaamcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGSaalcWaGacja0=FFmmWTcqWGNbWzdaqhaaWcbaGaeGymaeJaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiykaKcaaa@66DF@, such that Q(̌g(s+1)|g(s),{nk})=max⁡gQ(g|g(s),{nk}) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemyuaeLaeiikaGYeuvgwd1KuV1wyUbqegmwBYfdmaGabbiadaciKaaaa=XWa3Iqabiab+DgaNnaaCaaaleqabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiiFaWNae43zaC2aaWbaaSqabeaacqGGOaakcqWGZbWCcqGGPaqkaaGccqGGSaalcqGG7bWEcqWGUbGBdaWgaaWcbaGaem4AaSgabeaakiabc2ha9jabcMcaPiabg2da9maaxababaGagiyBa0MaeiyyaeMaeiiEaGhaleaacqGFNbWzaeqaaOGaemyuaeLaeiikaGIae43zaCMaeiiFaWNae43zaC2aaWbaaSqabeaacqGGOaakcqWGZbWCcqGGPaqkaaGccqGGSaalcqGG7bWEcqWGUbGBdaWgaaWcbaGaem4AaSgabeaakiabc2ha9jabcMcaPaaa@6289@ under restriction (3), because Q(g|g^(s), {n_k}) is a strictly concave function for g₁₀, g₀₁and g₁₁and the restriction region is a convex set. See Appendix for the Kuhn-Tucker conditions and the solving process of ̌g(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWeuvgwd1KuV1wyUbqegmwBYfdmaGabbiadaciKaaaa=XWa3Iqabiab+DgaNnaaCaaaleqabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaaa@3AAA@.

We give the complete REM algorithm as follows:

Let g(0)=(g10(0),g01(0),g11(0)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGae83zaC2aaWbaaSqabeaacqGGOaakcqaIWaamcqGGPaqkaaGccqGH9aqpcqGGOaakcqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeiikaGIaeGimaaJaeiykaKcaaOGaeiilaWIaem4zaC2aa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabicdaWiabcMcaPaaakiabcYcaSiabdEgaNnaaDaaaleaacqaIXaqmcqaIXaqmaeaacqGGOaakcqaIWaamcqGGPaqkaaGccqGGPaqkaaa@46A5@ be the starting point (the starting value of g⁽⁰⁾may be taken as g^U=(g^10U,g^01U,g^11U) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaKaadaahaaWcbeqaaiabdwfavbaakiabg2da9iabcIcaOiqbdEgaNzaajaWaa0baaSqaaiabigdaXiabicdaWaqaaiabdwfavbaakiabcYcaSiqbdEgaNzaajaWaa0baaSqaaiabicdaWiabigdaXaqaaiabdwfavbaakiabcYcaSiqbdEgaNzaajaWaa0baaSqaaiabigdaXiabigdaXaqaaiabdwfavbaakiabcMcaPaaa@4131@ which can make the REM converge faster, where (g^10U,g^01U,g^11U) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaeiikaGIafm4zaCMbaKaadaqhaaWcbaGaeGymaeJaeGimaadabaGaemyvaufaaOGaeiilaWIafm4zaCMbaKaadaqhaaWcbaGaeGimaaJaeGymaedabaGaemyvaufaaOGaeiilaWIafm4zaCMbaKaadaqhaaWcbaGaeGymaeJaeGymaedabaGaemyvaufaaOGaeiykaKcaaa@3D54@ can be obtained from (θ^ABU,θ^BCU,θ^ACU) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaeiikaGccciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaemOqaieabaGaemyvaufaaOGaeiilaWIaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemyvaufaaOGaeiilaWIaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemyvaufaaOGaeiykaKcaaa@3F20@ by equations (1));

E-step: At step s, compute the expected number of recombination events a(s+1)=(a1(s+1),a2(s+1),a3(s+1),a4(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGae8xyae2aaWbaaSqabeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpcqGGOaakcqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiilaWIaemyyae2aa0baaSqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSiabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGSaalcqWGHbqydaqhaaWcbaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiykaKcaaa@5546@ from g^(s);

M-step: Compute g^(s+1)using a^(s+1). Firstly, compute g˜(s+1)=(g˜10(s+1),g˜01(s+1),g˜11(s+1))=(a3(s+1)/n,a2(s+1)/n,a4(s+1)/n) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaGaadaahaaWcbeqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabcIcaOiqbdEgaNzaaiaWaa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSiqbdEgaNzaaiaWaa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSiqbdEgaNzaaiaWaa0baaSqaaiabigdaXiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcMcaPiabg2da9iabcIcaOiabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGVaWlcqWGUbGBcqGGSaalcqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaei4la8IaemOBa4MaeiilaWIaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabc+caViabd6gaUjabcMcaPaaa@71C1@. If g˜(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaGaadaahaaWcbeqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@325F@ satisfies restriction (3), then g^(s+1)= g˜(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaGaadaahaaWcbeqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@325F@; otherwise, then g^(s+1)must belong to one of the following cases (i.e. only one case holds):

case 1. g00(s+1)=g01(s+1)=g10(s+1)=g11(s+1)=1/4 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIWaamcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpcqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyypa0Jaem4zaC2aa0baaSqaaiabigdaXiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabigdaXiabc+caViabisda0aaa@5433@, if the following inequalities hold simultaneously

{ a 3 ( s + 1 ) + a 4 ( s + 1 ) > a 1 ( s + 1 ) + a 2 ( s + 1 ) , a 2 ( s + 1 ) + a 4 ( s + 1 ) > a 1 ( s + 1 ) + a 3 ( s + 1 ) , a 2 ( s + 1 ) + a 3 ( s + 1 ) + a 4 ( s + 1 ) > 3 a 1 ( s + 1 ) ; MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeWabaaabaGaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaey4kaSIaemyyae2aa0baaSqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSaqaaiabdggaHnaaDaaaleaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGHRaWkcqWGHbqydaqhaaWcbaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyOpa4Jaemyyae2aa0baaSqaaiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGSaalaeaacqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaey4kaSIaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqaIZaWmcqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaei4oaSdaaaGaay5Eaaaaaa@9240@

case 2. g01(s+1)=g11(s+1)=g10(s+1)=a2(s+1)+a3(s+1)+a4(s+1)3n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpcqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyypa0tcfa4aaSaaaeaacqWGHbqydaqhaaqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaacqGHRaWkcqWGHbqydaqhaaqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaacqGHRaWkcqWGHbqydaqhaaqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaeaacqaIZaWmcqWGUbGBaaaaaa@62BB@, g00(s+1)=a1(s+1)n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaemOBa4gaaaaa@3E89@, if

{ a 3 ( s + 1 ) + a 4 ( s + 1 ) > 2 a 2 ( s + 1 ) , a 2 ( s + 1 ) + a 4 ( s + 1 ) > 2 a 3 ( s + 1 ) , 3 n / 4 ≥ a 2 ( s + 1 ) + a 3 ( s + 1 ) + a 4 ( s + 1 ) > 0 ; MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeWabaaabaGaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqaIYaGmcqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiilaWcabaGaemyyae2aa0baaSqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqaIYaGmcqWGHbqydaqhaaWcbaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiilaWcabaGaeG4mamJaemOBa4Maei4la8IaeGinaqJaeyyzImRaemyyae2aa0baaSqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGHRaWkcqWGHbqydaqhaaWcbaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyOpa4JaeGimaaJaei4oaSdaaaGaay5Eaaaaaa@8226@

case 3. g01(s+1)=g11(s+1)=a2(s+1)+a4(s+1)2n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpjuaGdaWcaaqaaiabdggaHnaaDaaabaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaiabgUcaRiabdggaHnaaDaaabaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaqaaiabikdaYiabd6gaUbaaaaa@511E@, g10(s+1)=g00(s+1)=a1(s+1)+a3(s+1)2n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIWaamcqaIWaamaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpjuaGdaWcaaqaaiabdggaHnaaDaaabaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaiabgUcaRiabdggaHnaaDaaabaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaqaaiabikdaYiabd6gaUbaaaaa@5116@, if

{ a 3 ( s + 1 ) a 4 ( s + 1 ) > a 1 ( s + 1 ) a 2 ( s + 1 ) , a 3 ( s + 1 ) > a 1 ( s + 1 ) , a 1 ( s + 1 ) + a 3 ( s + 1 ) ≥ a 2 ( s + 1 ) + a 4 ( s + 1 ) > 0 ; MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeWabaaabaGaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemyyae2aa0baaSqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSaqaaiabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiilaWcabaGaemyyae2aa0baaSqaaiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGHLjYScqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaey4kaSIaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg6da+iabicdaWiabcUda7aaaaiaawUhaaaaa@81A6@

case 4. g10(s+1)=g11(s+1)=a3(s+1)+a4(s+1)2n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpjuaGdaWcaaqaaiabdggaHnaaDaaabaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaiabgUcaRiabdggaHnaaDaaabaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaqaaiabikdaYiabd6gaUbaaaaa@5120@, g01(s+1)=g00(s+1)=a1(s+1)+a2(s+1)2n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIWaamcqaIWaamaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpjuaGdaWcaaqaaiabdggaHnaaDaaabaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaiabgUcaRiabdggaHnaaDaaabaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaqaaiabikdaYiabd6gaUbaaaaa@5114@, if

{ a 2 ( s + 1 ) a 4 ( s + 1 ) > a 1 ( s + 1 ) a 3 ( s + 1 ) , a 2 ( s + 1 ) > a 1 ( s + 1 ) , a 1 ( s + 1 ) + a 2 ( s + 1 ) ≥ a 3 ( s + 1 ) + a 4 ( s + 1 ) > 0 ; MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeWabaaabaGaemyyae2aa0baaSqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSaqaaiabdggaHnaaDaaaleaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiilaWcabaGaemyyae2aa0baaSqaaiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGHLjYScqWGHbqydaqhaaWcbaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaey4kaSIaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg6da+iabicdaWiabcUda7aaaaiaawUhaaaaa@81A4@

case 5. g01(s+1)=g11(s+1)=a2(s+1)+a4(s+1)2n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpjuaGdaWcaaqaaiabdggaHnaaDaaabaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaiabgUcaRiabdggaHnaaDaaabaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaqaaiabikdaYiabd6gaUbaaaaa@511E@, g10(s+1)=a3(s+1)n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaemOBa4gaaaaa@3E8F@, g00(s+1)=a1(s+1)n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaemOBa4gaaaaa@3E89@, if

{ a 4 ( s + 1 ) > a 2 ( s + 1 ) , 2 a 3 ( s + 1 ) ≥ a 2 ( s + 1 ) + a 4 ( s + 1 ) > 0 , a 2 ( s + 1 ) + 2 a 3 ( s + 1 ) + a 4 ( s + 1 ) ≤ n ; MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeWabaaabaGaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg6da+iabdggaHnaaDaaaleaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGSaalaeaacqaIYaGmcqWGHbqydaqhaaWcbaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyyzImRaemyyae2aa0baaSqaaiabikdaYaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqaIWaamcqGGSaalaeaacqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaey4kaSIaeGOmaiJaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGHKjYOcqWGUbGBcqGG7aWoaaaacaGL7baaaaa@77B8@

case 6. g10(s+1)=g11(s+1)=a3(s+1)+a4(s+1)2n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9iabdEgaNnaaDaaaleaacqaIXaqmcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH9aqpjuaGdaWcaaqaaiabdggaHnaaDaaabaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaiabgUcaRiabdggaHnaaDaaabaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaqaaiabikdaYiabd6gaUbaaaaa@5120@, g01(s+1)=a2(s+1)n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaemOBa4gaaaaa@3E8D@, g00(s+1)=a1(s+1)n MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaemOBa4gaaaaa@3E89@, if

{ a 4 ( s + 1 ) > a 3 ( s + 1 ) , 2 a 2 ( s + 1 ) ≥ a 3 ( s + 1 ) + a 4 ( s + 1 ) > 0 , 2 a 2 ( s + 1 ) + a 3 ( s + 1 ) + a 4 ( s + 1 ) ≤ n ; MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeWabaaabaGaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg6da+iabdggaHnaaDaaaleaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGSaalaeaacqaIYaGmcqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyyzImRaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGH+aGpcqaIWaamcqGGSaalaeaacqaIYaGmcqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaey4kaSIaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabgUcaRiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGHKjYOcqWGUbGBcqGG7aWoaaaacaGL7baaaaa@77BA@

case 7. g01(s+1)=a2(s+1)2(a2(s+1)+a3(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaeGOmaiJaeiikaGIaemyyae2aa0baaeaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaey4kaSIaemyyae2aa0baaeaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaeiykaKcaaaaa@4F54@, g10(s+1)=a3(s+1)2(a2(s+1)+a3(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaeGOmaiJaeiikaGIaemyyae2aa0baaeaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaey4kaSIaemyyae2aa0baaeaacqaIZaWmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaeiykaKcaaaaa@4F56@, g11(s+1)=a4(s+1)2(a1(s+1)+a4(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabigdaXiabigdaXaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaeGOmaiJaeiikaGIaemyyae2aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaey4kaSIaemyyae2aa0baaeaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaeiykaKcaaaaa@4F5A@, g00(s+1)=a1(s+1)2(a1(s+1)+a4(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaem4zaC2aa0baaSqaaiabicdaWiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg2da9KqbaoaalaaabaGaemyyae2aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaaabaGaeGOmaiJaeiikaGIaemyyae2aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaey4kaSIaemyyae2aa0baaeaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGaeiykaKcaaaaa@4F50@, if

{ a 2 ( s + 1 ) + a 3 ( s + 1 ) > a 1 ( s + 1 ) + a 4 ( s + 1 ) , a 4 ( s + 1 ) > 0 , a 1 ( s + 1 ) a 2 ( s + 1 ) > a 3 ( s + 1 ) a 4 ( s + 1 ) , a 1 ( s + 1 ) a 3 ( s + 1 ) > a 2 ( s + 1 ) a 4 ( s + 1 ) . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeabbaaaaeaacqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaey4kaSIaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg6da+iabdggaHnaaDaaaleaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGHRaWkcqWGHbqydaqhaaWcbaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiilaWcabaGaemyyae2aa0baaSqaaiabisda0aqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg6da+iabicdaWiabcYcaSaqaaiabdggaHnaaDaaaleaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqWGHbqydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyOpa4Jaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabdggaHnaaDaaaleaacqaI0aanaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGSaalaeaacqWGHbqydaqhaaWcbaGaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemyyae2aa0baaSqaaiabiodaZaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabg6da+iabdggaHnaaDaaaleaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqWGHbqydaqhaaWcbaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiOla4caaaGaay5Eaaaaaa@97ED@

The above procedure is iteratively carried out until convergence. Then the restricted MLE θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ of θ in terms of the restricted MLE g^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2E9A@ can be obtained correspondingly by equations (1).

Compared to the general EM algorithm, the M-step of the REM is a little more complex. It needs some necessary discrimination, then g^(s+1)can be obtained based on a^(s+1). Note that g^(s+1)has the closed-form solution, so it will largely improve the computational efficiency of the parameters. The restricted EM algorithm is convergent, and the restricted MLE θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ from the proposed restricted EM algorithm is a consistent estimator of the parameter θ.

Case for more offspring

It is an important fact that more offspring in each family will provide more information in linkage analysis, therefore, and we need to extend the REM algorithm to cases of multiple offspring (sibship) in each family.

We develop a strategy for estimating the two-locus recombination fractions for this case, and the proposed REM algorithm works as a unified method. Taking three-offspring case as an example, we group the observed families into 5 classes according to linkage analysis regulation, with the observed data {n_k, k = 1,⋯, 5}. After data augmentation, we obtain complete data {n_kl, k = 1, 2, 3, 4, 5, l = 1, 2, 3, 4}. Furthermore, the conditional expectation of the complete-data log-likelihood is

Q ( g | g ( s ) , { n k } ) = 3 [ b 1 ( s + 1 ) l n ( 1 − g 01 − g 10 − g 11 ) + b 2 ( s + 1 ) l n ( g 01 ) + b 3 ( s + 1 ) l n ( g 10 ) + b 4 ( s + 1 ) l n ( g 11 ) ] , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemyuaeLaeiikaGccbeGae83zaCMaeiiFaWNae83zaC2aaWbaaSqabeaacqGGOaakcqWGZbWCcqGGPaqkaaGccqGGSaalcqGG7bWEcqWGUbGBdaWgaaWcbaGaem4AaSgabeaakiabc2ha9jabcMcaPiabg2da9iabiodaZiabcUfaBjabdkgaInaaDaaaleaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqWGSbaBcqWGUbGBcqGGOaakcqaIXaqmcqGHsislcqWGNbWzdaWgaaWcbaGaeGimaaJaeGymaedabeaakiabgkHiTiabdEgaNnaaBaaaleaacqaIXaqmcqaIWaamaeqaaOGaeyOeI0Iaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGGPaqkcqGHRaWkcqWGIbGydaqhaaWcbaGaeGOmaidabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemiBaWMaemOBa4MaeiikaGIaem4zaC2aaSbaaSqaaiabicdaWiabigdaXaqabaGccqGGPaqkcqGHRaWkcqWGIbGydaqhaaWcbaGaeG4mamdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemiBaWMaemOBa4MaeiikaGIaem4zaC2aaSbaaSqaaiabigdaXiabicdaWaqabaGccqGGPaqkcqGHRaWkcqWGIbGydaqhaaWcbaGaeGinaqdabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaemiBaWMaemOBa4MaeiikaGIaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGGPaqkcqGGDbqxcqGGSaalaaa@8D25@

where bi(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemOyai2aa0baaSqaaiabdMgaPbqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@339B@'s have similar expressions with ai(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemyyae2aa0baaSqaaiabdMgaPbqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@3399@'s given previously. Then the other steps of the REM are the same as those for the case of two offspring, except replacing ai(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemyyae2aa0baaSqaaiabdMgaPbqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@3399@'s by bi(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemOyai2aa0baaSqaaiabdMgaPbqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@339B@'s. More offspring's cases are analogous completely. It is helpful to construct and analyze a linkage map using this kind of family data.

Case for unequal prior probabilities of linkage phases

Affected by many factors (e.g., linkage disequilibrium), each phase of a triply heterozygous parent's genotype may in fact not occur with equal prior probability, but the proposed REM can also be applied to the case of unequal phase probability as a unified method. Let each phase occur with probability h_i(i = 1, 2, 3, 4), where h_iis any fixed number that satisfying 0 ≤ h_i≤ 1, and ∑i=14hi=1 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaabCaeaacqWGObaAdaWgaaWcbaGaemyAaKgabeaakiabg2da9iabigdaXaWcbaGaemyAaKMaeyypa0JaeGymaedabaGaeGinaqdaniabggHiLdaaaa@373C@. In this case, two-offspring family data needs to be grouped into 10 different phenotype classes according to linkage analysis regulation (see Table 3), and we can obtain the observed data {n_k, k = 1, 2,⋯, 10}. Then we augment the observed data {n_k, k = 1, 2,⋯, 10} by latent variables {n_kl, k = 1, 2,⋯, 10, l = 1, 2, 3, 4} with corresponding probabilities {p_kl, k = 1, 2,⋯, 10, l = 1, 2, 3, 4}. The major difference from the procedure of the REM for h_i= 1/4 (i = 1, 2, 3, 4) lies in the expression of conditional expectation for each n_kl(k = 1, 2,⋯, 10, l = 1, 2, 3, 4). Take n₁₁as an example, E(n11|g(s),n1)=n1h1(g00(s))2p1(s) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemyrauKaeiikaGIaemOBa42aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGG8baFieqacqWFNbWzdaahaaWcbeqaaiabcIcaOiabdohaZjabcMcaPaaakiabcYcaSiabd6gaUnaaBaaaleaacqaIXaqmaeqaaOGaeiykaKIaeyypa0JaemOBa42aaSbaaSqaaiabigdaXaqabaqcfa4aaSaaaeaacqWGObaAdaWgaaqaaiabigdaXaqabaGaeiikaGIaem4zaC2aa0baaeaacqaIWaamcqaIWaamaeaacqGGOaakcqWGZbWCcqGGPaqkaaGaeiykaKYaaWbaaeqabaGaeGOmaidaaaqaaiabdchaWnaaDaaabaGaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaaaaaaa@511A@, where h₁is the assigned prior probability of phase I. Repeating the similar procedure given in the REM for h_i= 1/4 (i = 1, 2, 3, 4), we find that the conditional expectation of the log-likelihood of the complete data still has the form of (4), and only the expressions of the components of a^(s+1)are more complex than those given previously. Using the REM algorithm, we can obtain the restricted MLEs of the two-locus recombination fractions easily.

Table 3

Phenotype classification when each linkage phase occur with probability h_i

(i, j)^a

p _k

(1,1), (8,8), (1,8)

h 1 g 00 2 + h 2 g 01 2 + h 3 g 11 2 + h 4 g 10 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiAaG2aaSbaaSqaaiabigdaXaqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGimaadabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabikdaYaqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGymaedabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabiodaZaqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGymaedabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabisda0aqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeGOmaidaaaaa@49EF@

(2,2), (7,7), (2,7)

h 1 g 01 2 + h 2 g 00 2 + h 3 g 10 2 + h 4 g 11 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiAaG2aaSbaaSqaaiabigdaXaqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGymaedabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabikdaYaqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGimaadabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabiodaZaqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabisda0aqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGymaedabaGaeGOmaidaaaaa@49EF@

(3,3), (6,6), (3,6)

h 1 g 11 2 + h 2 g 10 2 + h 3 g 00 2 + h 4 g 01 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiAaG2aaSbaaSqaaiabigdaXaqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGymaedabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabikdaYaqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabiodaZaqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGimaadabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabisda0aqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGymaedabaGaeGOmaidaaaaa@49EF@

(4,4), (5,5), (4,5)

h 1 g 10 2 + h 2 g 11 2 + h 3 g 01 2 + h 4 g 00 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemiAaG2aaSbaaSqaaiabigdaXaqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGimaadabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabikdaYaqabaGccqWGNbWzdaqhaaWcbaGaeGymaeJaeGymaedabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabiodaZaqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGymaedabaGaeGOmaidaaOGaey4kaSIaemiAaG2aaSbaaSqaaiabisda0aqabaGccqWGNbWzdaqhaaWcbaGaeGimaaJaeGimaadabaGaeGOmaidaaaaa@49EF@

(1,2), (1,7), (2,8), (7,8)

2((h₁+ h₂)g₀₀g₀₁+ (h₃+ h₄)g₁₀g₁₁)

(3,4), (3,5), (4,6), (5,6)

2((h₁+ h₂)g₁₀g₁₁+ (h₃+ h₄)g₀₀g₀₁)

(2,3), (2,6), (3,7), (6,7)

2((h₁+ h₄)g₀₁g₁₁+ (h₂+ h₃)g₀₀g₁₀)

(1,4), (1,5), (4,8), (5,8)

2((h₁+ h₄)g₀₀g₁₀+ (h₂+ h₃)g₀₁g₁₁)

(1,3), (1,6), (3,8), (6,8)

2((h₁+ h₃)g₀₀g₁₁+ (h₂+ h₄)g₀₁g₁₀)

(2,4), (2,5), (4,7), (5,7)

2((h₁+ h₃)g₀₁g₁₀+ (h₂+ h₄)g₀₀g₁₁)

Total

^a(i, j): see Table 2 for the explanation.

Simulation methods

We conduct two simulation studies to evaluate the performance and robustness of the proposed REM. In the simulations, we simulate two-offspring family data.

Comparing the REM and the unrestricted method

Let θ₀= (θ_AB, θ_BC, θ_AC) denote the true value of the recombination fraction. In genetics, loci A and B are said to be closely linked when 0 ≤ θ_AB≤ 0.1, moderately linked when 0.1 ≤ θ_AB≤ 0.2, and loosely linked when 0.2 ≤ θ_AB≤ 0.5. To show the advantage of the REM algorithm, we consider six scenarios according to the different combinations of linkage states of loci AB and loci BC: CC, CM, CL, MM, ML, and LL, where C, M, and L denotes close, moderate, and loose linkage, respectively. In each scenario, θ_ABand θ_BCare respectively taken as 0.05, 0.15, and 0.35 for close, moderate, and loose linkage. θ_ACis taken as three equally spaced values which all guarantee that (θ_AB, θ_BC, θ_AC) satisfies the natural restriction (2), and the smaller value and the larger one are near the boundary of the region composed by restriction (2), and the moderate one is inside the region. Since the triply homozygous parent only produces haplotype abc in triple backcross family, we can only consider the sampling from the heterozygous parent. For demonstrate purpose, we give the process of generating data for each θ₀in detail:

1. According to equal probability 1/4, We randomly assign a linkage phase of the heterozygous parent in one family.

2. Generate two haplotypes of two offspring from the heterozygous parent in the family according to the conditional probabilities given in Table 1. The haplotype pair (or the family) is easily classified into one of the four classes in Table 2.

3. Repeat step 1 and 2 for n = 300 times, then data {n_k} for n simulated families can be obtained.

In each scenario of our simulations, for each θ₀, we calculate θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@ and θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ by the unrestricted method and the REM, respectively. Repeating the whole process for M = 1000 times, we obtain the averages of θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@ and θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ over 1000 replicates by the two methods (see Table 4). As expected, the averages of θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ over 1000 replicates agree better with θ₀than the averages of θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@.

Table 4

The averages of estimates over 1000 replicates for 300 two-offspring families by unrestricted method and the REM

Parameters

REM

Unrestricted Method

Scenario^a

θ _AB

θ _BC

θ _AC

θ ^ A B R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaemOqaieabaGaemOuaifaaaaa@3112@

θ ^ B C R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemOuaifaaaaa@3116@

θ ^ A C R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemOuaifaaaaa@3114@

θ ^ A B U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaemOqaieabaGaemyvaufaaaaa@3118@

θ ^ B C U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemyvaufaaaaa@311C@

θ ^ A C U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemyvaufaaaaa@311A@

0.05

0.06

0.0495

0.0497

0.0604

0.0499

0.0501

0.0597

0.075

0.0498

0.0500

0.0751

0.0499

0.0500

0.0752

0.09

0.0500

0.0903

0.0496

0.0499

0.0903

0.05

0.15

0.16

0.0502

0.1486

0.1607

0.0502

0.1494

0.1602

0.175

0.0502

0.1495

0.1742

0.0502

0.1495

0.1745

0.19

0.0497

0.1508

0.1898

0.0497

0.1509

0.1906

0.05

0.35

0.36

0.0496

0.3531

0.3685

0.0496

0.3300

0.3711

0.375

0.0502

0.3532

0.3777

0.0502

0.3287

0.3837

0.39

0.0498

0.3534

0.3939

0.0499

0.3344

0.3990

0.15

0.16

0.1487

0.1489

0.1643

0.1504

0.1507

0.1611

0.225

0.1503

0.1500

0.2248

0.1503

0.1501

0.2252

0.29

0.1497

0.1508

0.2887

0.1498

0.1509

0.2923

0.15

0.35

0.36

0.1505

0.3494

0.3745

0.1505

0.3247

0.3737

0.425

0.1505

0.3533

0.4274

0.1507

0.3254

0.4310

0.49

0.1498

0.3481

0.4499

0.1503

0.3331

0.4535

0.35

0.36

0.3443

0.3470

0.3601

0.3573

0.3312

0.3675

0.425

0.3525

0.3517

0.4305

0.3582

0.3315

0.4272

0.49

0.3531

0.3524

0.4554

0.3582

0.3255

0.4505

^aScenario: six combinations of linkage states of loci AB and loci BC (C: close linkage; M: moderate linkage; L: loose linkage).

To better show the performance of the REM, we mainly use the following three measures of accuracy to compare θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@ and θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@:

1. The number, denoted by KK, for which the unrestricted methods give unreasonable estimates based on 1000 replicates.

2. The standard derivations (SDs) of the estimate θ^iR MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyAaKgabaGaemOuaifaaaaa@3055@; the ratio of SDs of two kinds of estimates being rSD=SD(θ^iU)/SD(θ^iR) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaeeOCaiNaee4uamLaeeiraqKaeyypa0Jaee4uamLaeeiraqKaeiikaGIafqiUdeNbaKaadaqhaaWcbaGaemyAaKgabaGaemyvaufaaOGaeiykaKIaei4la8Iaee4uamLaeeiraqKaeiikaGIafqiUdeNbaKaadaqhaaWcbaGaemyAaKgabaGaemOuaifaaOGaeiykaKcaaa@4252@, i = AB, BC, AC.

3. The mean absolute error (MAE) of the estimate θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@, where MAE=∑l=11000(|θ^ABlR−θAB|+|θ^BClR−θBC|+|θ^AClR−θAC|)/3000 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaeeyta0KaeeyqaeKaeeyrauKaeyypa0ZaaabCaeaacqGGOaakcqGG8baFiiGacuWF4oqCgaqcamaaDaaaleaacqWGbbqqcqWGcbGqcqWGSbaBaeaacqWGsbGuaaGccqGHsislcqWF4oqCdaWgaaWcbaGaemyqaeKaemOqaieabeaakiabcYha8jabgUcaRiabcYha8jqb=H7aXzaajaWaa0baaSqaaiabdkeacjabdoeadjabdYgaSbqaaiabdkfasbaakiabgkHiTiab=H7aXnaaBaaaleaacqWGcbGqcqWGdbWqaeqaaOGaeiiFaWNaey4kaSIaeiiFaWNaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qamKaemiBaWgabaGaemOuaifaaOGaeyOeI0Iae8hUde3aaSbaaSqaaiabdgeabjabdoeadbqabaGccqGG8baFcqGGPaqkcqGGVaWlcqaIZaWmcqaIWaamcqaIWaamcqaIWaamaSqaaiabdYgaSjabg2da9iabigdaXaqaaiabigdaXiabicdaWiabicdaWiabicdaWaqdcqGHris5aaaa@6D37@; the ratio of MAEs being rMAE = MAE(θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@)/MAE(θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@).

The comparisons of estimations of two-locus recombination fraction by the unrestricted method and the REM are listed in Table 5. In each scenario, the unrestricted method gives lots of unreasonable results, i.e., the estimates do not satisfy the natural restriction (2), whereas the estimates obtained by the proposed REM all satisfy the restriction. The number KK of unreasonable estimates is larger when the true value θ₀is near the boundary of the restriction region (2), which corresponds to the larger or smaller true values of θ_AC, and KK is somewhat smaller when θ₀is inside the region, which corresponds to the moderate values of θ_AC. In the former situation the resulting θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@ could be obtained in the whole parameter space but not in the restriction region (2). When θ₀is near the boundary of the restriction region (2), θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@ is liable to be near the boundary of the region and hence likely to lie outside the boundary. However the proposed method can guarantee that θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ must be inside the restriction region at any time.

Table 5

Comparison of estimation of two-locus recombination fraction for 300 two-offspring families by the unrestricted method and the REM

Parameters

rSD^b

Scenario^a

θ _AB

θ _BC

θ _AC

MAE^c

rMAE^d

KK ^e

0.05

0.06

0.0089

0.0088

0.0095

1.0606

1.0790

1.1170

0.0072

1.0434

220

0.075

0.0090

0.0092

0.0114

1.0029

1.0033

1.0187

0.0078

1.0043

0.09

0.0091

0.0093

0.0127

1.0020

1.0022

1.0274

0.0083

1.0062

0.05

0.15

0.16

0.0093

0.0180

0.0177

1.0007

1.0603

1.0560

0.0119

1.0223

183

0.175

0.0091

0.0182

0.0195

1.0007

1.0168

1.0562

0.0124

1.0140

0.19

0.0094

0.0183

0.0209

1.0012

1.0122

1.1352

0.0128

1.0299

197

0.05

0.35

0.36

0.0095

0.0463

0.0481

1.0008

4.2411

1.4711

0.0272

1.2941

502

0.375

0.0090

0.0464

0.0482

1.0009

4.2875

1.6143

0.0272

1.3343

487

0.39

0.0093

0.0445

0.0467

1.0006

3.8670

1.7417

0.0267

1.3462

518

0.15

0.16

0.0156

0.0168

1.2658

1.1893

1.2115

0.0131

1.0956

451

0.225

0.0181

0.0176

0.0239

1.0078

1.0080

1.0863

0.0159

1.0174

0.29

0.0174

0.0187

0.0261

1.0117

1.0098

1.6503

0.0166

1.1165

343

0.15

0.35

0.36

0.0177

0.0452

0.0514

1.0024

5.1260

1.4805

0.0298

1.3264

419

0.425

0.0179

0.0459

0.0504

1.0071

5.0395

1.5690

0.0311

1.3790

297

0.49

0.0179

0.0410

0.0584

1.0167

4.9795

1.3348

0.0303

1.2595

304

0.35

0.36

0.0390

0.0373

0.0454

2.0082

6.4504

1.5975

0.0319

1.4403

604

0.425

0.0454

0.0436

0.0498

1.4563

4.3277

1.5612

0.0378

1.2931

278

0.49

0.0460

0.0465

0.0577

1.3683

4.5456

1.4778

0.0375

1.3018

216

^aScenario: see Table 4 for the explanation;

^brSD=SD(θ^iU)/SD(θ^iR) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaeeOCaiNaee4uamLaeeiraqKaeyypa0Jaee4uamLaeeiraqKaeiikaGIafqiUdeNbaKaadaqhaaWcbaGaemyAaKgabaGaemyvaufaaOGaeiykaKIaei4la8Iaee4uamLaeeiraqKaeiikaGIafqiUdeNbaKaadaqhaaWcbaGaemyAaKgabaGaemOuaifaaOGaeiykaKcaaa@4252@, i = AB, BC, AC;

^cMAE=∑l=11000(|θ^ABlR−θAB|+|θ^BClR−θBC|+|θ^AClR−θAC|)/3000 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaeeyta0KaeeyqaeKaeeyrauKaeyypa0ZaaabCaeaacqGGOaakcqGG8baFiiGacuWF4oqCgaqcamaaDaaaleaacqWGbbqqcqWGcbGqcqWGSbaBaeaacqWGsbGuaaGccqGHsislcqWF4oqCdaWgaaWcbaGaemyqaeKaemOqaieabeaakiabcYha8jabgUcaRiabcYha8jqb=H7aXzaajaWaa0baaSqaaiabdkeacjabdoeadjabdYgaSbqaaiabdkfasbaakiabgkHiTiab=H7aXnaaBaaaleaacqWGcbGqcqWGdbWqaeqaaOGaeiiFaWNaey4kaSIaeiiFaWNaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qamKaemiBaWgabaGaemOuaifaaOGaeyOeI0Iae8hUde3aaSbaaSqaaiabdgeabjabdoeadbqabaGccqGG8baFcqGGPaqkcqGGVaWlcqaIZaWmcqaIWaamcqaIWaamcqaIWaamaSqaaiabdYgaSjabg2da9iabigdaXaqaaiabigdaXiabicdaWiabicdaWiabicdaWaqdcqGHris5aaaa@6D37@: the mean absolute error of θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@;

^drMAE = MAE(θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@)/MAE(θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@);

^eKK: number for which the unrestricted method gives unreasonable estimates based on all 1000 replicates.

It is clear to see that our REM outperforms the unrestricted method for estimating two-locus recombination fractions in each simulated scenario. The estimates obtained by the REM have smaller SDs than the unrestricted method, which is more obvious especially at least one of the intervals of AB and BC is loosely linked. This suggests that the accuracy of estimates by the REM is more higher than by the unrestricted method, and that the natural restriction (2) should be taken into account in estimating, otherwise it would have significant impact on the accuracy on practical inference. Compared to θ^U MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdwfavbaaaaa@2F00@, θ^R MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaahaaWcbeqaaiabdkfasbaaaaa@2EFA@ is closer to the true value θ₀(rMAE > 1 for all groups in Table 5).

It also can be seen that the proposed REM is a robust algorithm. The REM can still give better results than the unrestricted method in each scenario even when KK is small (e.g., 1).

Evaluating the effect of interference to estimates

Interference refers to the phenomenon that crossovers in nearby intervals along a chromosome do not occur independently. Let I denote the value of interference. According the definition of interference in Strickberger 21, we have I=1−g11θABθBC MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemysaKKaeyypa0JaeGymaeJaeyOeI0scfa4aaSaaaeaacqWGNbWzdaWgaaqaaiabigdaXiabigdaXaqabaaabaacciGae8hUde3aaSbaaeaacqWGbbqqcqWGcbGqaeqaaiab=H7aXnaaBaaabaGaemOqaiKaem4qameabeaaaaaaaa@3BAB@. To better evaluate the effect of interference to the two kinds of estimations, we consider three scenarios: positive, null and negative interferences. In each scenario, we choose equal θ_ACand different θ_ABand θ_BCcorresponding to different interference values (see Table 6). For each scenario, we also simulate 300-family data, and the REM and the unrestricted method are applied to the simulated data, respectively. The whole process is repeated for 1000 times to compute the measures of accuracy given previously. The simulation results listed in Table 6 firstly show that the values of KK are very large when there exists positive (or negative) interference, and the values are small when there is no interference, while the REM gives reasonable estimates at any time. That is to say the estimating results by the unrestricted method are much affected by the interference, but the results by our REM is less affected. Secondly, the less fluctuations of SD(θ^ACR MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemOuaifaaaaa@3114@) in scenario 1 (or 3) also validate that the REM is less affected by interference. Finally, the REM outperforms the unrestricted method in each scenario (rSD > 1, rMAE > 1), especially, when negative interference is present.

Table 6

Evaluation of the effect of interference to estimates of recombination fractions

Scenario

θ _AB

θ _BC

θ _AC

I ^a

SD(θ^ACR MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemOuaifaaaaa@3114@)

rSD ^b

MAE^c

rMAE^d

KK ^e

0.031

0.060

0.09

0.7312

0.0124

1.0484

0.0078

1.0128

475

0.035

0.056

0.09

0.7449

0.0124

1.0323

0.0080

1.0125

487

0.039

0.052

0.09

0.7535

0.0120

1.0250

0.0078

1.0128

472

0.081

0.1301

0.19

0.0205

1.0537

0.0131

1.0229

0.085

0.1265

0.19

0.0196

1.0765

0.0127

1.0315

0.089

0.1229

0.19

0.0198

1.0505

0.0127

1.0236

0.151

0.359

0.39

-0.1068

0.0553

1.1971

0.0327

1.3945

354

0.155

0.355

0.39

-0.0904

0.0549

1.2095

0.0321

1.2928

323

0.159

0.351

0.39

-0.0751

0.0552

1.2156

0.0324

1.3025

300

^aI: value of interference;

^brSD, ^cMAE, ^drMAE and ^eKK: see Table 5 for the explanations.

In addition, we find that the restricted EM estimate is little changed when different starting values are taken. These above results indicate that the use of the REM can yield better performance than the current unrestricted method.

A worked example

We applied our proposed method to a real data set from published literature 22. The data set comprised of 134 individuals from a backcross of mice. Here we consider the three ordinal marker loci D2Mit365, D2Mit272 and D2Mit456 on the linkage map of chromosome 2, and we still use A, B and C to denote the three loci. According to the genotypes given in the data set, we record a haplotype code of each individual, where the haplotype is from the heterozygous parent. Two individuals are randomly grouped into one family, and we consider they are really from that family, where the treatment will not affect linkage information, because all offspring's genotypes are independent conditional on the genotypes of all parents for the data. Then we obtain n = 67 two-offspring families, and n₁= 21, n₂= 17, n₃= 14 and n₄= 15 by the classification given in Table 2. We used the proposed REM and the unrestricted method to estimate the recombination fractions based on (n₁, n₂, n₃, n₄). The MLEs of the recombination fractions are θ^ABR MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaemOqaieabaGaemOuaifaaaaa@3112@ = 0.3166, θ^BCR MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemOuaifaaaaa@3116@ = 0.3738 and θ^ACR MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemOuaifaaaaa@3114@ = 0.3738; and θ^ABU MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaemOqaieabaGaemyvaufaaaaa@3118@ = 0.3167, θ^BCU MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemOqaiKaem4qameabaGaemyvaufaaaaa@311C@ = 0.3942 and θ^ACU MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGaf8hUdeNbaKaadaqhaaWcbaGaemyqaeKaem4qameabaGaemyvaufaaaaa@311A@ = 0.3634, respectively. Obviously, the unrestricted estimates do not satisfy the second one of the natural restriction (2), and thus estimates contradict with the true order of the three markers on the linkage map of chromosome 2 22. According to our simulation and practical experience, the accuracy of estimation by the REM will improve by increasing sample size or by using the unrestricted estimates as initial values.

Discussion

We developed a restricted EM algorithm to calculate numerically the MLEs of two-locus recombination fractions that initially studied by Ott 3. The method in Ott 3 may not always provide the parameter estimates satisfying the natural restriction (2), since the approach does not take the inequality restrictions into account. Our method can deal with this problem, and the real data were handled very well with the proposed method.

The performance of the REM is also illustrated using simulated data. Our simulation shows that the unrestricted method gives some unreasonable estimate results in each scenario, and thus such estimates may not provide correct interpretation of the recombination phenomenon in practice. The major advantage of the REM is its robustness and efficiency. The REM can give better results even when the number for which the unrestricted method gives unreasonable estimate results is small (e.g., KK = 1), and our estimates are more precise than those obtained by the unrestricted method. Moreover, the REM is less affected by interference, and the estimate of parameter g in M-step having the closed-form solution largely improves the computational efficiency of the parameter.

On the other hand, noticing the important fact that more offspring in each family can really provide more information in linkage analysis, we develops a strategy for estimating the two-locus recombination fractions when each observed family has more offspring, and the proposed REM algorithm works as a unified method. In practice, the method developed by Lu et al. 10 can be first adopted to obtain the estimates of probabilities h_i's of linkage phases when considering multiple offspring, then the REM is used to obtain the restricted MLEs of recombination fractions, which may improve the estimation precision. It is helpful to construct and analyze a linkage map using this kind of family data.

Recent research in genetics has shown that statistical inference about the two-locus recombination fraction offers an effective approach for constructing and analyzing a linkage map between the genetic marker and the genetic disorders. Reasonable estimates of the recombination fractions are important in gene mapping, especially in interval mapping 23242526. Only the reasonable estimate result may identify the actual genes responsible for some trait, and it is feasible to embed the REM into interval mapping to improve the efficiency of mapping.

It is noticed that our analysis is focused on three biallelic loci. The above constrained parameter problem may become complicated if the number of loci is more than three, or some markers may have more alleles than others, for example, in outcrossing plant species. When the number of loci is more than three, we suggest that every three adjacent loci are subject to three-point analysis. We can obtain two different estimates of the recombination fraction for the same marker interval, and a better way to combine these estimates is to take a weighted mean. More alleles for each markers mean more possible linkage phases 10, which bring some difficulty to linkage analysis, however, the idea of considering the natural restriction (2) on recombination fractions should also be emphasized. Further investigation in this area is warranted.

Appendix

The Kuhn-Tucker Theorem 1920

Suppose that θ* is a solution of

Max f(θ) subject to f₁(θ) ≥ 0,⋯, f_m(θ) ≥ 0,

where f, f₁,⋯, f_m: R^N→ R are C¹functions. Then the following conditions hold:

(1) ∂∂θif(θ∗)+∑j=1mλj∂θifj(θ∗)=0 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaqcfa4aaSaaaeaacqGHciITaeaacqGHciITiiGacqWF4oqCdaWgaaqaaiabdMgaPbqabaaaaOGaemOzayMaeiikaGIae8hUde3aaWbaaSqabeaacqGHxiIkaaGccqGGPaqkcqGHRaWkdaaeWbqaaiab=T7aSnaaBaaaleaacqWGQbGAaeqaaKqbaoaalaaabaGaeyOaIylabaGae8hUde3aaSbaaeaacqWGPbqAaeqaaaaaaSqaaiabdQgaQjabg2da9iabigdaXaqaaiabd2gaTbqdcqGHris5aOGaemOzay2aaSbaaSqaaiabdQgaQbqabaGccqGGOaakcqWF4oqCdaahaaWcbeqaaiabgEHiQaaakiabcMcaPiabg2da9iabicdaWaaa@5210@, i = 1,⋯, N;

(2) λ_jf_j(θ*) = 0, j = 1,⋯, m;

(3) f_j(θ*) ≥ 0, j = 1,⋯, m;

(4) λ_j≥ 0, j = 1,⋯, m,

where (λ₁,⋯, λ_m) are Lagrangian multipliers. The four conditions are called Kuhn-Tucker conditions. Specially, if f(θ) is strictly concave and the set {θ: f₁(θ) ≥ 0,⋯, f_m(θ) ≥ 0} is convex, the Kuhn-Tucker conditions are also sufficient, and the solution θ* is unique.

Solving equation (5) when g˜(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacbeGaf83zaCMbaGaadaahaaWcbeqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaaaaa@325F@ does not satisfy restriction (3)

Because Q(g|g^(s), {n_k}) is a strictly concave function and the restriction region (3) is a convex set, there must be a unique solution ̌g(s+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWeuvgwd1KuV1wyUbqegmwBYfdmaGabbiadaciKaaaa=XWa3Iqabiab+DgaNnaaCaaaleqabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaaaa@3AAA@ to equation (5) by the Kuhn-Tucker Theorem. The Lagrangian is

L(g, λ) = Q(g|g^(s), {n_k}) + λ₁(g₀₁- g₁₁) + λ₂(g₁₀- g₁₁) + λ₃g₁₁+ λ₄(1/2 - g₀₁- g₁₀),

where λ = (λ₁, λ₂, λ₃, λ₄), and λ_i's are Lagrangian multipliers. Then ̌g(s+1)=(̌g10(s+1),̌g01(s+1),̌g11(s+1)) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWeuvgwd1KuV1wyUbqegmwBYfdmaGabbiadaciKaaaa=XWa3Iqabiab+DgaNnaaCaaaleqabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeyypa0JaeiikaGcceaGamaiGqca9=3hddCRaem4zaC2aa0baaSqaaiabigdaXiabicdaWaqaaiabcIcaOiabdohaZjabgUcaRiabigdaXiabcMcaPaaakiabcYcaSiadaciNaq==9XWa3kabdEgaNnaaDaaaleaacqaIWaamcqaIXaqmaeaacqGGOaakcqWGZbWCcqGHRaWkcqaIXaqmcqGGPaqkaaGccqGGSaalcWaGacja0=FFmmWTcqWGNbWzdaqhaaWcbaGaeGymaeJaeGymaedabaGaeiikaGIaem4CamNaey4kaSIaeGymaeJaeiykaKcaaOGaeiykaKcaaa@66DF@ is a unique solution to

{ − a 1 ( s ) g 00 + a 3 ( s ) g 10 + λ 2 − λ 4 = 0 , − a 1 ( s ) g 00 + a 2 ( s ) g 01 + λ 1 − λ 4 = 0 , − a 1 ( s ) g 00 + a 4 ( s ) g 11 − λ 1 − λ 2 + λ 3 = 0 , λ 1 ( g 01 − g 11 ) = 0 , λ 2 ( g 10 − g 11 ) = 0 , λ 3 g 11 = 0 , λ 4 ( 1 / 2 − g 01 − g 10 ) = 0 , g 01 ≥ g 11 , g 10 ≥ g 11 , g 11 ≥ 0 , 1 / 2 ≥ g 01 + g 10 , λ i ≥ 0 , i = 1 , 2 , 3 , 4. MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaWaaiqabeaafaqaaeadbaaaaaaabaGaeyOeI0scfa4aaSaaaeaacqWGHbqydaqhaaqaaiabigdaXaqaaiabcIcaOiabdohaZjabcMcaPaaaaeaacqWGNbWzdaWgaaqaaiabicdaWiabicdaWaqabaaaaOGaey4kaSscfa4aaSaaaeaacqWGHbqydaqhaaqaaiabiodaZaqaaiabcIcaOiabdohaZjabcMcaPaaaaeaacqWGNbWzdaWgaaqaaiabigdaXiabicdaWaqabaaaaOGaey4kaSccciGae83UdW2aaSbaaSqaaiabikdaYaqabaGccqGHsislcqWF7oaBdaWgaaWcbaGaeGinaqdabeaakiabg2da9iabicdaWiabcYcaSaqaaiabgkHiTKqbaoaalaaabaGaemyyae2aa0baaeaacqaIXaqmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaabaGaem4zaC2aaSbaaeaacqaIWaamcqaIWaamaeqaaaaakiabgUcaRKqbaoaalaaabaGaemyyae2aa0baaeaacqaIYaGmaeaacqGGOaakcqWGZbWCcqGGPaqkaaaabaGaem4zaC2aaSbaaeaacqaIWaamcqaIXaqmaeqaaaaakiabgUcaRiab=T7aSnaaBaaaleaacqaIXaqmaeqaaOGaeyOeI0Iae83UdW2aaSbaaSqaaiabisda0aqabaGccqGH9aqpcqaIWaamcqGGSaalaeaacqGHsisljuaGdaWcaaqaaiabdggaHnaaDaaabaGaeGymaedabaGaeiikaGIaem4CamNaeiykaKcaaaqaaiabdEgaNnaaBaaabaGaeGimaaJaeGimaadabeaaaaGccqGHRaWkjuaGdaWcaaqaaiabdggaHnaaDaaabaGaeGinaqdabaGaeiikaGIaem4CamNaeiykaKcaaaqaaiabdEgaNnaaBaaabaGaeGymaeJaeGymaedabeaaaaGccqGHsislcqWF7oaBdaWgaaWcbaGaeGymaedabeaakiabgkHiTiab=T7aSnaaBaaaleaacqaIYaGmaeqaaOGaey4kaSIae83UdW2aaSbaaSqaaiabiodaZaqabaGccqGH9aqpcqaIWaamcqGGSaalaeaacqWF7oaBdaWgaaWcbaGaeGymaedabeaakiabcIcaOiabdEgaNnaaBaaaleaacqaIWaamcqaIXaqmaeqaaOGaeyOeI0Iaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGGPaqkcqGH9aqpcqaIWaamcqGGSaalaeaacqWF7oaBdaWgaaWcbaGaeGOmaidabeaakiabcIcaOiabdEgaNnaaBaaaleaacqaIXaqmcqaIWaamaeqaaOGaeyOeI0Iaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGGPaqkcqGH9aqpcqaIWaamcqGGSaalaeaacqWF7oaBdaWgaaWcbaGaeG4mamdabeaakiabdEgaNnaaBaaaleaacqaIXaqmcqaIXaqmaeqaaOGaeyypa0JaeGimaaJaeiilaWcabaGae83UdW2aaSbaaSqaaiabisda0aqabaGccqGGOaakcqaIXaqmcqGGVaWlcqaIYaGmcqGHsislcqWGNbWzdaWgaaWcbaGaeGimaaJaeGymaedabeaakiabgkHiTiabdEgaNnaaBaaaleaacqaIXaqmcqaIWaamaeqaaOGaeiykaKIaeyypa0JaeGimaaJaeiilaWcabaGaem4zaC2aaSbaaSqaaiabicdaWiabigdaXaqabaGccqGHLjYScqWGNbWzdaWgaaWcbaGaeGymaeJaeGymaedabeaakiabcYcaSaqaaiabdEgaNnaaBaaaleaacqaIXaqmcqaIWaamaeqaaOGaeyyzImRaem4zaC2aaSbaaSqaaiabigdaXiabigdaXaqabaGccqGGSaalaeaacqWGNbWzdaWgaaWcbaGaeGymaeJaeGymaedabeaakiabgwMiZkabicdaWiabcYcaSaqaaiabigdaXiabc+caViabikdaYiabgwMiZkabdEgaNnaaBaaaleaacqaIWaamcqaIXaqmaeqaaOGaey4kaSIaem4zaC2aaSbaaSqaaiabigdaXiabicdaWaqabaGccqGGSaalaeaacqWF7oaBdaWgaaWcbaGaemyAaKgabeaakiabgwMiZkabicdaWiabcYcaSiabdMgaPjabg2da9iabigdaXiabcYcaSiabikdaYiabcYcaSiabiodaZiabcYcaSiabisda0iabc6caUaaaaiaawUhaaaaa@005F@

To solve the above equations, we need to consider all possible cases for λ_i= 0 or λ_i> 0, i = 1, 2, 3, 4. There are totally seven possible solutions for the above equations which were just given in the previous REM algorithm.

Authors' contributions

YZ derived the genetic and statistical model and wrote computer programs. NZS and WKF provided insightful comments to the presentation. JG conceived of ideas and algorithm. All authors read and approved the final manuscript.

Acknowledgements

The authors would like to thank Dr. Wen-Sheng Zhu for helpful discussions and comments on a draft of the paper. This research was supported by the National Natural Science Foundation of China (Grant Numbers 10431010 and 10701022), National 973 Key Project of China (2007CB311002), NCET-04-0310, the Jilin Distinguished Young Scholars Program (Grant Number 20030113) and the Program Innovative Research Team (PCSIRT) in University (#IRT0519).

A general model for the analysis of pedigree data Elston RC Stewart J Hum Hered 1971 21 523 542 5149961 Linkage strategies for genetically complex traits Risch N Am J Hum Genet 1990 46 222 253 1684987 2301392 Phase-Unkown Triple Backcross with Two Offspring Ott J Analysis of Human Genetic Linkage The Johns Hopkins University Press: Baltimore 3 1999 122 124 Thompson EA Statistical Inference from Genetic Data on Pedigree Institute of Mathematical Statistics Beachwood: Ohio 2000 The recombination of linkage values and the calculation of distances between the loci of linked factors Haldane JBS J Genet 1919 8 299 309 The Theory of Genes Morgan TH Yale University Press: New Haven 1928 A mathematically tractable family of genetic mapping functions with different amounts of interference Felsenstein J Genetics 1979 91 769 775 1216865 17248911 Information gain in joint linkage analysis Thompson EA IMA J Math Appl Med Biol 1984 1 31 49 10.1093/imammb/1.1.31 6600091 Simultaneous maximum likelihood estimation of linkage and linkage phases in outcrossing populations Wu RL Ma CX Painter I Zeng ZB Theor Pop Biol 2002 61 349 363 10.1006/tpbi.2002.1577 A multilocus likelihood approach to joint modelling of linkage, parnet diplotype and gene order in a full-sib family Lu Q Cui YH Wu RL BMC Genet 2004 5 20 509239 15274749 10.1186/1471-2156-5-20 Wu RL Ma CX Casella G Statistical Genetics of Quantitative Traits: Linkage, Maps, and QTL Springer: New York 2007 Strategies for multilocus linkage analysis in humans Lathrop GM Lalouel JM Julier C Ott J Proc Natl Acad Sci USA 1984 81 3443 3446 345524 6587361 10.1073/pnas.81.11.3443 Multilocus linkage analysis in humans: Detection of linkage and estimation of recombination Lathrop GM Am J Hum Genet 1985 37 482 498 1684598 3859205 An algorithm for restricted least squares regression Dykstra RL J Am Statist Assoc 1983 78 837 842 10.2307/2288193 Robertson T Wright FT Dykstra R Order Restricted Statistical Inference Wiley: New York 1988 Estimation of discrete distribution with a class of simplex constraints Liu C J Am Stat Assoc 2000 95 109 120 10.2307/2669531 The restricted EM algorithm under inequality restrictions on the parameters Shi NZ Zheng SR Guo JH J Multivariate Anal 2005 92 53 76 10.1016/S0047-259X(03)00134-9 Maximum likelihood from incomplete data via the EM algorithm (with discussion) Dempster AP Laird NM Rubin DB J Roy Stat Soc B 1977 39 1 38 Mokhtar SB Shetty CM Nonlinear Programming: Theory and Algorithms John Wiley and Sons: New York 1979 Anthony LP Francis ES Uhl JJ Jr The Mathematics of Nonlinear Programming Springer-Verlag: New York 1992 Strickberger MW Genetics MacMillan: New York third 1985 Genetic control of susceptibility to UV-induced immunosuppression by interacting quantitative trait loci Clemens KE Churchill G Bhatt N Richardson K Noonan FP Genes and Immunity 2000 1 251 259 10.1038/sj.gene.6363667 Mapping Mendelian factors underlying quantitative traits using RFLP linkage maps Lander ES Botstein D Genetics 1989 121 185 199 1203601 2563713 High resolution of quantitative trait into multiple loci via interval mapping Jansen RC Stam P Genetics 1994 136 1447 1455 1205923 8013917 Multiple interval mapping for quantitative trait loci Kao CH Zeng ZB Teasdale RD Genetics 1999 152 1203 1216 1460657 10388834 The full EM algorithm for the MLEs of QTL effects and positions and their estimated variance in multiple-interval mapping Chen Z Biometrics 2005 61 474 480 10.1111/j.1541-0420.2005.00327.x 16011694