Abstract
Background
The Red Queen Hypothesis (RQH) suggests that the coevolutionary dynamics of hostparasite systems can generate selection for increased host recombination. Since hostparasite interactions often have a strong genetic basis, recombination between different hosts can increase the fraction of novel and potentially resistant offspring genotypes. A prerequisite for this mechanism is that hostparasite interactions generate persistent oscillations of linkage disequilibria (LD).
Results
We use deterministic and stochastic models to investigate the persistence of LD oscillations and its impact on the RQH. The standard models of the Red Queen dynamics exhibit persistent LD oscillations under most circumstances. Here, we show that altering the standard model from discrete to continuous time or from simultaneous to sequential updating results in damped LD oscillations. This suggests that LD oscillations are structurally not robust. We then show that in a stochastic regime, drift can counteract this dampening and maintain the oscillations. In addition, we show that the amplitude of the oscillations and therefore the strength of the resulting selection for or against recombination are inversely proportional to the size of the (host) population.
Conclusion
We find that host parasiteinteractions cannot generally maintain oscillations in the absence of drift. As a consequence, the RQH can strongly depend on population size and should therefore not be interpreted as a purely deterministic hypothesis.
Background
There is almost no species that is not attacked by parasites. From an evolutionary perspective, hostparasite interactions are of fundamental importance, because these interactions can have very strong fitness effects on both hosts and parasites. For any given species, it is hard to imagine a change of environment that is as fast, as consistent and as profound as that constituted by its coevolving parasite (or host) species. A particularly intriguing and much debated aspect of hostparasite coevolution is the socalled Red Queen Hypothesis (RQH) [1]. In a nutshell, the RQH states that the antagonistic coevolution between host and parasite leads to cyclical dynamics, also called Red Queen dynamics (RQD), which favor genetic shuffling [24]: The host continuously tries to escape the parasite which in turn responds to each adaptation with the corresponding counteradaptation. In this arms race, recombination may offer the host the opportunity to generate novel, and therefore potentially resistant, offspring more quickly.
The only genetic effect of shuffling (through sex or recombination) is to reduce linkage disequilibria (LD), i.e. statistical associations between alleles at different loci in the genome. Thus, any theory that attempts to identify an evolutionary advantage of genetic shuffling must be based on a beneficial effect of reducing linkage disequilibria. In the context of the RQH, the benefit of genetic shuffling is associated with breaking up linkage disequilibria in the host population that are generated by selection pressures imposed by the coevolving parasite population. Specifically, a prerequisite for the RQH is that the hostparasite interaction generates persistent LD oscillations. If these LD oscillations would wane over time, then selection for recombination/sex can at best be transient. Indeed, standard models of the RQH [57] do show persistent LD oscillations. However, given that oscillations are often structurally not robust (structural robustness refers to whether the behavior of a system is robust to minor modifications of the form of the underlying equations), it is surprising that the question of robustness has been largely ignored in the context of the RQH.
Here, we investigate one of the standard models for the RQH [5], a discrete time model that uses a specific updating scheme where host and parasite frequencies are updated simultaneously. We then investigate two slightly modified models: (i) a continuoustime version of the standard model (referred to from here on as the continuoustime model), and (ii) a discretetime version with a different updating scheme (referred to from here on as the sequentialupdating model). While the standard model [5] includes most interaction types that have previously been studied (e.g. the matching allele [6,7] and the geneforgene interaction type [8,9]), we restrict our discussion to the matchingallele type (i.e. where the fitness of host and parasite depends only on the number of matched alleles) and neglect the (plantspecific) geneforgene type [8,9] which is generally known to exhibit selection against sex/recombination. In the first part of our analysis, we focus on the classical matchingallele type (considered in [57]) and then extend our scope to more general types of interaction [10].
Interestingly, we find that the proposed modifications of the standard model lead to a strong dampening of LD oscillations, which is driven by recombination and mutation. In addition, we find that even in the standard model, dampening occurs under some circumstances. These observations suggest that LD oscillations in the Red Queen are structurally not robust. If hostparasite interactions could maintain LD oscillations only transiently, the plausibility of the RQH would be severely undercut.
To investigate what factors could contribute to the persistence of LD oscillations we study here the effect of finite population size. In particular, we study the dynamic behavior of stochastic versions of both the standard simultaneousupdating model and of the alternative sequentialupdating model. We have chosen to consider the sequentialupdating model as a representative of the alternative models because it can be conveniently transformed into a stochastic model. We find that in the alternative model, drift indeed helps to maintain LD oscillations, and as a consequence, population size can strongly affect selection for recombination or sex. This contrasts the situation in the standard model where the effects of drift are much less pronounced and restricted to weak selection coefficients. Finally, we consider the evolution of sex/recombination in a broader set of interaction types (including the matchingallele type) and show that our results hold for the majority of these interaction types.
Results
The structural robustness of LD oscillations in deterministic models
A peculiar and hitherto unnoticed consequence of deterministic modeling of hostparasite coevolution is that the amplitude of the resulting linkage disequilibrium (LD) oscillations may decrease over time and eventually reach negligibly small values. LD oscillations can be damped in all three models (see Figure 1 for typical simulation runs). The dampening is a general phenomenon in the two alternative models, but in the standard model, it is only observed when selection coefficients are small (approximately s_{H }and s_{P}<0.4; see section "Methods"). Moreover, for weak selection, the type of LD oscillations in the standard model depends on the initial conditions: either the oscillations are weak but stable, or the oscillations are damped. For random initial allele frequencies, both scenarios seem to occur with similar frequency.
Figure 1. Typical simulation run in the deterministic versions of the standard model (a), the sequentialupdating model (b), and the continuoustime model (c). The variable t represents the number of host generations. The figures show the LD oscillations during 10000 host generations. The following parameters were used: r_{mm }= 0.1, s_{H }= s_{P }= 0.05.
Previous analyses of the standard model [57] did not report any dampening. The dampening of the LD oscillations may have gone unnoticed for several reasons. First, for very weak selection, the dampening is particularly slow. Second, in the standard model (but not in the alternative models), only the LD oscillations are damped while the genotypefrequencies remain oscillating with a stable amplitude (results not shown). Third, the dampening does not occur for strong selection, even if selection is strong only for the parasite (this is the parameter range analyzed in [6,7]). Overall, our simulations show that stability of LD oscillations is not a generic feature of the standard model, unless selection is strong on the parasite.
The sequential updating model exhibits substantial dampening of the LD oscillations for various recombination rates, mutation rates and selection coefficients ranging over several orders of magnitude (see supplementary table S1; all supplementary figures and tables can be found in the Additional file 1). Moreover, the rate of the dampening depends on both the mutation rate and the recombination rate (see supplementary table S1, Additional file 1), with high mutation and recombination rates causing faster decay. The continuoustime model shows a qualitatively similar behavior (results not shown). These patterns suggest that for the alternative models, the antagonistic interactions between hosts and parasites alone are not able to maintain genotype and LD oscillations against the dampening forces of mutation and recombination. Taken together, these results suggest that stable LD oscillations are not a robust feature of RQ dynamics.
Additional file 1. Supplementary material. Contains the supplementary tables and figures that are mentioned in this article.
Format: PDF Size: 810KB Download file
This file can be viewed with: Adobe Acrobat Reader
Testing the impact of stochasticity
In order to analyze the effects of (finite) population size on the RQH, we developed stochastic versions of our models (for the sake of simplicity we considered stochastic effects only for the host populations). This is straightforward for the discretetime models (see section "Methods"), but more cumbersome for continuous time models. We therefore focus on the two discretetime models: The standard model illustrates the role of stochasticity for systems in which oscillations can be maintained deterministically, and the alternative (sequentialupdating) model illustrates its role for systems in which oscillations are damped deterministically.
Stochasticity can help to maintain the LD oscillations
In the stochastic regime, LD oscillations can be maintained indefinitely even in the alternative model (Figure 2). This result holds for a wide range of mutation rates, recombination rates, and population sizes (see supplementary table S1, Additional file 1). Of special interest is the impact of population size on the LD amplitude that can be maintained at steady state (shown in Figure 3 for both the standard and the alternative model). In the standard model, stochasticity increases the amplitudes of LD oscillations only for small selection coefficients, i.e. for those parameter values where damped oscillations occur in the deterministic model. In the alternative model, on the other hand, the amplitudes of LD oscillations increase with decreasing population size independent of selection coefficients. In particular, the amplitudes of LD oscillations tend to negligibly small values as population size grows to very large values (i.e. as the system approaches the deterministic range). Thus, while mutation and recombination can dampen the LD oscillations, finite population size counters this process.
Figure 2. Typical simulation run in the stochastic version (N = 10 000) of the sequentialupdating model. The variable t represents host generations. The main figure shows the LD oscillations from the start, the inset shows the dynamics of the LD oscillations later during the simulation (t = 100 000). The following parameters were used: r_{mm }= 0.1, s_{H }= s_{P }= 0.05.
Figure 3. The effect of population size N on the amplitude of LD oscillations in the standard model (a) and in the sequentialupdating model (b). The amplitude of the LD oscillations is measured as the maximum difference of linkage disequilibrium (ΔLD) between t = 10 000 and t = 20 000. The following parameter was used: r_{mm }= 0.1.
Consequences for the evolution of recombination
How does the dampening of the LD oscillations affect the evolution of sex and recombination? The mechanism underlying the RQH requires fluctuations of LD and epistasis (note that epistasis in hosts reflects LD in parasites and vice versa), which in turn strongly depend on population size (Figure 3). Thus, an effect of population size on the evolution of recombination seems evident.
To analyze this effect, we distinguish between two cases: (i) the competition between a sexual and a completely asexual type and (ii) the competition between two sexual types with different recombination rates. Both cases can be considered with the same model (and are in fact just two cases among a continuum of scenarios given by different recombination rates between the selected loci and between the modifier and the selected loci) but correspond to two different biological scenarios: The first case describes the replacement of a sexual by an asexual population. The second case describes the successive change of recombination rate. Several studies [57] have shown that the RQH depends crucially on the linkage between the modifier and the genes involved in hostparasite interactions. In particular, selection for higher recombination rates is generally more favored when linkage is tight. In the competition between sexual and asexual types, recombination occurs only between sexuals (because the asexuals reproduce clonally). Therefore, the modifier responsible for asexuality never switches its genetic background, i.e. it is tightly linked to the rest of the genome. Thus, the requirements that need to be met for the RQD to favor sexual over asexual types are less stringent than those that need to be met to favor high over low recombination rates, since in the latter case, the modifier can recombine away from the genotypic combinations that it produces (note, however, that the conditions are less stringent only if there is no or very little cost to sex). We model the competition between sexuals and asexuals by setting the recombination rates r_{mm }and r_{mM }to 0, and r_{MM}> 0 (see section "Methods") and the competition between modifiers coding for low and high recombination rate by choosing recombination rates 0 <r_{mm }<r_{mM }< r_{MM.}. Note that the modifier is selectively neutral, i.e. costs of sex are not included in our simulations.
Figure 4 shows the impact of population size on the evolution of recombination for both the standard model (panels a and b) and for the alternative model (panel c and d). Notice that we measure the selection on the modifier between generations 1000 and 2000 (see section methods). Thus, although the LD oscillations (and with them the selection on the modifier) vanish eventually in the cases with damped oscillations, they are still present (although very weakly) when we track the modifier. In the standard model, drift increases the strength of selection on the modifier if selection on the interaction loci is weak but decreases the strength of selection on the modifier when selection on the interaction loci is strong. In the first region, damped LD oscillations occur and drift considerably increases the amplitude of the oscillations, whereas the LD oscillations are always stable in the second region and drift affects the amplitude only marginally (see also Figure 3). This pattern suggests that drift increases the strength of selection on the modifier if it increases the amplitude of the LD oscillations, but rather decreases this selection if it does not affect the LD oscillations. In accordance with this interpretation, drift always increases the strength of selection on the modifier in the alternative model (in which LD oscillations are always damped), i.e. the strength of selection on the modifier strongly increases with decreasing population size.
Figure 4. Selective advantage of sexual over asexual reproduction (r_{mm }= 0, r_{mM }= 0, r_{MM }= 0.1) (a,c) and of high over low recombination (b,d) in both the standard model (a,b) and the sequentialupdating model (c,d), plotted for different selection coefficients (s) and different population sizes. The yaxis corresponds to the selection on the modifier (of sex/recombination), which is measured as the frequency change during a simulation run (i.e. 1000 host generations after introduction of the modifier allele M), averaged over 10000 simulation runs (100 for the deterministic model) with different random initial conditions.
The impact of the interaction type
The preceding discussion was based on the matching allele interaction type. In order to investigate the impact of the interaction type, we measured the selection on a recombination/sex modifier for the generalized matching allele interaction type (see section "Methods") with selection coefficients s_{1 }and s_{2 }ranging from 0 to 1 with a gradation of 0.01 (i.e. for 10^{4 }different interaction matrices). The results are summarized in Figures 5, 6, 7, 8. Figures 5 (selection for/against sex) and 6 (selection for lower/higher recombination) correspond to the standard model and Figures 7 and 8 to the alternative model. These figures show that for most interaction types, the impact of population size is qualitatively the same as for the matching allele interaction type: In the standard model, drift only increases the strength of selection on the modifier when s_{1 }and s_{2 }are small. In the alternative model, however, drift increases the strength of selection for the whole range of s_{1 }and s_{2}. The only exception to this pattern can be found in the in the vicinity of the MMA (i.e when the number of matched loci determines the fitness in an approximately multiplicative way). In this region, we observe a strong selection against sex/recombination even in the deterministic regime. The figures show that with decreasing population size this region (where selection against recombination is strong) shrinks and the strength of selection against sex/recombination decreases. The reason for this effect is that systems with an (almost) multiplicative fitness function exhibit a different dynamic behavior than those with stronger interactions: Instead of periodic alternations of positive and negative LD, the system converges to a state in which the LD does not change its sign anymore (see discussion). Other than this effect around the MMA, finite population size does not have any appreciable effect on the direction of selection on the modifier: Independently of population size, sex wins against asex for the vast majority of interaction types (in both the standard and alternative model), and high recombination wins against low recombination only if the selection coefficients are strong enough.
Figure 5. Selective advantage of sexual over asexual reproduction (r_{mm }= 0, r_{mM }= 0, r_{MM }= 0.1) in the standard model for different interaction matrices, simulated deterministically (a) and stochastically with populations sizes N = 1000 (b), N = 10 000 (c), and N = 100 000 (d). The color of each of the points on a graph shows the frequency change during a simulation run (i.e. 1000 host generations after introduction of the modifier allele M), averaged over 10000 simulation runs (100 for the deterministic model) with different random initial conditions. The number of host alleles, n, matched by the parasite determines the corresponding fitness w_{n }in the following way: for hosts, w_{2 }= 1s_{2}, w_{1 }= 1  s_{1}, w_{0 }= 1, for parasites w_{2 }= 1, w_{1 }= (1  s_{2})/(1  s_{1}), w_{0 }= 1  s_{2}. This generalized model reflects the biological characteristic that host and parasite fitness are inversely correlated. The matrix can be continually varied as a function of the parameters s_{1 }and s_{2}, and contains the MA and the MMA as special cases (MA: s_{1 }= 0; MMA, s_{2 }= 1(1s_{1})^{2}, yellow dashed line). Only fitness matrices with s_{1 }≦ s_{2 }are shown. The parameters s_{1 }and s_{2 }range from 0 to 1 with 0.01 gradation.
Figure 6. Selective advantage of a modifier increasing the recombination rate in the standard model(r_{mm }= 0.1, r_{mM }= 0.15, r_{MM }= 0.2), for the deterministic regime (a) and for the stochastic regime with population size N = 1000 (b), N = 10 000 (c), and N = 100 000 (d). For further details see legend of figure 5.
Figure 7. Selective advantage of sexual over asexual reproduction (r_{mm }= 0, r_{mM }= 0, r_{MM }= 0.1) in the sequentialupdating model for different interaction matrices, simulated deterministically (a) and stochastically with populations sizes N = 1000 (b), N = 10 000 (c), and N = 100 000 (d). For further details see legend of figure 5.
Figure 8. Selective advantage of a modifier increasing the recombination rate in the sequentialupdating model (r_{mm }= 0.1, r_{mM }= 0.15, r_{MM }= 0.2), for the deterministic regime (a) and for the stochastic regime with population size N = 1000 (b), N = 10 000 (c), and N = 100 000 (d). For further details see legend of figure 5.
Discussion
Our results show that damped LD oscillations are the rule for the sequentialupdating and the continuoustime model. In the standard model however, damped LD oscillations occur rarely (i.e. only when selection is weak). Moreover, persistent oscillations have also been observed in a model with interaction types different from the ones used here [11,12]. Thus, the dampening of the LD oscillations depends on the specific implementation of the hostparasite interaction. This raises the question whether damped or persistent oscillations are the generic case. Which of the models investigated here is most applicable to any particular hostparasite interaction strongly depends on the corresponding biology. The sequentialupdating model, for example, describes a situation in which the parasite population can first adapt to the host population for a few generations, and only subsequently affects host fitness. This pattern might be realized if at the start of every hostgeneration, the parasite population is small (and hence exerts only a negligible selection on the hostpopulation) and later, after a number of parasite generations, reaches an appreciable size (and thus exerts appreciable selection on the host after it has adapted to the host population). The standard model assumes that the fitnesseffect of a hostparasite interaction affects host and parasites simultaneously. Which scenario is more plausible is, in our view, debatable. More important, however, is the fact that oscillations are also damped in the continuous time model (in which updating is by definition simultaneous), suggesting that (i) the dampening is not an artifact that is particular only to the sequential updating model and (ii) that the dampening cannot be attributed exclusively to sequential versus simultaneous updating. The difference in the dynamical behavior of the standard model and the continuoustime model is in line with the general observation that discretetime models tend to show more oscillatory behavior [13]. Continuoustime models are commonly considered more appropriate when reproduction is not fully synchronous. Finally, the view that persistent LD oscillations are structurally not robust is further supported by the fact that even the standard model exhibits dampedoscillations when selection is weak.
The observation that the persistence of LD oscillations may not be structurally robust places a larger emphasis on the possible role of stochastic effects in the context of the RQH. If oscillations are persistent in the deterministic model, then drift is not required to maintain considerable oscillations and population size only has a modest impact (Figure 4). If, however, the oscillations are damped in the deterministic model, then drift is a necessary requirement for persistent RQ dynamics and the strength of the selection for recombination depends crucially on the population size. In this latter case, the RQH should be considered as an essentially stochastic hypothesis, in contrast to the traditional view which classifies it as deterministic [14].
In the alternative model (and in the standard model with small selection), we generally observe stronger selection on modifiers of sex and recombination in small populations. This could be explained by two main mechanisms. The first mechanism is based on the observation that the amplitude of the LD and epistasis oscillations depend strongly on the population size (see Figure 3), reaching the largest values for small populations. This explains the strong selection in small populations (because the effect of recombination directly reflects the strength of LD). Alternatively, the impact of population size could merely reflect a superposition of the RQH (as described in the deterministic model) and the wellknown FisherMuller effect, which states that in finite population under directional selection, recombination can increase the response to selection [15]. However, we found that if the corresponding deterministic model exhibits persistent oscillations, decreasing population size does not increase the strength of selection on the modifier (e.g. in the standard model with strong selection; see Figure 4). This speaks against the FisherMuller effect but is in line with the expectation based on the first mechanism. We therefore think that the first mechanism is more plausible, although it is conceivable that the FisherMuller effect also contributes to selection on the recombination modifier.
On first thought, the observation that sex/recombination is strongly selected against for interaction types close to the MMA seems paradoxical, because both host and parasite loci determine fitness in a multiplicative fashion. Thus, one might expect that there is no epistasis. As a consequence, no LD should build up, and there should be no selection for or against sex in the region close to the MMA ("black crescent" in Figure 5a). This expectation, however, does not take into account that the epistasis experienced by the host population is a result of both the interaction matrix (i.e. s_{1 }and s_{2}) and the disequilibrium of the parasite population (see expression for host fitness in section "model"). In our simulations, we see that if recombination is small, host and parasites that interact according to the MMA (or closely related interaction types) seem to behave in a very particular way: If the system starts exactly at the "central equilibrium" (all frequencies are equal to 1/4 and thus LD equals 0), the system stays there and no LD develops. If, however, a small LD is introduced, the system leaves the central equilibrium and approaches a stable state with a strong and constant LD, which is either positive or negative depending on the initial condition. An example for this behavior is given in supplementary figure S3, Additional file 1. In accordance with the reduction principle [16], such a steady state with nonvanishing LD leads to selection against recombination and thus explains our results for the MMA and the closely related interaction types. Interestingly, a similar behavior has been described in diploid singlespecies models where a population can attain highcomplementarity equilibria (HCE), i.e. two stable steady states with nonvanishing LDs of opposite sign [17].
Conclusion
We conclude that in deterministic models of hostparasite interactions, persistent LD oscillations are structurally not robust. Whether these oscillations are persistent or damped depends on both the implementation of the model and on the parameter region. In this article, we found damped LD oscillations for weak selection in one of the standard models for hostparasite interactions [5] and throughout the whole parameter range (in which oscillations existed at all) in two alternative versions of this model. Damped LD oscillations imply (i) only transient selection for or against sex/recombination in the deterministic regime, and (ii) a large impact of stochasticity (i.e. of finite populations) on the evolution of sex/recombination. If oscillations are damped in the deterministic regime, stochasticity can counteract the dampening and maintain LD oscillations with considerable amplitude, which becomes larger with smaller population size. As a consequence, selection for or against sex/recombination is persistent in the stochastic regime and depends inversely on population size. If, on the other hand, LD oscillations are persistent in the deterministic regime, then stochasticity only weakly affects the evolution of sex/recombination and rather decreases the selection on a modifier. Overall, the fact that LDoscillations are structurally not robust in deterministic models of the RQH and that consequently, the impact of hostparasite interactions may crucially depend on population size, suggests that the RQH should be seen as an essentially stochastic hypothesis.
Methods
The deterministic model
Both hosts and parasites have 2 interaction loci with two alternative alleles (0 and 1) that determine the interaction between hosts and parasite. Additionally, the host has a modifier locus with two possible alleles, m (wildtype) and M (mutant), that affect the recombination rate. Hence, the eight possible host genotypes are 00m, 00M, 01m, 01M, 10m, 10M, 11m and 11M. The host population is initiated with random genotype frequencies, except that initially all hosts have the wildtype allele m at the modifier locus. The parasite population consists of four genotypes (00,01,10,11) and is also initiated with random genotype frequencies.
In the discretetime models (the standard model and the sequentialupdating model), the following processes occur at each timestep: host reproduction, host selection, host mutation, pathogen reproduction, pathogen selection, and pathogen mutation. The difference between the two discretetime models is that in the standard model, host and parasite populations are updated simultaneously, whereas in the alternative model, they are updated sequentially. To be more explicit, the updating in the sequential model works as follows. We first let the parasite population interact with the current host population, and then update the parasite population accordingly. This step is iterated n_{pg }times, where n_{pg }denotes the number of pathogen generations per host generation (for all simulations, we use n_{pg }= 5). Then we update the host population by letting it interact with the updated parasite population. In the standard model, on the other hand, both populations are updated simultaneously after one round of interaction. In this model, different generation times in host and parasites are realized by replacing every generation the whole parasite population but only a fraction 1/n_{pg }of the host population. The equations of the two discretetime models read as follows:
for the standard model, and
for the sequentialupdating model. The functions RMS_{h }and RMS_{p }denote the successive action of selection, mutation and recombination on the genotype frequencies (f^{H }and f^{P})for hosts and parasites respectively. The superscript (n_{pg}) expresses that corresponding function is iterated n_{pg }times.
The continuoustime model used here can be obtained from the standard model by replacing a fraction Δt of the host population and a fraction n_{pg}Δt of the parasite population every time step and then taking the limit Δt→0. The resulting ODEs read
In all models, hosts reproduce by recombining their genotypes, while parasites reproduce clonally. Recombination of two host genomes occurs at a rate that depends on the allele at the modifier locus in the two recombining hosts. If both hosts have allele m, the (per genome) recombination rate is r_{mm }(i.e. the wildtype recombination rate). If one host has allele m and the other has allele M, the recombination rate is r_{mM}. If both hosts have allele M, the recombination rate is r_{MM}. We allow a maximum of one recombination event per genome, and the probability of the crossingover event is independent of its location on the genome. Selection is determined by the fitness matrices w^{H}_{ij }and w^{P}_{ij}. Specifically, w^{H}_{ij }denotes the fitness of a hostgenotype i interacting with a parasitegenotype j and w^{P}_{ij }denotes the fitness of the parasitegenotype i interacting with a host genotype j. Since the interaction probability for host i and parasite j is proportional to their frequencies, f^{H}_{i }and f^{P}_{j}, the fitness of the hostgenotype i reads
and thus the frequency of the hostgenotype i after selection is
The parasite frequencies after selection are calculated analogously. Each interaction locus mutates independently with probability μ = 10^{5 }per generation, and forward and backward mutations occur with the same probability.
The stochastic model
We turn the deterministic into a stochastic model with population size N by including a sampling step each generation (after the mutation step): N individuals are sampled according to the multinomial distribution with frequencies f^{H}_{i}. The genotype frequencies are then obtained by dividing the number of sampled individuals per genotype, N_{i}, by the total number of individuals, N. We assume that parasite populations are much larger than host populations, and that they can thus be approximated with a deterministic description (i.e. without a sampling step).
Matching allele models
The fitness matrices w^{H}_{ij }and w^{P}_{ij }can specify a broad range of types of hostparasite interactions. In particular, two important special cases can be specified: The matching allele (MA) model assumes that the parasite can infect the host only if it matches all interaction loci of the host. An infected host suffers a fitness cost of s_{H}, while a noninfective parasite suffers a fitness cost of s_{P}. For the fitness matrices, this implies that for a match at all alleles of genotypes i and j, w^{H}_{ij }= 1s_{H }and w^{P}_{ij }= 1; and else w^{H}_{ij }= 1 and w^{P}_{ij }= 1s_{P}. Unless stated otherwise we assume s_{H }= s_{P }= s (the effects discussed in this paper remain, however, qualitatively the same if one relaxes this assumption and assumes for example a strong selection on the parasite and variable selection on the host such as in [6,7]). The MA model is extreme in that the effect of an allele at an interaction locus depends very strongly on its genetic background (i.e. epistasis is very strong). At the other extreme of very weak epistasis is the multiplicative matching allele (MMA) model, which is specified as follows. The extreme matches (i.e. 0 or 2 matched loci) have the same fitness as in the MA. If the parasite matches only one interaction locus, the fitness values of the MMA are intermediate: w^{H}_{ij }= (1s_{H})^{1/2 }and w^{P}_{ij }= (1s_{P})^{1/2}.
The MA and the MMA represent the extremes of very strong and no epistatic interactions. In order to study the RQD for a more general range of different models for the interaction between host and parasite, we consider the following set of fitness matrices: the fitness of the hostgenotype i interacting with the parasitegenotype j depends only on the number of host loci matched by the parasite (n), i.e. w^{H}_{ij }= w^{H}_{n }= (1s_{n}); in addition, we set w^{H}_{0 }= 1, i.e. a host that is not recognized by the parasite at any interaction locus suffers from no fitness cost. By assumption host and parasite interact antagonistically, i.e. the higher the fitness of the parasite, the lower the fitness of the host. For simplicity, we assume that this antagonistic interaction takes the form w^{P}_{n }= c/w^{H}_{n}, i.e. the fitness of the parasite is inversely proportional to the fitness of the host (whereby the constant c is chosen such that w^{P}_{2 }= 1). For two loci, the system can thus be described by two parameters s_{1 }and s_{2}(the selection on a host matched at one or two loci, respectively). This generalized matching allele model (with inverse proportionality between host and parasite fitness) contains the MA model (s_{1 }= 0, s_{2 }> 0) and the MMA model (w^{H}_{2 }= w^{H}_{1 }* w^{H}_{1}) but also a broad range of epistatic interactions of intermediate strength.
Measuring selection on the modifier of recombination
We estimate the selection for larger or smaller recombination rates in the following way: Starting with randomly chosen initial genotype frequencies at interaction loci, we allow host and parasite populations to coevolve for 1,000 host generations, during which all hosts reproduce at a wildtype recombination rate r_{mm}. After that, the mutant allele M is introduced in 50% of the host population, and after another 1,000 host generations, the frequency of M is recorded. The frequency change of the modifier, averaged over a large number of samples, is then used as a proxy for the selection on the modifier of recombination. We have verified this proxy using a simple onelocus/twoallele model with fitness values 1 and 1+s (see supplementary figure S1, Additional file 1).
Authors' contributions
All three authors contributed substantially to designing, performing, analyzing, and interpreting the simulations. All authors read and approved the final manuscript.
Acknowledgements
We thank Sarah Otto, Olin Silander, Roland Regoes, and three anonymous reviewers for valuable comments and the Swiss National Science Foundation for financial support.
References

Bell G: The Masterpiece of Nature: The Evolution and Genetics of Sexuality. University of California Press; 1982.

Hamilton WD: Sex Versus NonSex Versus Parasite.
Oikos 1980, 35(2):282290. Publisher Full Text

Jaenike J: An hypothesis to account for the maintenance of sex within populations.

Otto SP, Nuismer SL: Species interactions and the evolution of sex.
Science 2004, 304(5673):10181020. PubMed Abstract  Publisher Full Text

Peters AD, Lively CM: The red queen and fluctuating epistasis: A population genetic analysis of antagonistic coevolution.
Am Nat 1999, 154(4):393405. PubMed Abstract  Publisher Full Text

Peters AD, Lively CM: Short and longterm benefits and detriments to recombination under antagonistic coevolution.
J Evolution Biol 2007, 20(3):12061217. Publisher Full Text

Parker MA: Pathogens and Sex in Plants.
Evol Ecol 1994, 8(5):560584. Publisher Full Text

Parker MA: The nature of plantparasite specificity  Comment.
Evol Ecol 1996, 10(3):319322. Publisher Full Text

Salathé M, Kouyos RD, Regoes RR, Bonhoeffer S: Rapid Parasite Adaption drives Selection for High Recombination Rates.

Nee S: Antagonistic CoEvolution and the Evolution of Genotypic Randomization.
J Theor Biol 1989, 140(4):499518. PubMed Abstract  Publisher Full Text

Gandon S, Otto SP: The evolution of sex and recombination in response to abiotic or coevolutionary fluctuations in epistasis.
Genetics 2007, 175(4):18351853. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

May RM: Relationships among Various Types of Population Models.
Am Nat 1973, 107(953):4657. Publisher Full Text

Maynard Smith J: The evolution of recombination. In The evolution of sex: an examination of current ideas. Edited by Michod RE, Levin BR. Sunderland, Massachusetts , Sinauer; 1988:106125.

Otto SP, Barton NH: Selection for recombination in small populations.
Evolution 2001, 55(10):19211931. PubMed Abstract

Altenberg L, Feldman MW: Selection, Generalized Transmission and the Evolution of Modifier Genes .1. the Reduction Principle.
Genetics 1987, 117(3):559572. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Franklin I, Lewontin RC: Is Gene Unit of Selection.
Genetics 1970, 65(4):707&. PubMed Abstract  Publisher Full Text  PubMed Central Full Text