<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>1753-6561-3-S7-S10</ui>
   <ji>1753-6561</ji>
   <fm>
      <dochead>Proceedings</dochead>
      <bibl>
         <title>
            <p>Representation of genetic association via attributable familial relative risks in order to identify polymorphisms functionally relevant to rheumatoid arthritis</p>
         </title>
         <aug>
            <au id="A1" ca="yes">
               <snm>Bermejo</snm>
               <mnm>Lorenzo</mnm>
               <fnm>Justo</fnm>
               <insr iid="I1"/>
               <insr iid="I2"/>
               <email>Justo.Lorenzo@imbi.uni-heidelberg.de</email>
            </au>
            <au id="A2">
               <snm>Fischer</snm>
               <fnm>Christine</fnm>
               <insr iid="I3"/>
               <email>Christine.Fischer@med.uni-heidelberg.de</email>
            </au>
            <au id="A3">
               <snm>Schulz</snm>
               <fnm>Anke</fnm>
               <insr iid="I4"/>
               <email>anke.schulz@dkfz.de</email>
            </au>
            <au id="A4">
               <snm>Cremer</snm>
               <fnm>Nadine</fnm>
               <insr iid="I4"/>
               <email>n.cremer@dkfz.de</email>
            </au>
            <au id="A5">
               <snm>Hein</snm>
               <fnm>Rebecca</fnm>
               <insr iid="I4"/>
               <email>r.hein@dkfz.de</email>
            </au>
            <au id="A6">
               <snm>Beckmann</snm>
               <fnm>Lars</fnm>
               <insr iid="I4"/>
               <email>l.beckmann@dkfz.de</email>
            </au>
            <au id="A7">
               <snm>Chang-Claude</snm>
               <fnm>Jenny</fnm>
               <insr iid="I4"/>
               <email>j.chang-claude@dkfz.de</email>
            </au>
            <au id="A8">
               <snm>Hemminki</snm>
               <fnm>Kari</fnm>
               <insr iid="I2"/>
               <insr iid="I5"/>
               <email>k.hemminki@dkfz.de</email>
            </au>
         </aug>
         <insg>
            <ins id="I1">
               <p>Institute of Medical Biometry and Informatics, University Hospital Heidelberg, INF 305, 69120 Heidelberg, Germany</p>
            </ins>
            <ins id="I2">
               <p>Division of Molecular Genetic Epidemiology, German Cancer Research Center, INF 520, 69120 Heidelberg, Germany</p>
            </ins>
            <ins id="I3">
               <p>Institute of Human Genetics, University of Heidelberg, INF 366, 69120 Heidelberg, Germany</p>
            </ins>
            <ins id="I4">
               <p>Division of Cancer Epidemiology, German Cancer Research Centre, INF 280, 69120 Heidelberg, Germany</p>
            </ins>
            <ins id="I5">
               <p>Center for Family and Community Medicine, Karolinska Institute, 14183 Huddinge, Sweden</p>
            </ins>
         </insg>
         <source>BMC Proceedings</source>
         <supplement>
            <title>
               <p>Genetic Analysis Workshop 16</p>
            </title>
            <note>Proceedings</note>
         </supplement>
         <conference>
            <title>
               <p>Genetic Analysis Workshop 16</p>
            </title>
            <location>St Louis, MO, USA</location>
            <date-range>17-20 September 2008</date-range>
            <url>http://www.gaworkshop.org/</url>
         </conference>
         <issn>1753-6561</issn>
         <pubdate>2009</pubdate>
         <volume>3</volume>
         <issue>Suppl 7</issue>
         <fpage>S10</fpage>
         <url>http://www.biomedcentral.com/1753-6561/3/S7/S10</url>
         <xrefbib>
            <pubid idtype="pmpid">20017963</pubid>
         </xrefbib>
      </bibl>
      <history>
         <pub>
            <date>
               <day>15</day>
               <month>12</month>
               <year>2009</year>
            </date>
         </pub>
      </history>
      <cpyrt>
         <year>2009</year>
         <collab>Bermejo et al; licensee BioMed Central Ltd.</collab>
         <note>This is an open access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note>
      </cpyrt>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <p>The results from association studies are usually summarized by a measure of evidence of association (frequentist or Bayesian probability values) that does not directly reflect the impact of the detected signals on familial aggregation. This article investigates the possible advantage of a two-dimensional representation of genetic association in order to identify polymorphisms relevant to disease: a measure of evidence of association (the Bayes factor, BF) combined with the estimated contribution to familiality (the attributable sibling relative risk, <it>&#955;</it><sub>s</sub>). Simulation and data from the North American Rheumatoid Consortium (NARAC) were used to assess the possible benefit under several scenarios. Simulation indicated that the allele frequencies to reach the maximum BF and the maximum attributable <it>&#955;</it><sub>s </sub>diverged as the size of the genetic effect increased. The representation of BF versus attributable <it>&#955;</it><sub>s </sub>for selected regions of NARAC data revealed that SNPs involved in replicated associations clearly departed from the bulk of SNPs in these regions. In the 12 investigated regions, and particularly in the low-recombination major histocompatibility region, the ranking of SNPs according to BF differed from the ranking of SNPs according to attributable <it>&#955;</it><sub>s</sub>. The present results should be generalized using more extensive simulations and additional real data, but they suggest that a characterization of genetic association by both BF and attributable <it>&#955;</it><sub>s </sub>may result in an improved ranking of variants for further biological analyses.</p>
         </sec>
      </abs>
   </fm>
   <bdy>
      <sec>
         <st>
            <p>Introduction</p>
         </st>
         <p>Susceptibility to rheumatoid arthritis (RA) is determined by both genetic and environmental factors, with an estimated sibling relative risk of 5-10. The <it>HLA-DRB1 </it>and <it>PTPN22 </it>genes explain approximately 50% of the familial aggregation. A recent genome-wide association (GWA) study carried out by the Wellcome Trust Case Control Consortium (WTCCC) found nine single-nucleotide polymorphisms (SNPs) with associated probability values of less than 10<sup>-5 </sup>that did not map to loci previously related to RA <abbrgrp><abbr bid="B1">1</abbr></abbrgrp>. In agreement with the common disease-common variant hypothesis, the novel variants were common (minor allele frequencies from 0.07 to 0.41) and they showed genotype relative risks (GRRs) of less than 2.3. The authors of the WTCCC article recognized a disparity between the large population-attributable fraction (PAF) and the modest sibling relative risk (<it>&#955;</it><sub>s</sub>) explained by the newly identified variants <abbrgrp><abbr bid="B1">1</abbr></abbrgrp>. This disparity is related to the technical characteristics of the platforms used in GWA studies, designed to scrutinize polymorphisms (common variants).</p>
         <p>Let us assume that a polymorphism is a marker of a rarer causal variant, and the marker-specific PAF equals the PAF of the causal variant. Under this assumption, we have demonstrated that the causal variant has a higher attributable <it>&#955;</it><sub>s </sub>than the marker <abbrgrp><abbr bid="B2">2</abbr></abbrgrp>. In other words: for a fixed PAF, causal variants contribute more to familial aggregation (<it>&#955;</it><sub>s</sub>) than the polymorphisms they are represented by.</p>
         <p>There is much debate concerning the representation of statistical evidence in GWA studies. The frequentist <it>p</it>-value depends on the power of the study and it does not provide a consistent measure of evidence because identical <it>p</it>-values do not imply identical evidence of genetic association <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>. In contrast, the Bayes factor (BF) statistic provides a single measure of the strength of evidence of association.</p>
         <p>We hypothesize here that the representation of genetic association by BF together with the attributable <it>&#955;</it><sub>s </sub>may help to identify polymorphisms relevant to RA, and use simulation and data from the North American Rheumatoid Consortium (NARAC) to evaluate this assumption.</p>
      </sec>
      <sec>
         <st>
            <p>Methods</p>
         </st>
         <sec>
            <st>
               <p>Derivation of attributable risks and Bayes factors</p>
            </st>
            <p>The sibling relative risk (<it>&#955;</it><sub>s</sub>) attributable to a gene reflects the extent to which a particular genetic locus contributes to familial aggregation. The calculation of attributable <it>&#955;</it><sub>s </sub>values was first described in an early paper of James <abbrgrp><abbr bid="B4">4</abbr></abbrgrp>. If the frequency of the high-risk allele is denoted by RAF, the relative risk of RA for high-risk allele homozygotes compared to low-risk allele homozygotes by GRR<sub>hom</sub>, the relative risk of heterozygotes compared to low-risk allele homozygotes by GRR<sub>het </sub>and the disease prevalence among low-risk allele homozygotes by <it>&#954;</it><sub>0</sub>, the attributable <it>&#955;</it><sub>s </sub>is given by: <it>&#955;</it><sub>s </sub>= 1+(1/2V<sub>a</sub>+1/4V<sub>d</sub>)/K<sup>2</sup>, where V<sub>a </sub>(additive genetic variance divided by <it>&#954;</it><sub>0</sub><sup>2</sup>) equals 2RAF(1-RAF)[(1-RAF)(1-GRR<sub>het</sub>)-RAF(GRR<sub>hom</sub>-GRR<sub>het</sub>)]<sup>2</sup>, V<sub>d </sub>(dominance genetic variance divided by <it>&#954;</it><sub>0</sub><sup>2</sup>) equals RAF<sup>2</sup>(1-RAF)<sup>2</sup>[1+GRR<sub>hom</sub>-2GRR<sub>het</sub>]<sup>2 </sup>and K (population prevalence divided by <it>&#954;</it><sub>0</sub>) equals RAF<sup>2</sup>GRR<sub>Hom</sub>+2RAF(1-RAF)GRR<sub>het</sub>+ (1-RAF)<sup>2</sup>. Note that if the overall disease prevalence is 50%, <it>&#955;</it><sub>s </sub>cannot exceed two by definition. However, an important property of the attributable <it>&#955;</it><sub>s </sub>is that it only depends on RAF, GRR<sub>hom</sub>, and GRR<sub>het</sub>. That is, the attributable <it>&#955;</it><sub>s </sub>is independent of the disease prevalence among low-risk homozygotes <it>&#954;</it><sub>0</sub>.</p>
            <p>The BF statistic is the ratio of the probability of the observed data under the assumption that there is a true association to its probability under the null hypothesis (absence of association). A small BF provides evidence in favor of a true association. To investigate the relationship between attributable <it>&#955;</it><sub>s </sub>and the BF, we calculated the expected distribution of genotypes in 1000 cases and 1000 controls when GRR<sub>hom </sub>= 1.5, 2, 3, 4, 5 and 10. Calculations were carried out for the dominant model, which assumes that GRR<sub>het </sub>= GRR<sub>hom</sub>, the recessive model (GRR<sub>het </sub>= 1), and for the additive model (GRR<sub>het </sub>= (1+GRR<sub>hom</sub>)/2). Under Hardy-Weinberg equilibrium, the expected distribution of genotypes in controls (D = 0) is: <it>Pr</it>(G = aa|D = 0) = (1-RAF)<sup>2</sup>; <it>Pr</it>(G = Aa|D = 0) = 2RAF(1-RAF); <it>Pr</it>(G = AA|D = 0) = RAF<sup>2 </sup>The expected distribution of genotypes in cases (D = 1) satisfies:</p>
            <p>GRR<sub>hom </sub>= (<it>Pr</it>(D = 1 | G = AA)/<it>Pr</it>(D = 0 | G = AA))/(<it>Pr</it>(D = 1 | G = aa)/<it>Pr</it>(D = 0 | G = aa)) and GRR<sub>het </sub>= (<it>Pr</it>(D = 1 | G = Aa)/<it>Pr</it>(D = 0 | G = Aa))/(<it>Pr</it>(D = 1 | G = aa)/<it>Pr</it>(D = 0 | G = aa)). For example, if RAF = 0.2 and GRR<sub>hom </sub>= GRR<sub>het </sub>= 2 (dominance), the expected distribution is (aa = 640, Aa = 320, AA = 40) in controls and (aa = 471, Aa = 471, AA = 59) in cases.</p>
            <p>The expected distributions of genotypes were investigated by Bayesian logistic regression. We considered a general three-genotype model of association. Calculation of BFs requires assumptions about effect sizes. We assumed N(0,1) priors on the mean and the two genetic effects. The function <it>MCMClogit </it>(R package <it>MCMCpack </it><abbrgrp><abbr bid="B5">5</abbr></abbrgrp>) was used to generate a 10,000 sample dataset from the posterior distribution using a random walk Metropolis algorithm. The <it>BayesFactor </it>function in the same package was used to compute log marginal likelihoods for a model 'with' compared to a model 'without' genotypic information using a Laplace approximation.</p>
         </sec>
         <sec>
            <st>
               <p>Investigated regions</p>
            </st>
            <p>This study investigated regions around the 12 signals detected in the WTCCC study with associated probability values of less than 10<sup>-5 </sup>(Table <tblr tid="T1">1</tblr>). The left side of Table <tblr tid="T1">1</tblr> represents the 12 selected regions from the WTCCC study. For example, the most associated marker on 1p13 was rs6679677. We retrieved NARAC data from 1000-kb regions centred on the positions of the 12 signals from the WTCCC study. For example, our first region comprised the chromosomal interval (10,901,850::11,901,850) around rs6679677. The WTCCC study reported two SNPs in 6p21 that resulted in two overlapping intervals which were independently investigated.</p>
            <tbl id="T1">
               <title>
                  <p>Table 1</p>
               </title>
               <caption>
                  <p>Description and results from the 12 investigated regions</p>
               </caption>
               <tblbdy cols="9">
                  <r>
                     <c cspan="5" ca="center">
                        <p>
                           <b>WTCCC study<sup>a</sup></b>
                        </p>
                     </c>
                     <c cspan="4" ca="center">
                        <p>
                           <b>NARAC data<sup>b</sup></b>
                        </p>
                     </c>
                  </r>
                  <r>
                     <c cspan="5">
                        <hr/>
                     </c>
                     <c cspan="4">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="left">
                        <p>
                           <b>Chr</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>SNP</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>Position</b>
                        </p>
                     </c>
                     <c cspan="2" ca="center">
                        <p>
                           <b>MAD of log<sub>10</sub></b>
                        </p>
                     </c>
                     <c ca="left">
                        <p>
                           <b>Outlying SNPs, gene regions</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>log<sub>10 </sub>(BF)</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>RAF</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>&#955;<sub>s </sub>Median (5<sup>th</sup>-95<sup>th</sup>)</b>
                        </p>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c cspan="2">
                        <hr/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c ca="center">
                        <p>
                           <b>GRR<sub>hom</sub></b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>GRR<sub>het</sub></b>
                        </p>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c cspan="9">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>1p13</p>
                     </c>
                     <c ca="left">
                        <p>rs6679677</p>
                     </c>
                     <c ca="right">
                        <p>11,401,850</p>
                     </c>
                     <c ca="center">
                        <p>0.282</p>
                     </c>
                     <c ca="center">
                        <p>0.199</p>
                     </c>
                     <c ca="left">
                        <p>rs2476601, <it>PTPN22</it></p>
                     </c>
                     <c ca="right">
                        <p>3.91</p>
                     </c>
                     <c ca="center">
                        <p>0.084</p>
                     </c>
                     <c ca="center">
                        <p>1.048 (1.017-1.098)</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>1p36</p>
                     </c>
                     <c ca="left">
                        <p>rs6684865</p>
                     </c>
                     <c ca="right">
                        <p>2,578,391</p>
                     </c>
                     <c ca="center">
                        <p>0.282</p>
                     </c>
                     <c ca="center">
                        <p>0.199</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>1p31</p>
                     </c>
                     <c ca="left">
                        <p>rs11162922</p>
                     </c>
                     <c ca="right">
                        <p>80,284,079</p>
                     </c>
                     <c ca="center">
                        <p>0.282</p>
                     </c>
                     <c ca="center">
                        <p>0.199</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>4p15</p>
                     </c>
                     <c ca="left">
                        <p>rs3816587</p>
                     </c>
                     <c ca="right">
                        <p>25,093,513</p>
                     </c>
                     <c ca="center">
                        <p>0.255</p>
                     </c>
                     <c ca="center">
                        <p>0.188</p>
                     </c>
                     <c ca="left">
                        <p>rs12505556, <it>SLC34A2</it></p>
                     </c>
                     <c ca="right">
                        <p>3.04</p>
                     </c>
                     <c ca="center">
                        <p>0.112</p>
                     </c>
                     <c ca="center">
                        <p>1.071 (1.011-1.630)</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>6p21a</p>
                     </c>
                     <c ca="left">
                        <p>rs6457617</p>
                     </c>
                     <c ca="right">
                        <p>32,771,829</p>
                     </c>
                     <c ca="center">
                        <p>0.306</p>
                     </c>
                     <c ca="center">
                        <p>0.206</p>
                     </c>
                     <c ca="left">
                        <p>rs2395175, <it>MHC</it></p>
                     </c>
                     <c ca="right">
                        <p>16.48</p>
                     </c>
                     <c ca="center">
                        <p>0.148</p>
                     </c>
                     <c ca="center">
                        <p>1.164 (1.108-1.241)</p>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c ca="left">
                        <p>rs7765379, <it>MHC</it></p>
                     </c>
                     <c ca="right">
                        <p>6.11</p>
                     </c>
                     <c ca="center">
                        <p>0.113</p>
                     </c>
                     <c ca="center">
                        <p>1.175 (1.053-1.668)</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>6p21b</p>
                     </c>
                     <c ca="left">
                        <p>rs615672</p>
                     </c>
                     <c ca="right">
                        <p>32,682,149</p>
                     </c>
                     <c ca="center">
                        <p>0.306</p>
                     </c>
                     <c ca="center">
                        <p>0.206</p>
                     </c>
                     <c ca="left">
                        <p>rs2395175, <it>MHC</it></p>
                     </c>
                     <c ca="right">
                        <p>16.48</p>
                     </c>
                     <c ca="center">
                        <p>0.148</p>
                     </c>
                     <c ca="center">
                        <p>1.164 (1.108-1.241)</p>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c ca="left">
                        <p>rs7765379<it>MHC</it></p>
                     </c>
                     <c ca="right">
                        <p>6.11</p>
                     </c>
                     <c ca="center">
                        <p>0.113</p>
                     </c>
                     <c ca="center">
                        <p>1.175 (1.053-1.668)</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>6q23</p>
                     </c>
                     <c ca="left">
                        <p>rs6920220</p>
                     </c>
                     <c ca="right">
                        <p>138,048,197</p>
                     </c>
                     <c ca="center">
                        <p>0.306</p>
                     </c>
                     <c ca="center">
                        <p>0.206</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>7q32</p>
                     </c>
                     <c ca="left">
                        <p>rs11761231</p>
                     </c>
                     <c ca="right">
                        <p>130,827,294</p>
                     </c>
                     <c ca="center">
                        <p>0.268</p>
                     </c>
                     <c ca="center">
                        <p>0.185</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>10p15</p>
                     </c>
                     <c ca="left">
                        <p>rs2104286</p>
                     </c>
                     <c ca="right">
                        <p>6,139,051</p>
                     </c>
                     <c ca="center">
                        <p>0.290</p>
                     </c>
                     <c ca="center">
                        <p>0.197</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                     <c ca="center">
                        <p>-</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>13q12</p>
                     </c>
                     <c ca="left">
                        <p>rs9550642</p>
                     </c>
                     <c ca="right">
                        <p>19,848,092</p>
                     </c>
                     <c ca="center">
                        <p>0.286</p>
                     </c>
                     <c ca="center">
                        <p>0.200</p>
                     </c>
                     <c ca="left">
                        <p>rs1407961, <it>ZMYM2</it></p>
                     </c>
                     <c ca="right">
                        <p>3.59</p>
                     </c>
                     <c ca="center">
                        <p>0.920</p>
                     </c>
                     <c ca="center">
                        <p>1.033 (1.033-1.225)</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>21q22</p>
                     </c>
                     <c ca="left">
                        <p>rs2837960</p>
                     </c>
                     <c ca="right">
                        <p>41,433,788</p>
                     </c>
                     <c ca="center">
                        <p>0.288</p>
                     </c>
                     <c ca="center">
                        <p>0.208</p>
                     </c>
                     <c ca="left">
                        <p>rs468646, <it>MX1</it></p>
                     </c>
                     <c ca="right">
                        <p>4.28</p>
                     </c>
                     <c ca="center">
                        <p>0.488</p>
                     </c>
                     <c ca="center">
                        <p>1.038 (1.019-1.057)</p>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c ca="left">
                        <p>rs466092, <it>MX2</it></p>
                     </c>
                     <c ca="right">
                        <p>3.59</p>
                     </c>
                     <c ca="center">
                        <p>0.488</p>
                     </c>
                     <c ca="center">
                        <p>1.030 (1.016-1.048)</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>22q13</p>
                     </c>
                     <c ca="left">
                        <p>rs743777</p>
                     </c>
                     <c ca="right">
                        <p>35,876,107</p>
                     </c>
                     <c ca="center">
                        <p>0.283</p>
                     </c>
                     <c ca="center">
                        <p>0.216</p>
                     </c>
                     <c ca="left">
                        <p>rs3218258, <it>IL2RB</it></p>
                     </c>
                     <c ca="right">
                        <p>9.63</p>
                     </c>
                     <c ca="center">
                        <p>0.771</p>
                     </c>
                     <c ca="center">
                        <p>1.061 (1.041-1.084)</p>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c ca="left">
                        <p>rs710183, <it>CSF2RB</it></p>
                     </c>
                     <c ca="right">
                        <p>4.26</p>
                     </c>
                     <c ca="center">
                        <p>0.072</p>
                     </c>
                     <c ca="center">
                        <p>1.028 (1.011-1.183)</p>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c ca="left">
                        <p>rs8137446, <it>KCTD17</it></p>
                     </c>
                     <c ca="right">
                        <p>3.48</p>
                     </c>
                     <c ca="center">
                        <p>0.903</p>
                     </c>
                     <c ca="center">
                        <p>1.035 (1.018-1.123)</p>
                     </c>
                  </r>
               </tblbdy>
               <tblfn>
                  <p><sup>a</sup>Results from the WTCCC study.</p>
                  <p><sup>b</sup>Results based on NARAC.</p>
               </tblfn>
            </tbl>
         </sec>
         <sec>
            <st>
               <p>Calculation of attributable risks and Bayes factors for NARAC data</p>
            </st>
            <p>SNPs in the 12 selected intervals were extracted from NARAC data, and the association between RA and the retrieved SNPs was represented by 1) the base 10 logarithm of the BF (log<sub>10</sub>BF) and 2) the attributable <it>&#955;</it><sub>s</sub>. RA status (affected or unaffected) was modelled by logistic regression, taking into account the covariates gender, number of <it>HLA</it>-<it>DRB1 </it>shared-epitope alleles (NN = 0, SN = 1 or SS = 2) and genotype (three levels). Individuals with missing information were excluded from the calculations. Only SNPs with the three genotypes represented in both cases and controls were considered.</p>
            <p>As already mentioned, calculation of BFs requires assumptions on effect sizes. We calculated frequentist estimates of logistic regression coefficients over the corresponding entire chromosomes using NARAC data. Density plots and tests of goodness of fit of frequentist estimates of log<sub>10</sub>GRR<sub>Hom </sub>and log<sub>10</sub>GRR<sub>Het </sub>for the seven investigated chromosomes indicated that GRR variation was better represented by the median absolute deviation (MAD) than by the standard deviation (data not shown). Therefore, we assumed N(0, MAD<sup>2</sup>) priors on the logarithms of genetic effects. <it>MCMClogit </it>and <it>BayesFactor </it><abbrgrp><abbr bid="B5">5</abbr></abbrgrp> were used to calculate BFs for each SNP in the selected regions based on NARAC data. The number of individuals with complete data and the observed allele frequencies in controls were used to draw 10,000 samples from a binomial distribution, which were combined with the posterior estimates of genetic effects to simulate the distribution of attributable <it>&#955;</it><sub>s </sub>for each SNP.</p>
            <p>A bagplot is a bivariate generalization of the non-parametric univariate boxplot <abbrgrp><abbr bid="B6">6</abbr></abbrgrp>. In a bagplot, the region which contains 50% of the observations with greatest bivariate depth is denominated the bag. Observations outside the bag expanded three times are considered outliers, they are too far away from the data's central bulk. These outliers are indicated by closed dots in univariate boxplots. Bagplots have been shown to be equivariant for linear transformations and not limited to elliptical distributions. Due to these properties and the characteristics of our data (unknown shape of the underlying distributions), we used non-parametric bagplots to identify deviating SNPs. Bagplots were determined using the function <it>compute.bagplot </it>in the R package <it>aplpack </it><abbrgrp><abbr bid="B7">7</abbr></abbrgrp>.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Results</p>
         </st>
         <sec>
            <st>
               <p>Theoretical relationship between Bayes factor and attributable risk</p>
            </st>
            <p>Table <tblr tid="T1">1</tblr> shows the RAFs at which the maximum log<sub>10</sub>BF and <it>&#955;</it><sub>s </sub>were reached assuming several GRR<sub>hom </sub>values under the dominant, recessive and additive modes of inheritance. For example, under GRR<sub>hom </sub>= 2 and dominance, the maximum log<sub>10</sub>BF (25.3) was reached when RAF = 0.22 and the maximum <it>&#955;</it><sub>s </sub>(1.06) for RAF = 0.17. Alternative sample-sizes/priors would result in different log<sub>10</sub>BFs, but the RAF to reach the maximum log<sub>10</sub>BF would not change. The representation of log<sub>10</sub>BF versus attributable <it>&#955;</it><sub>s </sub>(data not shown) indicated that the two parameters were correlated, but they did not correspond one-to-one. In the three models, the RAF corresponding to the highest attributable <it>&#955;</it><sub>s </sub>and the RAF corresponding to the highest log<sub>10</sub>BF decreased with increasing GRR<sub>hom </sub>values. The RAF at maximum log<sub>10</sub>BF was always higher than the RAF at maximum <it>&#955;</it><sub>s</sub>, i.e., balanced designs resulted in stronger association evidences. The difference between RAF at maximum log<sub>10</sub>BF and RAF at maximum attributable <it>&#955;</it><sub>s </sub>increased with increasing GRR<sub>hom</sub>, for example (0.24-0.21) = 0.03 if GRR<sub>hom </sub>= 1.5 versus (0.14-0.05) = 0.09 when GRR<sub>hom </sub>= 10 in the dominant model.</p>
            <tbl id="T2">
               <title>
                  <p>Table 2</p>
               </title>
               <caption>
                  <p>Allele frequencies at maximum <it>&#955;</it><sub>s </sub>and maximum log<sub>10</sub>(BF)</p>
               </caption>
               <tblbdy cols="7">
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c cspan="2" ca="center">
                        <p>
                           <b>Dominant model</b>
                        </p>
                     </c>
                     <c cspan="2" ca="center">
                        <p>
                           <b>Recessive model</b>
                        </p>
                     </c>
                     <c cspan="2" ca="center">
                        <p>
                           <b>Additive model</b>
                        </p>
                     </c>
                  </r>
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c cspan="2">
                        <hr/>
                     </c>
                     <c cspan="2">
                        <hr/>
                     </c>
                     <c cspan="2">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>
                           <b>GRR<sub>hom</sub></b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>Max log<sub>10</sub>(BF)</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>Max <it>&#955;</it><sub>s</sub></b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>Max log<sub>10</sub>(BF)</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>Max <it>&#955;</it><sub>s</sub></b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>Max log<sub>10</sub>(BF)</b>
                        </p>
                     </c>
                     <c ca="center">
                        <p>
                           <b>Max <it>&#955;</it><sub>s</sub></b>
                        </p>
                     </c>
                  </r>
                  <r>
                     <c cspan="7">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>1.5</p>
                     </c>
                     <c ca="center">
                        <p>0.24</p>
                     </c>
                     <c ca="center">
                        <p>0.21</p>
                     </c>
                     <c ca="center">
                        <p>0.70</p>
                     </c>
                     <c ca="center">
                        <p>0.66</p>
                     </c>
                     <c ca="center">
                        <p>0.39</p>
                     </c>
                     <c ca="center">
                        <p>0.40</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>2</p>
                     </c>
                     <c ca="center">
                        <p>0.22</p>
                     </c>
                     <c ca="center">
                        <p>0.17</p>
                     </c>
                     <c ca="center">
                        <p>0.64</p>
                     </c>
                     <c ca="center">
                        <p>0.61</p>
                     </c>
                     <c ca="center">
                        <p>0.38</p>
                     </c>
                     <c ca="center">
                        <p>0.33</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>3</p>
                     </c>
                     <c ca="center">
                        <p>0.20</p>
                     </c>
                     <c ca="center">
                        <p>0.13</p>
                     </c>
                     <c ca="center">
                        <p>0.61</p>
                     </c>
                     <c ca="center">
                        <p>0.54</p>
                     </c>
                     <c ca="center">
                        <p>0.33</p>
                     </c>
                     <c ca="center">
                        <p>0.25</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>4</p>
                     </c>
                     <c ca="center">
                        <p>0.17</p>
                     </c>
                     <c ca="center">
                        <p>0.10</p>
                     </c>
                     <c ca="center">
                        <p>0.59</p>
                     </c>
                     <c ca="center">
                        <p>0.48</p>
                     </c>
                     <c ca="center">
                        <p>0.26</p>
                     </c>
                     <c ca="center">
                        <p>0.20</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>5</p>
                     </c>
                     <c ca="center">
                        <p>0.16</p>
                     </c>
                     <c ca="center">
                        <p>0.08</p>
                     </c>
                     <c ca="center">
                        <p>0.57</p>
                     </c>
                     <c ca="center">
                        <p>0.45</p>
                     </c>
                     <c ca="center">
                        <p>0.24</p>
                     </c>
                     <c ca="center">
                        <p>0.17</p>
                     </c>
                  </r>
                  <r>
                     <c ca="center">
                        <p>10</p>
                     </c>
                     <c ca="center">
                        <p>0.14</p>
                     </c>
                     <c ca="center">
                        <p>0.05</p>
                     </c>
                     <c ca="center">
                        <p>0.49</p>
                     </c>
                     <c ca="center">
                        <p>0.33</p>
                     </c>
                     <c ca="center">
                        <p>0.17</p>
                     </c>
                     <c ca="center">
                        <p>0.09</p>
                     </c>
                  </r>
               </tblbdy>
            </tbl>
         </sec>
         <sec>
            <st>
               <p>Bayes factors and attributable sibling relative risks in the investigated regions</p>
            </st>
            <p>The analysis of complete chromosomes by frequentist logistic regression resulted in 2(GRR<sub>hom</sub>, GRR<sub>het</sub>) &#215; 8(chromosomes 1, 4, 6, 7, 10, 13, 21, 22) sets of genetic effects. Table <tblr tid="T1">1</tblr> shows the MADs of log<sub>10</sub>GRR<sub>hom </sub>and log<sub>10</sub>GRR<sub>het </sub>used as scale parameters in the normal prior distributions. As expected, the <it>a priori </it>variance of genetic effects was highest for chromosome 6 (MHC region).</p>
            <p>Figure <figr fid="F1">1</figr> represents the bivariate distribution of log<sub>10</sub>BF by attributable <it>&#955;</it><sub>s </sub>based on NARAC data for individual SNPs in the 12 explored regions. Gray points show SNPs within the bulk of data, outlying observations (observations outside the bag expanded three times) are represented by black points. The right part of Table <tblr tid="T1">1</tblr> shows SNP numbers and close genes for the most extreme outliers. For example, rs2476601 in the 1p13 region: based on NARAC data, the log<sub>10</sub>BF was 3.91, the high-risk allele frequency in controls is 0.084, and the estimated attributable <it>&#955;</it><sub>s </sub>with 95% confidence interval was 1.048 (1.017 to 1.098) for this SNP. The other two regions on chromosome 1 did not reveal strong associations with RA. The investigation of the two overlapping intervals in chromosome 6p21 showed practically identical results; the highest attributable <it>&#955;</it><sub>s </sub>values were found for SNPs rs7765379 (1.175) and rs2395175 (1.164). Many SNPs in this region showed a strong association with RA. The investigation of the 6q23, 7q32, and 10p15 regions resulted in log<sub>10</sub>BF values below three. The log<sub>10</sub>BF and the attributable <it>&#955;</it><sub>s </sub>for SNP rs1407961 in the 13q12 region clearly departed from the majority of data. Two extreme outlier SNPs were identified in the 21q22 region and three outliers in the 22q13 region.</p>
            <fig id="F1">
               <title>
                  <p>Figure 1</p>
               </title>
               <caption>
                  <p>Scatterplots of log<sub>10 </sub>values of Bayes factors (log10(BF)) and attributable sibling relative risks (<it>&#955;</it><sub>s</sub>) for SNPs in the investigated regions</p>
               </caption>
               <text>
                  <p><b>Scatterplots of log<sub>10 </sub>values of Bayes factors (log10(BF)) and attributable sibling relative risks (<it>&#955;</it><sub>s</sub>) for SNPs in the investigated regions</b>. Outlying SNPs (black points) were identified by bagplots. SNP numbers are shown for most extreme outliers with log<sub>10</sub>(BF)s higher than three. Note scale differences.</p>
               </text>
               <graphic file="1753-6561-3-S7-S10-1"/>
            </fig>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Discussion</p>
         </st>
         <p>This study explored the advantage of combining BF, a measure of statistical evidence of association, and the attributable <it>&#955;</it><sub>s</sub>, a measure of contribution to familial aggregation, in order to characterize the effect of a particular polymorphism on disease risk. Both simulation and NARAC-based results showed that BF usually correlates with the attributable <it>&#955;</it><sub>s</sub>. Most markers identified in GWA studies confer a slightly increased risk of disease. For this kind of modest genetic effects (GRR &#8804; 2), simulation indicated that the maximum log<sub>10</sub>BF and the maximum attributable <it>&#955;</it><sub>s </sub>were expected to be found for variants with similar frequencies: around 20% (dominant), 40% (additive) and 70% (recessive penetrances). The larger the size of the genetic effect, the lower the RAF to reach the maxima, and the larger the difference between RAFs. Causal variants generally show stronger effects than markers from GWA studies. For example, a recent GWA study identified five novel breast cancer susceptibility loci. The highest GRR was 1.6, which can be compared with GRR = 6 to 30 for carriers of <it>BRCA1 </it>mutations. Simulation suggested that, for this kind of strong genetic effects, attributable <it>&#955;</it><sub>s </sub>and BF are two different dimensions.</p>
         <p>The representation of <it>&#955;</it><sub>s </sub>versus log<sub>10</sub>BF based on NARAC data confirmed that SNPs which have shown replicated associations clearly departed from the majority of polymorphisms in the selected regions. For example, the functionally relevant SNP rs2476601 was unequivocally separated from the rest of SNPs in the 1p13 region. Other genes located in the proximity of the most extreme SNPs were <it>ZMYM2</it>, <it>MX1</it>, <it>MX2</it>, <it>IL2RB</it>, and <it>CSF2RB</it>. This list includes SNPs which show strong evidence of association (log<sub>10</sub>BF higher than three) and outlying <it>&#955;</it><sub>s </sub>values. SNPs with high attributable <it>&#955;</it><sub>s </sub>values but relatively low BFs may also be of interest. Simulation showed that one BF value corresponds to two different <it>&#955;</it><sub>s </sub>values. In the 12 regions investigated using NARAC data, the ranking of SNPs according to BF differed from the ranking according to attributable <it>&#955;</it><sub>s</sub>. The difference was particularly clear in the low-recombination MHC region, where rs7765379 showed the maximum <it>&#955;</it><sub>s </sub>and rs2395175 showed the maximum log<sub>10</sub>BF. This difference in rankings suggests that, in addition to a measure of association evidence, the extensive fine-mapping needed to characterize etiological variants may benefit from the consideration of the attributable <it>&#955;</it><sub>s</sub>. Future studies based on more extensive simulations and additional real data should investigate this possibility.</p>
         <p>The present study made use of Bayesian and robust statistics. The Bayesian approach has been overlooked in the analysis of GWA studies, where the adjustment for multiple testing, the relationship between power and statistical significance, and the selection of disease models are important issues <abbrgrp><abbr bid="B1">1</abbr><abbr bid="B3">3</abbr></abbrgrp>. We only considered SNPs with the three genotypes represented in both cases and controls. This strategy would initially hamper the identification of rare causal variants but, on the other hand, logistic regression has not been robust to particular types of outliers, and a three-genotype model with well represented categories would result in more robust estimates. Robust methods aim to describe the structure best fitting to the bulk of the data, and to identify deviating observations. Robust statistics are used a lot less than they ought to be in genetic epidemiology. The use of MADs and bagplots in the present article illustrates their advantage over classical methods in practical situations.</p>
      </sec>
      <sec>
         <st>
            <p>Conclusion</p>
         </st>
         <p>The association results from GWA studies are usually summarized by a measure of evidence of association (frequentist or Bayesian probability values), which do not reflect the contribution of the identified signals to familial aggregation. We propose here a two-dimensional characterization of genetic association consisting of the attributable <it>&#955;</it><sub>s </sub>and the BF.</p>
      </sec>
      <sec>
         <st>
            <p>List of abbreviations used</p>
         </st>
         <p>BF: Bayes factor; GRR: Genotype relative risk; GWA: Genome-wide association; <it>&#955;</it><sub>s</sub>: sibling relative risk; MAD: Median absolute deviation; MHC: Major histocompatibility complex; PAF: Population-attributable fraction; RA: Rheumatoid arthritis; SNP: Single-nucleotide polymorphism; WTCCC: Wellcome trust case control consortium</p>
      </sec>
      <sec>
         <st>
            <p>Competing interests</p>
         </st>
         <p>The authors declare that they have no competing interests.</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>JLB designed the study, performed the statistical analyses and drafted the manuscript. CF and KH contributed to the study design and revised critically the manuscript. AS, NC, RH, LB, and JCC made substantial contributions to interpretation of results. All authors read and approved the final manuscript.</p>
      </sec>
   </bdy>
   <bm>
      <ack>
         <sec>
            <st>
               <p>Acknowledgements</p>
            </st>
            <p>The Genetic Analysis Workshops are supported by NIH grant R01 GM031575 from the National Institute of General Medical Sciences. JLB was supported by Deutsche Krebshilfe and the Swedish Cancer Society. RH was supported by NGFN 2 (SMP-GEM, PGE-S30T09), funded by the BMBF.</p>
            <p>This article has been published as part of <it>BMC Proceedings </it>Volume 3 Supplement 7, 2009: Genetic Analysis Workshop 16. The full contents of the supplement are available online at <url>http://www.biomedcentral.com/1753-6561/3?issue=S7</url>.</p>
         </sec>
      </ack>
      <refgrp>
         <bibl id="B1">
            <title>
               <p>Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls</p>
            </title>
            <aug>
               <au>
                  <cnm>Wellcome Trust Case Control Consortium</cnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2007</pubdate>
            <volume>447</volume>
            <fpage>661</fpage>
            <lpage>678</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">2719288</pubid>
                  <pubid idtype="pmpid" link="fulltext">17554300</pubid>
                  <pubid idtype="doi">10.1038/nature05911</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B2">
            <title>
               <p>The 'common disease-common variant' hypothesis and familial risks</p>
            </title>
            <aug>
               <au>
                  <snm>Hemminki</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>F&#246;rsti</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Bermejo</snm>
                  <fnm>JL</fnm>
               </au>
            </aug>
            <source>PLoS ONE</source>
            <pubdate>2008</pubdate>
            <volume>3</volume>
            <fpage>e2504</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">2423486</pubid>
                  <pubid idtype="pmpid" link="fulltext">18560565</pubid>
                  <pubid idtype="doi">10.1371/journal.pone.0002504</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B3">
            <title>
               <p>Bayes factors for genome-wide association studies: comparison with P-values</p>
            </title>
            <aug>
               <au>
                  <snm>Wakefield</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Genet Epidemiol</source>
            <pubdate>2009</pubdate>
            <volume>33</volume>
            <fpage>79</fpage>
            <lpage>86</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1002/gepi.20359</pubid>
                  <pubid idtype="pmpid" link="fulltext">18642345</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B4">
            <title>
               <p>Frequency in relatives for an all-or-none trait</p>
            </title>
            <aug>
               <au>
                  <snm>James</snm>
                  <fnm>JW</fnm>
               </au>
            </aug>
            <source>Ann Hum Genet</source>
            <pubdate>1971</pubdate>
            <volume>35</volume>
            <issue>1</issue>
            <fpage>47</fpage>
            <lpage>49</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmpid">5106369</pubid>
                  <pubid idtype="doi">10.1111/j.1469-1809.1956.tb01377.x</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B5">
            <title>
               <p>MCMCpack: (MCMC) Package</p>
            </title>
            <aug>
               <au>
                  <snm>Martin</snm>
                  <fnm>AD</fnm>
               </au>
               <au>
                  <snm>Quinn</snm>
                  <fnm>KM</fnm>
               </au>
            </aug>
            <url>http://mcmcpack.wustl.edu/wiki/index.php/Main_Page</url>
         </bibl>
         <bibl id="B6">
            <title>
               <p>The Bagplot: a Bivariate boxplot</p>
            </title>
            <aug>
               <au>
                  <snm>Rousseeuw</snm>
                  <fnm>PJ</fnm>
               </au>
               <au>
                  <snm>Ruts</snm>
                  <fnm>I</fnm>
               </au>
               <au>
                  <snm>Tukey</snm>
                  <fnm>JW</fnm>
               </au>
            </aug>
            <source>Am Stat</source>
            <pubdate>1999</pubdate>
            <volume>53</volume>
            <fpage>382</fpage>
            <lpage>387</lpage>
            <xrefbib>
               <pubid idtype="doi">10.2307/2686061</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B7">
            <title>
               <p>aplpack: Another Plot PACKage</p>
            </title>
            <aug>
               <au>
                  <snm>Wolf</snm>
                  <fnm>P</fnm>
               </au>
            </aug>
            <url>http://www.wiwi.uni bielefeld.de/~wolf/software/aplpack/</url>
         </bibl>
      </refgrp>
   </bm>
</art>
