Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Comparison of the latest commercial short and long oligonucleotide microarray technologies

BMC Genomics volume 7, Article number: 51 (2006) Cite this article

Abstract

Background

We compared the relative precision and accuracy of expression measurements obtained from three different state-of-the-art commercial short and long-oligonucleotide microarray platforms (Affymetrix GeneChip™, GE Healthcare CodeLink™ and Agilent Technologies). The design of the comparison was chosen to judge each platform in the context of a multi-project program.

Results

All wet-lab experiments and raw data acquisitions were performed independently by each commercial platform. Intra-platform reproducibility was assessed using measurements from all available targets. Inter-platform comparisons of relative signal intensities were based on a common and non-redundant set of roughly 3,400 targets chosen for their unique correspondence toward a single transcript. Despite many examples of strong similarities we found several areas of discrepancy between the different platforms.

Conclusion

We found a higher level of reproducibility from one-color based microarrays (Affymetrix and CodeLink) compared to the two-color arrays from Agilent. Overall, Affymetrix data had a slightly higher level of concordance with sample-matched real-time quantitative reverse-transcriptase polymerase chain reaction (QRT-PCR) data particularly for detecting small changes in gene expression levels.

Background

For the last decade, genome-wide expression analysis technologies have been rapidly evolving. With the growing number of large data sets derived from a variety of technological platforms (commercial and "homemade" spotted arrays) cross-laboratory studies are becoming more challenging. These kind of studies are greatly effected by differences in target type (cDNA versus short or long oligonucleotide), target production and design, the efficiencies of target labeling and sub-optimal array production/hybridization protocols [1–4]. These effects are compounded in studies involving clinically derived tissue samples such as human tumor biopsies. Efforts have been made to overcome these limitations by proposing to conform to standardize experimental conditions and procedural documentation [5]. Recently, Dobbin et al. demonstrated that by using standardized conditions and a single technological platform (Affymetrix HG-U133A), a cancer-related (RNA from tumor tissue and cell lines), multi-laboratory expression profiling study was feasible [6]. Mathematical approaches [7–10] and sequence-based mapping between platforms [11–13] have also been developed to reduce inter-technological differences in order to maximize cross-platform studies.

Nevertheless, increasing the precision and accuracy of a given microarray study will ultimately increase the yield of meaningful biological information and thus reduce the cost of genome-based biomedical discovery. Since commercial expression profiling technologies, which typically offer a higher precision compared to homemade arrays, are not only becoming more abundant but also more affordable comparative studies are useful in making a cost-efficient choice. Several of these types of studies have been published [14–22]. However, due to the rapid pace of technological development, the relevance of many of the published comparisons are quickly brought into question. Moreover, these studies have either offered conflicting conclusions or were biased by competing interests [19, 22] and most have not been validated with a non-microarray-based approach, such as quantitative reverse-transcriptase PCR (QRT-PCR). Recent papers by Bammler et al. and Irizarry et al. offer a multi-laboratory comparisons of different technologies [23, 24]. Bammler et al. compared 12 technological platforms and 7 different laboratories, and found that standardized protocols combined with comparisons limited to biological themes greatly increased inter-laboratory and inter-platform reproducibility. Irizarry et al. compared different dilutions of 3 cell lines analyzed at 10 different laboratories and 3 different platforms (Affymetrix oligo arrays, 2-color oligo arrays and 2-color cDNA arrays where only one platform was employed by a given lab) and found that overall level of accuracy and precision of a given technological platform are greatly affected by the differences in lab performance. Though useful, these studies do not offer a clear choice between current genome-wide, transcriptome technologies for studying human disease in the context of a centralized, multi-project (theme) program.

We present here, a comparison of the precision and accuracy of the latest and most exploited commercial high-density, pan-genomic short- and long-oligonucleotide reporter technologies. We compared data derived "in-house" from a common source of RNAs from 3 different human cell lines between Affymetrix HG-U133 plus 2.0 GeneChip™ (one-color), GE Healthcare Codelink™ (Amersham) (one-color) and Agilent Technologies 44 k whole human genome arrays (two-color). This comparison was conducted for the multi-project transcriptome program "Cartes d'Identite des Tumeurs" (CIT,[25]) launched by France's Ligue Contre le Cancer as well as for the Canceropole, Ile-de-France [26], France's cancer research network. The aim of these programs is to provide a standardized method for centralized, large-scale transcriptome analyses of a great diversity of tumors covering the maximal number of genes of interest for intra- and inter-cancer research projects. Keeping this aim in mind, we standardized the one-color with two-color data by including a common reference sample. Designs that optimize studies using two-color arrays combined with a limited number of samples (e.g. loop design, [27]) were not considered.

Results and discussion

All raw data sets were generated by each respective commercial entity (labeling, hybridization, image analyses and pre-processing data filtering) from a common source of biologically different RNAs (MCF-7, Jurkat, and Batt P12 cell lines). Data from a pre-release version of a fourth commercial platform ("PX", one-color, 60-mer oligonucleotide-microarray) was also included in and limited to the evaluation of the level of discordance between the target measurements between the 3 platforms. The term "available targets" hereafter refers to target measurements that were not filtered out by a given platform. Different lists of targets (spotted or synthesized oligonucleotide located on the arrays) were used for the following different aspects of the analyses: all available target measurements were used for the comparisons of intra-platform reproducibility (precision); all available targets out of a common lists of 3,471 targets ("3.4 K" set) were used for all inter-platform comparisons of the accuracy of target measurement (agreement in expression levels and statistical tests results); a sub-list of 14 genes were used for the comparison of microarray data and quantitative QRT-PCR data.

Comparison of the precision of expression measurements

In order to compare the precision of the measurements derived from each platform we used the following three criteria: 1. the percentage of targets having a 2-fold difference (or higher) of expression measurements obtained between each pair-wise combination of replicate slides; 2. the distribution of inter-slide (intra-cell line) variation measures; 3. inter-slide (intra-cell line) correlation of expression profiles analyzed for 4 intensity quantiles. One of the major observations from this study is that the data from all platforms were highly reproducible. We found that one-color platforms globally yielded lower variation measures compared to the two-color platform of Agilent (Fig. 1). We found the lowest number of 2-fold differences between replicate samples from the Affymetrix data (Fig. 1A) and the lowest CVs from Amersham. Although we found higher SDs measurements of the log2-ratios for one-color platforms compared to their corresponding CVs this transformation did not change the overall degree of variation relative to the two-color data obtained from Agilent. As another evaluation of intra-platform precision we calculated correlation coefficients (Pearson coefficient) stratified by intensity quantiles (Q1 to Q4, see Methods). A summary of the maximum (max) and minimum (min) correlations for a given quantile are shown in Figure 1C. We found the highest maximal level of correlation for the majority of targets from the Amersham data while Affymetrix consistently (difference between min and max) yielded a higher correlation for lower intensities (Q1 and Q2). The number of data points per quantile were not the same for each platform (roughly 12.6 K, 9.9 K and 3.9 K for Affymetrix, Agilent and Amersham, respectively), however, re-computing the correlation per quantile based on 1.6 K evenly distributed data points per quantile did not change the results (not shown). Taken altogether these results show that Affymetrix data was found to have a slightly overall higher level of precision compared to the other platforms.

Figure 1
figure 1

Boxplots of the distributions of the inter-slide, intra-cell line log2-ratios (y axis) calculated between cell line replicate pairs are shown in A (white: BattP12; yellow: Jurkat; green: MCF7, pink: REF). All pair-wise comparisons for each platform are shown. To the right is a summary (minimum (min %) and maximum (max %)) of the relative number of targets having a fold change superior to 2 (-1.0 > log2-ratio > 1.0) between replicate samples. B shows the box plots of the distributions of the average inter-array, intra-cell line variation measured as the coefficient of variation (CV) measured for the log2 intensities (Amersham and Affymetrix) or standard deviation (SD) of log2-ratios (Amersham (Amer.), Affymetrix (Affy.) and Agilent). To the right is a table of the 50th (median) and 95th percentile values obtained from different measures of variation between replicate slides (SD of log2-ratios and CV of log2-intensities). Minimum (dotted lines) and maximum (filled lines) intra-quantile correlation of expression values for each platform are shown in C. The values were based on log2-ratios. All correlation coefficients (Pearson correlation coefficient plotted on the y-axis) were calculated for all pair-wise comparisons between replicates data for the same cell line. Quantile attribution was based on the median intensities across all cell lines for a given platform where Q1 = lowest 25% mean intensities targets and Q4 = the 25% highest mean intensities targets (see Methods). Color code is as follows: green: Affymetrix; red: Amersham; black: Agilent.

Full size image

Comparison of the accuracy of expression measurements

The evaluation of platform accuracy was based on the following criteria: 1. concordance between the expression levels of commonly represented targets on each array type; 2. agreement in the identification of genes discriminating the three cell lines; 3. concordance of relative expression compared to data obtained from QRT-PCR for subset of 14 genes. The first 2 evaluations were based on the available targets from the 3.4 K set. This 3.4 K set was specifically chosen in order to reduce the confounding effects of multiplicity (N targets: transcript (RefSeq identifier) relationship, see Methods). This approach afforded the most straightforward study of the concordance across the different platforms and did not favor platforms with high feature-to-target and/or target-to-transcript ratios. Moreover, this 3.4 K set of targets is representative, at the array feature-intensity level, of overall target measurements for each array type. Roughly 25% of the available 3.4 K targets were attributed to each of the 4 intensity quantile bins for each platform (quantile bins are based on all available targets, see Methods and [Additional file 2]). Expression values above the filtering thresholds were available from all platforms for 2,218 out of the 3.4 K common targets.

Similarity in relative expression levels

Cluster analysis of log2-ratio data from all platforms yielded clusters of samples grouped according to the three cell lines showing a high overall correlation between the 4 platforms (high minimal intra-platform (0.96) and inter-platform (0.72) correlation, see Fig. 2). We observed that one of the Amersham Jurkat samples clustered slightly apart from the other two Jurkat samples, consistent with the heterogeneity in the reproducibility of the Amersham observed in Figure 1. However, visual inspection of the array images, overall distributions of the data (boxplots and MA plots, not shown) and the equal percentage of available data points (56% – 61%) for Jurkat samples relative to the other cell line samples (53% – 62%) did not provide an explanation for this observation.

Figure 2
figure 2

Clustering of all samples based on log2-ratio data of 3.4 K common transcripts is shown in A. The dendrogram shows three major clusters of samples indicated by red (Batt P12 samples), blue (MCF7 samples) and green (Jurkat samples). Pearson correlation coefficients corresponding to the maximum and minimum correlation nodes in the dendrogram shown in A (intra- and inter-platform correlations) are given in B. Since the platforms detected a different number of targets from slide to slide, all correlations were calculated using the maximal number of targets detected in common between each pair-wise combination (complete, pair-wise correlation).

Full size image

Nevertheless, we found a significant number of aberrant target measurements unique to particular platform. Here the data from PX was included in order to confirm the discordance in target measurement observed for a particular platform. We found that while most of the 2,218 targets had a similar overall expression values between the 4 platforms 965 targets were found to be discordant across the different platforms (Fig. 3A). Of these, we found 271 targets that were discordant uniquely for either Affymetrix, Agilent or Amersham (difference of at least 2 intensity quantile attributions between 1 platform and the other 3). Of the three platforms, Agilent contributed the lowest number of discordant expression values (32) compared to Affymetrix and Amersham (66 and 117, respectively). The discordant targets found for Agilent were dispersed evenly into three Agilent quantile bins (Q1, Q2 and Q3–4) whereas 91% of the discordant targets unique to Amersham in its lowest 2 intensity quantiles (Q1 and Q2) suggesting a problem of sensitivity (Fig. 3B). We found that 60% of the discordant targets found for Affymetrix were in its Q3 and Q4 quantiles suggesting a more fundamental problem in target identification.

Figure 3
figure 3

(A) Summary table of a comparison of the available targets out of the 3.4 K for each platform. 1 The number of targets out the 3.4 K common set that were available for at least one sample for a given platform. 2 The number of targets out the 3.4 K common set that were commonly available for at least one sample for all platforms. 3The number of targets that were attributed with a similar intensity quantiles nomenclature (identical or off by 1 quantile, see Methods) for Affymetrix, Amersham, Agilent and PX. 4 The number of targets that were attributed with a different intensity quantile (off by 2 quantiles) for at least 2 platforms. 5 The number of targets attributed with a different intensity quantile (off by 2 quantiles) for a given platform compared to the other 3 platforms. (B) The fraction of uniquely discordant targets by quantile for each platform with the following color code: white: Q1; yellow: Q2; orange: Q3; red: Q4. The numbers indicate the number of targets that fell into that particular quantile specifically for that particular platform and that should have fallen into another quantile based on the agreement of quantile attribution for those targets between the other platforms.

Full size image

Differences in target availability and discordant expression values between the platforms may be related to the differences in feature design, sequence and their placement along the target transcript. Recent sequence-based identification studies have suggested that annotations attributed to target sequence is a non-negligible source of discrepancy between technologies [13, 28]. Using a sequence-based identification for Affymetrix probe sets on the HG-U133 plus 2.0 arrays Harbig et al. not only re-named over 20,000 probe sets but flagged over 5,000 probe sets that specifically hybridize to either more than one splice variants (multiplicity problem) or transcripts from different loci (specificity problem). We should note that none of the Affymetrix probe sets flagged by Harbig et al. were among the 3.4 K set. Unfortunately, comparisons between the different platforms, at this level, were not feasible as feature location and sequence information are publicly available for only Affymetrix and Agilent.

Agreement in the identification of differentially expressed genes

Starting from all available targets out of the 3.4 K set for each platform we performed independent ANOVA and t test analyses. From the ANOVA analyses, we obtained 1,696, 1,727 and 1,781 significant targets (p < 0.001) for Affymetrix, Amersham and Agilent, respectively (Table 1). Based on all 280 possible multivariate permutations for a given platform we found that the probability of obtaining these results by chance if there are no real differences between the classes was 0.00357. We found a lower percentage of the total amount of "ANOVA targets" (roughly 4 – 7.5%) attributed with intra-platform quantile Q1 for all platforms. Affymetrix data yielded fewer ANOVA targets (12%) in its Q1 and Q2 bins compared to the 22% and 32% found for Agilent 44 K and Amersham, respectively. We found roughly the same percentage of ANOVA targets (59–60%) that had similar levels of expression for each respective platform (consensus quantiles cQ1 to cQ4, see Methods). Of these, approximately the same low proportion (roughly 2.0%) corresponded to low-expressing transcripts (a cQ inferior to cQ2.0). Overall, these results suggest that there is a common limitation of the 3 technologies to detect differences in expression of the lowest expressing genes.

Table 1 Summary of discriminating targets
Full size table

Figure 4 summarizes the agreement or overlap of the ANOVA targets as well as for the targets distinguishing MCF7 and Batt P12 samples identified for the 3 platforms. A total of 2,362 and 2,135 discriminating targets were found for at least 1 out of the 3 platforms based on ANOVA and t tests, respectively. While a considerable number of targets were unique to one or two platforms we observed that 1,096 ANOVA targets were in common between all 3 platforms. Many of the targets correspond to known cancer genes such as NFkB1, BUB1B, CDK7, CCNB2, CCND3 and CXCR4. The expression profiles of the 1,096 common ANOVA targets were highly correlative between the platforms. Similar to what we observed in Figure 2, a pan-platform cluster analysis based on these targets yielded 3 major sample clusters corresponding to the 3 cell lines [see Additional file 5]. Within each of the 3 major cell line clusters, samples were grouped according to platform. Cluster analysis based on the expression profiles of the 1,096 common ANOVA targets available in a larger variety of tissue samples yielded biologically relevant sample groups, consistent with the 3 major clusters observed in Figure 4A.

Figure 4
figure 4

Venn diagram showing the overlap of 2,362 targets (the union of all ANOVA targets) that were considered significantly different in a F test (p < 0.001) between the cell lines calculated for at least one platform (left). It must be noted that the numbers indicating the targets unique to a platform or common to 2 platforms include targets that may have been filtered out by the other platform(s) during the preprocessing. See Table 2 for a summary of platform-unique targets that were available (not filtered) for all platforms. The Venn diagram to the right shows the overlap of the 2,135 targets discriminating MCF7 and Batt P12 samples (p < 0.001, union of all 3 platform results) for at least one platform.

Full size image

Based on the ANOVA results we found the least amount of commonality from the Amersham data (Table 2). Of the 287 targets unique to Amersham, 171 were available (not filtered) for all platforms, 28 of which were expressed at high levels (not shown) and 47 yielded p values > 0.05 for both Affymetrix and Agilent. Moreover, 69% (157 out of 228 targets) of the ANOVA targets found by Agilent and Affymetrix yielded p values superior to 0.05 for Amersham. Limiting the tests to the identification of genes that discriminate MCF7 and Batt P12 samples we observed a much lower number of genes (558) common to all 3 different platforms. We also observed a higher level of discordance with the Agilent data. Taking all tests into consideration, we found a slightly higher level of agreement (least amount of discordance) in the identification of discriminating genes from the Affymetrix data.

Table 2 Summary of discordance of discriminating targets
Full size table

Evaluation of relative expression measures compared to QRT-PCR data

In order to address the discrepancies in accuracy mentioned above we analyzed 14 genes (plus one control gene) using real-time QRT-PCR. These genes passed the pre-processing filters in at least one out all of the samples studied. In addition, these genes were selected based on either 1. complete concordance (CCNB1) or discordance between either their measured expression levels (CASP5, CXCL10, MAPK4, RAB17, RME8 and TMPRSS5, and WNT10B) and/or being identified as a discriminating gene between the different platforms (ALG8, CASP5, CXCL10, MAPK4, RAG2, THEM2, TMPRSS5); 2. three genes (ERBB2, RPS6KB1, BCAS2) known to be highly expressed in MCF7 cells [29–32]. ERBB2 and RPS6KB1 corresponded to multiple targets to a different extent for the 3 platforms and were therefore excluded from the overall correlation calculation between RT-PCR and array data as well as from the all gene-wise comparison (see below). The 14 genes covered a large dynamic range of expression levels (maximal Ct = 37.85 (low relative level of expression); minimal Ct = 20.60 (high relative level of expression), see [Additional file 4] for all array data and sample-matched QRT-PCR Ct values for the corresponding genes).

Despite a high overall correlation between array and RT-PCR data (Table 3) we found several discrepancies between the different platforms. Based on the RT-PCR data we detected 12 out of the 14 genes in all 4 samples (3 cell lines and the REF sample). RAG2 was out of the limit of detection in BattP12 and MCF7 samples while detected in Jurkat samples. RAG2 was equally filtered out for BattP12 and MCF7 in 3 out of the 4 replicate Agilent arrays and all of the replicate Amersham arrays, whereas this gene was found to be a "unique ANOVA" target for Affymetrix. CASP5 was below the level of detection in Jurkat but yielded high Ct values in BattP12 and MCF7 samples. However, for the Agilent data, CASP5 was detected by all arrays barring one BattP12 replicate array. CASP5 was considered a low expressing gene for in all Affymetrix arrays (Q2) and Amersham arrays (Q1). It should be noted that the data provided by Agilent was derived from experiments in which about 1/10 of the amount of material was used for a hybridization (0.75 μg of cRNA compared 10 μg of cRNA used by the other platforms) in accordance with their recommended protocol. As expected, RT-PCR values for ERBB2, RPS6KB1, BCAS2 were relatively higher in MCF7 compared to the other samples. Similarly, all 3 platforms yielded consistently high relative expression values for RPS6KB1 and BCAS2. Array data for ERBB2, however, were found to be equally inconsistent from all 3 platforms.

Table 3 Correlation of platform data and sample-matched QRT-PCR data
Full size table

A gene by gene analysis of the expression relative to the reference sample revealed a high agreement between array data and QRT-PCR data (Table 4). This observation was independent of the overall expression level as assessed by the average Ct values for each gene. Here, 'agreement' refers to the same direction of relative expression (over or under-expressed) for a gene in a given cell line relative to the reference sample. We found that Affymetrix yielded a slightly higher overall score compared with the other 2 platforms. A recent paper studying the correlation between Affymetrix HG-U133A data (normalized using either RMA or MAS5.0) from 48 genes and QRT-PCR data found an equally high correlation (r = 0.89) with both methods for roughly 85% of the genes [33]. They found poor correlations with genes that were either expressed at low levels or those for whose probe sets were not adequately designed. Based on our analysis we did not observe an expression-level dependence on the correlation between Affymetrix, Agilent and Amersham array data and the QRT-PCR data.

Table 4 Gene by gene concordance of relative expression levels between platform data and sample-matched QRT-PCR data
Full size table

We extended this analysis to an all gene pair-wise comparison of relative expression levels as a function of fold change (FC). For this, the relative expression levels (ratios) between all pairs of genes across all 3 cell lines from the QRT-PCR data were calculated. Values that were filtered out by either Agilent or Amersham were not included in the comparison and thus we did not penalize these 2 platforms for missing values. A total of 3,321 and 3,828 combinations were considered for ratio and single intensity array data, respectively (see Methods). Each gene pair combination was attributed to 1 out of 9 FC bin depending on its QRT-PCR value. We then analyzed the concordance of log2-ratio (cell line/REF) array data to -ΔΔCt QRT-PCR data by -ΔΔCt FC bins. To optimize comparisons with single intensity platforms we also compared -ΔCt QRT-PCR values to log2-intensity values as a function of -ΔCt FC bins. Figure 5 shows box plots of the distributions of the ratios obtained from array data of the gene pair combinations per FC bin. Although we observe a general trend of array FC levels concordant with the QRT-PCR data, transforming single intensity data into log2-ratios resulted in a marked reduction in the range of array FCs (compare Fig. 5A with D and B with E for Affymetrix and Amersham, respectively). Based on log2-ratio array data and -ΔΔCt data we observed a closer relationship of Agilent FCs to QRT-PCR FCs (Fig 5C). We also observed that for extreme FCs calculated based on QRT-PCR (superior to or equal to log2 FC of 5.0) 25% of the FCs obtained from Amersham ratio data were below 0. If, however, we base our assessment of single-intensity platforms on single-intensity data we see a much closer correlation with QRT-PRC data, particularly for Affymetrix which yielded a near linear relationship with QRT-PCR data ranging from the minimal to the maximal FC bin (Fig. 5E).

Figure 5
figure 5

Boxplots of the distributions of all the gene pair relative expression levels calculated across all cell lines for the different platforms. From a total number of 4,851 possible gene pair combinations based on the array measurements of 12 out of the 14 genes (excluding ERBB2 and RPS6KB1 and data points (RAG2 and CASP5) not available from QRT-PCR) in the 3 cell lines (3 replicate arrays each) a total number of 3,321 and 3,828 combinations were considered for ratio and single intensity array data, respectively. See [Additional file 4] for the number of possible versus available gene pair combinations for the QRT-PCR and array data, respectively. Combinations were then attributed to one of 9 different fold-change bins based on the -ΔΔCt (for A – C) or -ΔCt (D and E) values calculated from the QRT-PCR data with the following code (in bold) corresponding the following geneA/geneB log2-ratios (x) intervals: < -5: x < -5; -3: -5 = x < -1.25; -1: -1.25 = x < -0.75; -0.5: -0.75 = x < -0.25; 0: -0.25 = x < 0.25; 0.5: 0.25 = x > 1.25; 1: 0.25 = x > 1.25; 3: 1.25 = x > 5.0; > = 5: x = 5.0. For each gene pair combination we assessed the corresponding FCs either from the (1) array log2-ratio (cell line/REF) data (Affymetrix, Amersham, and Agilent, shown in A – C, respectively) or from (2) log2-intensities (Affymetrix and Amersham data only, shown in D and E).

Full size image

Conclusion

Our study compares the latest, state-of-the-art short and long oligonucleotide human-microarray commercial technologies. The results presented here were used for the program CIT, a centralized, multi-tumor program as well as for a similar program launched by the Canceropole Ile-de-France (France's cancer research network) in choosing a human genome-based microarray technological platform that can meet a high-throughput demand. Therefore, the design of the study was adapted to judge each company in the context of these types of programs. In this context, our results show that all platforms yielded reproducible and comparable data. Nevertheless, between the 3 technologies we found that one-color platforms were more precise while Affymetrix and Agilent were more concordant based on the agreement of expression measurements and identification of differentially expressed genes. In addition, Affymetrix was found to have a slightly higher sensitivity at detecting relative differences in gene expression levels (irrespective of the magnitude of change) and an overall higher level of concordance with the QRT-PCR data.

Methods

RNA samples and number of slides analyzed per platform

Human cell lines Jurkat (T cell acute lymphoblastic leukemia), MCF7 (breast cancer) were provided by INSERM U462, Institute Universitaire d'Hematologie, Hospital Saint Louis, Paris, France) and BattP12 (mesothelioma) was established and kindly provided by Dr. Marie-ClaudeJaurand (Université Paris XII, Paris, France). All cell lines were cultured in RPMI 1640 supplemented with 10% fetal calf serum, 10 U/ml penicillin, 100 μg/ml streptomycin and 2 mM L-glutamine. Cells were harvested during exponential phase growth and total RNAs were extracted as previously described [34]. Universal human reference RNA (REF, Stratagene) was recovered following manufacturer instructions. One hundred micrograms of each RNA were then purified using QIAGEN (QIAGEN S.A., Courtaboeuf, France) RNeasy mini kit, as describe in manufacturer's clean-up column protocol. All RNAs were aliquoted and stored at -80°C. Aliquots of the RNAs were analyzed by electrophoresis on a Bioanalyser 2100 (version A.02 S1292, Agilent Technologies, Waldbronn, Germany) and quantified using Nano Drop™ ND-1000 (Nyxor Biotech). Criteria for qualification was a 28 s/18 s ratio above 1.8, and an optical density at 260 nm and 280 nm ratio above 1.80. Between 2 – 25 μg per cell line along with 3 – 25 μg REF RNA were then sent to each platform (Affymetrix UK Ltd., High Wycombe, United Kingdom; Agilent Technologies, Waldbronn, Germany; GE Healthcare (Amersham), Freiberg, Germany).

Probe labeling, array hybridizations and image analyses

Barring Agilent, all platforms use a one-color labeling approach. Agilent arrays were co-hybridized with cell line samples and the reference sample. Each platform followed protocols that are publicly available at their respective web sites [35–37]. Briefly, each platform hybridized the following material: 10 μg fragmented cRNA, Affymetrix; 10 μg fragmented cRNA, Amersham; 0.75 μg cRNA labeled with Cy3 (cell line sample) and Cy5 (REF) from 3 independent labeling reaction per cell line, Agilent; 10 μg fragmented cRNA, PX. Raw data from the following were obtained and processed: 12 Affymetrix HG-U133 plus 2.0 GeneChip™ arrays (3 arrays per sample type independently labeled, March, 2004); 12 Agilent's "44 K whole genome" arrays (4 arrays per cell line (3 arrays for 3 independent labeling reactions plus one technical replicate, June 2004); 12 Amersham CodeLink™ UniSet Human 20 K Human arrays (3 slides per sample type labeled in batch, March, 2004); 8 PX arrays (2 slides per sample type labeled in batch, February, 2004). A summary of the relative representation of available public data bank identifiers for each array is given [see Additional file 1]. The annotation information was supplied by each platform at the time the experiment was conducted. Since the time of this analysis GE Healthcare has launched a new CodeLink Human Whole Genome Bioarray which is claimed to target roughly 45,000 well characterized human gene and transcript targets. All raw data and associated annotations are publicly available (acc.# E-MEXP-467) at ArrayExpress [38].

Data filtering and normalization

Filtering information with the aim of removing data obtained from non-viable targets (spotted or synthesized oligonucleotide) was provided by Amersham, Agilent and PX. Briefly, for Agilent, 20 different criteria were used to flag a specific target based on signal/noise ratio, spot morphology or homogeneity. For Amersham only spots with intensities above the negative control threshold (20% trim-mean of negative controls + 3 standard deviations using the trim-mean set) were included in the analysis. PX filtered targets based on a signal/noise threshold ratio of 3 and those called "not-detected" by their spot-detection software. The criteria used to flag targets were not imposed or suggested but rather derived from the respective platforms. We did not receive pre-processed or filtered data from Affymetrix. The following methods were used to normalize each data sets: robust multi-average (RMA) normalization and expression summary [39] for Affymetrix HG-U133 plus 2.0 raw data; median normalization (BRB-Array Tools v3.2 beta5.0) for Amersham CodeLink and PX raw, filtered data; lowess non-linear normalization [40] for Agilent raw, filtered data. Only available data from each platform were taken into consideration in our evaluation of platform discordance of expression measurements. When necessary, all single-intensity platform data (Affymetrix, Amersham and PX) were transformed into log2-ratios using the median value of the universal reference samples as the denominator.

Intensity quantile bin attribution

For each platform we attributed 1 out of 4 intra-platform intensity quantiles (Q1, ..., Q4) to each available targets out of all available targets per platform. The rank of the median intensities across all 3 cell lines for all targets were used to attribute an intensity quantile bin to a given target. Therefore targets in first quantile (Q1) have the 25% weakest expressed median intensities and Q4 corresponds to the targets having 25% strongest median intensities. We then determined the number of targets having similar inter-platform (consensus) quantile attributions (cQ1, ..., cQ4) between all 4 platforms. Here "similar" refers to a situation where the minimal and maximal quantile attributions to a given target doesn't differ more than 1 (e.g. min = Q1 and max = Q2; min = Q2 and max = Q3). Using the quantile information for each platform 1 of 7 consensus quantiles (cQ, mean of the original quantile attributions) was attributed to each of these targets using the following partitioning: cQ1 for targets with mean quantile attributions (Qmean) between 1–1.25; cQ1.5: Qmean = 1.5; cQ2: Qmean = 1.75 – 2.25; etc.). We also determined the number of targets having "discordant" quantile attributions unique to a given platform (min Q – max Q = 2 while "similar" for 3 out of the 4 platforms) as well as discordant between all platforms (min Q – max Q = 2 and not similar for 3 out of the 4 platforms (see [Additional file 2] for a list of the 3.4 K common RefSeq accession numbers as well as the original quantile and cQ attributions).

3.4 K common data set

In order to eliminate the problem of multiplicity (1: N and N: 1 relationships between targets and transcripts), only non-redundant targets (one feature per target ID) in which there was a 1 target: 1 transcript (RefSeq identifier) correspondence represented on the slide were considered (PX: 11,271 targets; Agilent: 10,363 targets; Amersham: 9,964; Affymetrix: 8,705 targets). Sequence-based mapping between the different platforms was not feasible as oligonucleotide sequence information was not available for each of the 4 platforms (only for Affymetrix and Agilent). We used the provided representative sequence identifier (Genbank and RefSeq accession number) to map each oligonucleotide to an Entrez Gene identifier that was available at the time (April 2004). We found that out of the 6,664 unique sequence identifiers that were found in common between the different platforms, 6,404 mapped to Entrez Gene identifiers. Only single transcripts associated with a Entrez Gene identifiers represented only once on the arrays (3,471 targets ("3.4 K set")) were used for direct comparisons of relative expression measurements. This set of 3.4 K targets were representative, at the feature-intensity level, for each array type (25% representation in each intensity-quantile bin (quantiles defined using all targets for each array type).

Statistical tests

To determine the genes that discriminate the different cell lines we performed independent ANOVA analyses (F tests) and t tests (MCF7 versus Batt P12) for the 3 platforms. All univariate t and F tests using BRB ArrayTools (v3.2 b5) using the log2 single-intensity data for Affymetrix and Amersham and log2-ratio data obtained for Agilent. "Discriminating targets" were determined using a nominal significance level of each univariate test of p < 0.001. The F test was based on comparing the differences in mean log2-intensities (or log2-ratios) between the 3 cell lines relative to the variation expected in the mean differences. Due to small sample population for each platform we used a random variance model for the univariate tests when distribution assumptions underlying this model were met [41]. These assumptions were satisfied for all platforms except for F tests conducted for the Affymetrix data (here, we used the within class variance calculated for each target).

Cluster analysis

For the clustering analysis shown in Figure 2, samples were clustered using R software (v2.0.1; package class v7.2.10) and the following parameters: complete linkage; distant metric = 1 – Pearson correlation (the distance measured between any two samples was calculated using the maximal number of common targets between the two samples). Though other inter-platform normalization methods and clustering methods were tested (z-score, quantile normalization), we found that only by using a common reference sample and transforming single intensity data into a log ratio enabled us to overcome the platform-dependent bias and observe cross-platform cell line-specific clusters.

Quantitative RT-PCR

Quantitative RT-PCR (QRT-PCR) reactions were performed as previously described [42] for each of 15 genes (see [Additional file 3] for gene list, sequences and position for each primer/probe set) using the same aliquots originally sent to each platform. Briefly, the reverse transcription was performed using 4 μg RNA in a final volume of 80 μl. For each set of primers and probe 2 μL of cDNA was diluted to total volume of 25 μL containing 12.5 μL Universal Master Mix (Applied Biosystems, Foster City, CA, USA), 0.3 μM of each primers and 0.2 μM Taqman® probe. After initial steps for 2 min at 50°C and 10 min at 95°C, 50 cycles at 95°C for15 sec and 60°C for 1 min were performed on an ABI Prism 7700 (Applied Biosystems, Foster City, CA, USA). Primers and Taqman® probes for the selected set of genes were chosen using Primer Express software (Applied Biosystems, Foster City, CA, USA) based on the primer-probe combinations prioritizing the 5' end of the transcript and in which the sense and anti-sense primers corresponded to 2 different exons separated by an intron of at least 500 bases. This yielded several potential combinations. The final combination for each gene was chosen based on thermodynamic criteria. All QRT-PCR reactions included in the analysis yielded amplification curves with ΔRN above 1.0, slopes between -3.1 and -3.8 and correlation coefficients above 0.98. Optimisation of each reaction was based on the performance of a given primer-pair/probe combination and the resulting standard curves from dilution series experiments (1:10 to 1:100,000 of cDNA from samples known to express each gene). Absence of a specific transcript in a given cell line (eg. RAG2 transcript expression in Batt P12 and MCF7 cells and CASP5 transcript expression in Jurkat cells) was assessed based on an absence of amplification in the corresponding QRT-PCR assay. For RAG2 and CASP5 transcripts, sensitivity was experimentally determined to be at 1:10,000 dilution of Jurkat cDNA, and 1:1,000 dilution of peripheral blood mononuclear cell (isolated from blood samples after ficoll purification) cDNA in water, respectively. Based on this dilution series we obtained an optimal slope (-3.68 for Rag2 and -3.43 for CASP5). Normalization of the Ct values was carried out by subtracting the Ct values of the control gene ABL1 yielding ΔCt values for each gene [43]. ΔΔCt values were then derived by subtracting each ΔCt by the ΔCt value obtained from the same gene in the REF sample.

For each cell line, the correlation coefficient (Pearson and Spearman) between each array data sample replicate and the corresponding QRT-PCR data were calculated (see Table 3), using 12 genes out of the 14 (ERBB2 and RPS6KB1 were excluded as there was several corresponding targets in the array data). The R function cor.test was used to calculate the coefficients and associated p values. To measure the concordance of relative expression of the different genes and cell lines two approaches were used. We compared the relative expression of all 14 genes in a given cell relative the reference samples. For this, we compared -ΔΔCt values for each gene in each cell line (42 data points) to the corresponding array ratios obtained as described above. For the all pair-wise gene-gene combination analysis (Fig. 5) we first attributed all the gene-gene ratios calculated across all cell lines based on the -ΔΔCt values calculated from the QRT-PCR data to 9 fold-change bins. From a total number of 4,851 possible gene pair combinations based on the array measurements of 12 out of the 14 genes (excluding ERBB2 and RPS6KB1 and data points (RAG2 and CASP5) not available from QRT-PCR) in the 3 cell lines (3 replicate arrays each) a total number of 3,321 and 3,828 combinations were considered for ratio and single intensity array data, respectively. The distribution of the array data corresponding to each set of combinations were compared by fold change bin. [Additional file 4] gives the sample-matched Ct values as well as for the log2-intensities for all genes from each platform.

References

  1. Bakay M, Chen YW, Borup R, Zhao P, Nagaraju K, Hoffman EP: Sources of variability and effect of experimental approach on expression profiling data interpretation. BMC Bioinformatics. 2002, 3: 4. Epub 2002 Jan 31.-10.1186/1471-2105-3-4.

    Article  Google Scholar 

  2. Ramdas L, Coombes KR, Baggerly K, Abruzzo L, Highsmith WE, Krogmann T, Hamilton SR, Zhang W: Sources of nonlinearity in cDNA microarray expression measurements. Genome Biol. 2001, 2: RESEARCH0047. Epub 2001 Oct 18.-10.1186/gb-2001-2-11-research0047.

    Article  Google Scholar 

  3. Dobbin KK, Kawasaki ES, Petersen DW, Simon RM: Characterizing dye bias in microarray experiments. Bioinformatics. 2005, 17: 17-

    Google Scholar 

  4. Woo Y, Affourtit J, Daigle S, Viale A, Johnson K, Naggert J, Churchill G: A comparison of cDNA, oligonucleotide, and Affymetrix GeneChip gene expression microarray platforms. J Biomol Tech. 2004, 15: 276-284.

    PubMed  PubMed Central  Google Scholar 

  5. Ball CA, Sherlock G, Parkinson H, Rocca-Sera P, Brooksbank C, Causton HC, Cavalieri D, Gaasterland T, Hingamp P, Holstege F, Ringwald M, Spellman P, Stoeckert CJJ, Stewart JE, Taylor R, Brazma A, Quackenbush J: Standards for microarray data. Science. 2002, 298: 539-10.1126/science.298.5593.539b.

    Article  PubMed  CAS  Google Scholar 

  6. Dobbin KK, Beer DG, Meyerson M, Yeatman TJ, Gerald WL, Jacobson JW, Conley B, Buetow KH, Heiskanen M, Simon RM, Minna JD, Girard L, Misek DE, Taylor JM, Hanash S, Naoki K, Hayes DN, Ladd-Acosta C, Enkemann SA, Viale A, Giordano TJ: Interlaboratory comparability study of cancer gene expression analysis using oligonucleotide microarrays. Clin Cancer Res. 2005, 11: 565-572.

    PubMed  CAS  Google Scholar 

  7. Culhane AC, Perriere G, Higgins DG: Cross-platform comparison and visualisation of gene expression data using co-inertia analysis. BMC Bioinformatics. 2003, 4: 59-10.1186/1471-2105-4-59.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Bloom G, Yang IV, Boulware D, Kwong KY, Coppola D, Eschrich S, Quackenbush J, Yeatman TJ: Multi-platform, multi-site, microarray-based human tumor classification. Am J Pathol. 2004, 164: 9-16.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  9. Wright G, Tan B, Rosenwald A, Hurt EH, Wiestner A, Staudt LM: A gene expression-based method to diagnose clinically distinct subgroups of diffuse large B cell lymphoma. Proc Natl Acad Sci U S A. 2003, 100: 9991-6. Epub 2003 Aug 4.. 10.1073/pnas.1732008100.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  10. Stevens JR, Doerge RW: Combining Affymetrix microarray results. BMC Bioinformatics. 2005, 6: 57-10.1186/1471-2105-6-57.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Carter SL, Eklund AC, Mecham BH, Kohane IS, Szallasi Z: Redefinition of Affymetrix probe sets by sequence overlap with cDNA microarray probes reduces cross-platform inconsistencies in cancer-associated gene expression measurements. BMC Bioinformatics. 2005, 6: 107-10.1186/1471-2105-6-107.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Mecham BH, Klus GT, Strovel J, Augustus M, Byrne D, Bozso P, Wetmore DZ, Mariani TJ, Kohane IS, Szallasi Z: Sequence-matched probes produce increased cross-platform consistency and more reproducible biological results in microarray-based gene expression measurements. Nucleic Acids Res. 2004, 32: e74.-10.1093/nar/gnh071.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Mecham BH, Wetmore DZ, Szallasi Z, Sadovsky Y, Kohane I, Mariani TJ: Increased measurement accuracy for sequence-verified microarray probes. Physiol Genomics. 2004, 18: 308-315. 10.1152/physiolgenomics.00066.2004.

    Article  PubMed  CAS  Google Scholar 

  14. Kuo WP, Jenssen TK, Butte AJ, Ohno-Machado L, Kohane IS: Analysis of matched mRNA measurements from two different microarray technologies. Bioinformatics. 2002, 18: 405-412. 10.1093/bioinformatics/18.3.405.

    Article  PubMed  CAS  Google Scholar 

  15. Li J, Pankratz M, Johnson JA: Differential gene expression patterns revealed by oligonucleotide versus long cDNA arrays. Toxicol Sci. 2002, 69: 383-390. 10.1093/toxsci/69.2.383.

    Article  PubMed  CAS  Google Scholar 

  16. Lee JK, Bussey KJ, Gwadry FG, Reinhold W, Riddick G, Pelletier SL, Nishizuka S, Szakacs G, Annereau JP, Shankavaram U, Lababidi S, Smith LH, Gottesman MM, Weinstein JN: Comparing cDNA and oligonucleotide array data: concordance of gene expression across platforms for the NCI-60 cancer cells. Genome Biol. 2003, 4: R82. Epub 2003 Nov 25.-

    Google Scholar 

  17. Kothapalli R, Yoder SJ, Mane S, Loughran TPJ: Microarray results: how accurate are they?. BMC Bioinformatics. 2002, 3: 22-32. 10.1186/1471-2105-3-22.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Jarvinen AK, Hautaniemi S, Edgren H, Auvinen P, Saarela J, Kallioniemi OP, Monni O: Are data from different gene expression microarray platforms comparable?. Genomics. 2004, 83: 1164-1168. 10.1016/j.ygeno.2004.01.004.

    Article  PubMed  CAS  Google Scholar 

  19. Hughes TR, Mao M, Jones AR, Burchard J, Marton MJ, Shannon KW, Lefkowitz SM, Ziman M, Schelter JM, Meyer MR, Kobayashi S, Davis C, Dai H, He YD, Stephaniants SB, Cavet G, Walker WL, West A, Coffey E, Shoemaker DD, Stoughton R, Blanchard AP, Friend SH, Linsley PS: Expression profiling using microarrays fabricated by an ink-jet oligonucleotide synthesizer. Nat Biotechnol. 2001, 19: 342-347. 10.1038/86730.

    Article  PubMed  CAS  Google Scholar 

  20. Tan PK, Downey TJ, Spitznagel ELJ, Xu P, Fu D, Dimitrov DS, Lempicki RA, Raaka BM, Cam MC: Evaluation of gene expression measurements from commercial microarray platforms. Nucleic Acids Res. 2003, 31: 5676-5684. 10.1093/nar/gkg763.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  21. Yauk CL, Berndt ML, Williams A, Douglas GR: Comprehensive comparison of six microarray technologies. Nucleic Acids Res. 2004, 32: e124.-10.1093/nar/gnh123.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Shippy R, Sendera TJ, Lockner R, Palaniappan C, Kaysser-Kranich T, Watts G, Alsobrook J: Performance evaluation of commercial short-oligonucleotide microarrays and the impact of noise in making cross-platform correlations. BMC Genomics. 2004, 5: 61-76. 10.1186/1471-2164-5-61.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Bammler T, Beyer RP, Bhattacharya S, Boorman GA, Boyles A, Bradford BU, Bumgarner RE, Bushel PR, Chaturvedi K, Choi D, Cunningham ML, Deng S, Dressman HK, Fannin RD, Farin FM, Freedman JH, Fry RC, Harper A, Humble MC, Hurban P, Kavanagh TJ, Kaufmann WK, Kerr KF, Jing L, Lapidus JA, Lasarev MR, Li J, Li YJ, Lobenhofer EK, Lu X, Malek RL, Milton S, Nagalla SR, O'Malley J P, Palmer VS, Pattee P, Paules RS, Perou CM, Phillips K, Qin LX, Qiu Y, Quigley SD, Rodland M, Rusyn I, Samson LD, Schwartz DA, Shi Y, Shin JL, Sieber SO, Slifer S, Speer MC, Spencer PS, Sproles DI, Swenberg JA, Suk WA, Sullivan RC, Tian R, Tennant RW, Todd SA, Tucker CJ, Van Houten B, Weis BK, Xuan S, Zarbl H: Standardizing global gene expression analysis between laboratories and across platforms. Nat Methods. 2005, 2: 351-6. Epub 2005 Apr 21.. 10.1038/nmeth0605-477a.

    Article  PubMed  Google Scholar 

  24. Irizarry RA, Warren D, Spencer F, Kim IF, Biswal S, Frank BC, Gabrielson E, Garcia JG, Geoghegan J, Germino G, Griffin C, Hilmer SC, Hoffman E, Jedlicka AE, Kawasaki E, Martinez-Murillo F, Morsberger L, Lee H, Petersen D, Quackenbush J, Scott A, Wilson M, Yang Y, Ye SQ, Yu W: Multiple-laboratory comparison of microarray platforms. Nat Methods. 2005, 2: 345-50. Epub 2005 Apr 21.. 10.1038/nmeth756.

    Article  PubMed  CAS  Google Scholar 

  25. . [http://www.ligue-cancer.net/article.php3?id_article=42]

  26. . [http://www.canceropole-iledefrance.com]

  27. Churchill GA: Fundamentals of experimental design for cDNA microarrays. Nat Genet. 2002, 32: 490-495. 10.1038/ng1031.

    Article  PubMed  CAS  Google Scholar 

  28. Harbig J, Sprinkle R, Enkemann SA: A sequence-based identification of the genes detected by probesets on the Affymetrix U133 plus 2.0 array. Nucleic Acids Res. 2005, 33: e31.-10.1093/nar/gni027.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Barlund M, Forozan F, Kononen J, Bubendorf L, Chen Y, Bittner ML, Torhorst J, Haas P, Bucher C, Sauter G, Kallioniemi OP, Kallioniemi A: Detecting activation of ribosomal protein S6 kinase by complementary DNA and tissue microarray analysis. J Natl Cancer Inst. 2000, 92: 1252-1259. 10.1093/jnci/92.15.1252.

    Article  PubMed  CAS  Google Scholar 

  30. Brandes LJ, Hermonat MW: Receptor status and subsequent sensitivity of subclones of MCF-7 human breast cancer cells surviving exposure to diethylstilbestrol. Cancer Res. 1983, 43: 2831-2835.

    PubMed  CAS  Google Scholar 

  31. Nagasaki K, Maass N, Manabe T, Hanzawa H, Tsukada T, Kikuchi K, Yamaguchi K: Identification of a novel gene, DAM1, amplified at chromosome 1p13.3-21 region in human breast cancer cell lines. Cancer Lett. 1999, 140: 219-226. 10.1016/S0304-3835(99)00091-9.

    Article  PubMed  CAS  Google Scholar 

  32. Maass N, Rosel F, Schem C, Hitomi J, Jonat W, Nagasaki K: Amplification of the BCAS2 gene at chromosome 1p13.3-21 in human primary breast cancer. Cancer Lett. 2002, 185: 219-223. 10.1016/S0304-3835(02)00286-0.

    Article  PubMed  CAS  Google Scholar 

  33. Dallas PB, Gottardo NG, Firth MJ, Beesley AH, Hoffmann K, Terry PA, Freitas JR, Boag JM, Cummings AJ, Kees UR: Gene expression levels assessed by oligonucleotide microarray analysis and quantitative real-time RT-PCR - how well do they correlate?. BMC Genomics. 2005, 6: 59-10.1186/1471-2164-6-59.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Chomczynski P, Sacchi N: Single-step method of RNA isolation by acid guanidinium thiocyanate-phenol-chloroform extraction. Anal Biochem. 1987, 162: 156-159. 10.1016/0003-2697(87)90021-2.

    Article  PubMed  CAS  Google Scholar 

  35. . [http://www.chem.agilent.com]

  36. . [http://www4.amershambiosciences.com]

  37. . [http://www.affymetrix.com/support/technical/manual/expression_manual.affx]

  38. . [http://www.ebi.ac.uk/arrayexpress/]

  39. Bolstad BM, Irizarry RA, Astrand M, Speed TP: A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics. 2003, 19: 185-193. 10.1093/bioinformatics/19.2.185.

    Article  PubMed  CAS  Google Scholar 

  40. Yang YH, Dudoit S, Luu P, Lin DM, Peng V, Ngai J, Speed TP: Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Res. 2002, 30: e15.-

    Article  PubMed  PubMed Central  Google Scholar 

  41. Wright GW, Simon RM: A random variance model for detection of differential gene expression in small microarray experiments. Bioinformatics. 2003, 19: 2448-2455. 10.1093/bioinformatics/btg345.

    Article  PubMed  CAS  Google Scholar 

  42. Gabert J, Beillard E, van der Velden VH, Bi W, Grimwade D, Pallisgaard N, Barbany G, Cazzaniga G, Cayuela JM, Cave H, Pane F, Aerts JL, De Micheli D, Thirion X, Pradel V, Gonzalez M, Viehmann S, Malec M, Saglio G, van Dongen JJ: Standardization and quality control studies of 'real-time' quantitative reverse transcriptase polymerase chain reaction of fusion gene transcripts for residual disease detection in leukemia - a Europe Against Cancer program. Leukemia. 2003, 17: 2318-2357. 10.1038/sj.leu.2403135.

    Article  PubMed  CAS  Google Scholar 

  43. Beillard E, Pallisgaard N, van der Velden VH, Bi W, Dee R, van der Schoot E, Delabesse E, Macintyre E, Gottardi E, Saglio G, Watzinger F, Lion T, van Dongen JJ, Hokland P, Gabert J: Evaluation of candidate control genes for diagnosis and residual disease detection in leukemic patients using 'real-time' quantitative reverse-transcriptase polymerase chain reaction (RQ-PCR) - a Europe against cancer program. Leukemia. 2003, 17: 2474-2486. 10.1038/sj.leu.2403136.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgements

This work is part of the "Carte d'Identité des Tumeurs" (CIT) program initiated, developed and funded by the Ligue Nationale Contre le Cancer [25]. We thank Jacqueline Godet, scientific director of the Ligue Nationale Contre le Cancer, Jacqueline Metral, CIT project coordinator. Finally, we would like to warmly thank GE Healthcare (Amersham Biosystems), Agilent Technologies and Affymetrix, Inc for their kind participation in this study.

Author information

Authors and Affiliations

  1. Programme Cartes d'Identité des Tumeurs (CIT), Ligue Nationale Contre Le Cancer, Paris, France

    Aurélien de Reyniès, Daniela Geromin, Fabien Petel, Philippe Dessen, François Sigaux & David S Rickman

  2. INSERM U462 'Lymphocyte et Cancer', Institut Universitaire d'Hematologie, Hospital Saint Louis, Paris, France

    Daniela Geromin, Jean-Michel Cayuela & François Sigaux

  3. Genetics and Oncology, UMR 8125 CNRS, Institute Gustave Roussy, Villejuif, France

    Philippe Dessen

Authors
  1. Aurélien de Reyniès
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniela Geromin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jean-Michel Cayuela
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fabien Petel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Philippe Dessen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. François Sigaux
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. David S Rickman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David S Rickman.

Additional information

Authors' contributions

AdR: participated in the conception of analytical design, the analysis of the data and written text; DG: QRT-PCR experiments of the 15 genes, primer/probe design; JMC: oversaw QRT-PCR experiments of the 15 genes, primer/probe design; FP: data re-formatting and submission to EBI; PD: mapping of the platform target identifiers to public accession numbers and definition of the number of transcripts corresponding to each target for each platform, participated in the evaluation and interpretation of the results; FS: Director of the CIT program; initiated the comparison and participated in the evaluation and interpretation of the results; DSR: guided and participated in the analysis and conception of the analytical design, responsible for the majority of the written text; liaison between each platform and all authors.

Electronic supplementary material

12864_2005_434_MOESM1_ESM.xls

Additional File 1: Description of the 3 array formats used in the comparisons. The numbers represent the counts made of total number of targets represented on the respective microarrays. 1 The number of unique public sequence identifiers (ID) represented on the respective microarrays. These counts are based on the annotation table provided at the time the experiments were carried out (March – June, 2004). Control targets were excluded from the counts. (XLS 20 KB)

12864_2005_434_MOESM2_ESM.xls

Additional File 2: Table of the of 3,471 common target set. Shown in the table for each of the 3,471 common targets RefSeq identifiers (CommonREFSEQ_4platform) are the HUGO gene symbol (Gene Symbol) and Entrez Gene public data bank identifiers. Also given are the intra-platform intensity quantile attribution calculated for each platform respectively (PX Q, AFFYMETRIX.Q, AGILENT.Q, AMERSHAM.Q) as well as the consensus quantile (cQ) calculated based on the mean quantile attribution obtained for each platform. ANOVA targets (p < 0.001) are indicated for each platform ("1") where "0" indicates a target not filtered and not an ANOVA target. AMER_MCF_BATT, AFFY_MCF_BATT, AGILENT_MCF_BATT indicates the targets that passed the p < 0.001 filter for the respective t tests comparing the MCF7 and Batt P12 samples (see Figure 4 and Tables 1 and 2). Filtered log2-intensities are given for each slide hybridized by each platform (PX, Affymetrix (AFFY), Amersham (Amer) or the filtered log2-ratios obtained for Agilent (Agilent44K). "NA" is shown for all empty fields corresponding to filtered data points. (XLS 2 MB)

12864_2005_434_MOESM3_ESM.xls

Additional File 3: Primer/Probe information for the 15 genes analyzed by QRT-PCR. Shown in the table are the 15 genes (Genes Names), accession number, forward and reverse primers and probes with associated 5'-3' sequence, 5' position and size analyzed by QRT-PCR. (XLS 28 KB)

12864_2005_434_MOESM4_ESM.xls

Additional File 4: Array and QRT-PCR data for the 15 genes analyzed by QRT-PCR. This table is divided into three sections. Section I shows the filtered log2 intensities (Affymetrix and Amersham) or log2-ratios (Agilent) for the 15 genes analyzed by QRT-PCR. RNA batches are indicated above each table. Multiple targets were available for ERBB2 and RPS6KB1. Section II shows Ct values for each RNA batch obtained for each of the 2 batches (RNA batches are indicated above each table where Batch 1: green; Batch 2: pink). For sections I and II A red X is given for data points that were either filtered out by a given platform (microarray data) or for genes that were below the level of detection in a given cell line determined by QRT-PCR. Section III shows the number of possible versus available gene pair combinations QRT-PCR fold change bins used in Figure 5. The number of possible gene pair combinations per fold change bin were based on the distribution of relative expression levels calculated using the -ΔΔCt values to compare with log2-ratio array data (cell line/reference for all 3 platforms, shown in yellow) or using -ΔCt values to compare with log2 intensities (from Amersham and Affymetrix, shown in blue). Nine different bins were created with the following code (in bold) corresponding the following log2-ratios (x) intervals: <-5: x < -5; -3: -5 = x < -1.25; -1: -1.25 = x < -0.75; -0.5: -0.75 = x < -0.25; 0: -0.25 = x < 0.25; 0.5: 0.25 = x > 1.25; 1: 0.25 = x > 1.25; 3: 1.25 = x > 5.0; > = 5: x = 5.0. (XLS 32 KB)

12864_2005_434_MOESM5_ESM.pdf

Additional File 5: Cluster analysis using the common ANOVA targets. Sample cluster dendrograms of all 36 platforms samples alone (A) or with other data including 66 tumor samples (B) and gene cluster dendrogram with associated heat map based on the expression profile of 1,096 (A) common ANOVA targets (or 925 U133A targets mapped to the 1,096 targets for B) found between Affymetrix, Agilent and Amersham. Mapping to the Affymetrix U133A array was based on RefSeq identifiers. Clustered sample groups corresponding to the cell line and similar tumor type are indicated by colored bars. Log2-ratios were centered and color coded (below heat map B). MCF-7 samples are represented with blue bars, BattP12 and mesothelioma samples are represented with red bars while Jurkat and TALL samples are represented by green bars. BattP12 is a mesothelioma cell line and clusters with the MESO samples (red bar) which as a group clusters with the MCF7 samples (blue bar). Jurkat is a T-cell acute lymphoblastic leukemia and clusters with T-ALL samples (green bar). As a part of the CIT program we obtained raw Affymetrix HG-U133A data for 66 samples corresponding to either pooled tumors of a particular cancer type and/or derived cell lines (unpublished data). These samples include the universal reference RNA from Stratagene (see above). Tissues represented are as follows: B-cell acute lymphoblastic leukemia (BALL, n = 4); colon cell line (COLO, n = 8); follicular lymphoma (FOLL, n = 4); hepatocarcinoma (FOIE, n = 3); myeloblastic acute leukemia (LAM, n = 3); epidermotrophal lymphoma (LEPI, n = 2); chronic lymphoblastic leukemia (LLC, n = 1); myeloblastic chronic leukemia (LMC, n = 2); mesothelioma cell line (MESO, n = 8); epithelial cells (PEAU, n = 4); lung (POUM n = 3); T-cell acute lymphoblastic leukemia T (TALL, n = 20); thyroid (THYR n = 4). Labeled cRNA reactions, hybridizations and image analyses for all 66 samples were carried out at the IGBMC, Strasbourg, France (March, 2002). Raw data was normalized and summarized expression values were generated using RMA (described above). For all cluster analyses, normalized intensity values were transformed into log2-ratios using the reference sample as the denominator. Cluster analysis was performed using log2 ratios (ratios calculated as described above) and DNA-Chip Analyzer (dChip) Version 1.3, with the following parameters: distant metric = 1-pearson correlation; linkage = centroid; row standardization. (PDF 401 KB)

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

de Reyniès, A., Geromin, D., Cayuela, JM. et al. Comparison of the latest commercial short and long oligonucleotide microarray technologies. BMC Genomics 7, 51 (2006). https://doi.org/10.1186/1471-2164-7-51

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2164-7-51

Keywords

BMC Genomics

ISSN: 1471-2164

Contact us