Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Highly Accessed Research article

Identification of reproducible gene expression signatures in lung adenocarcinoma

Tzu-Pin Lu12, Eric Y Chuang23 and James J Chen14*

Author Affiliations

1 Division of Bioinformatics and Biostatistics, National Center for Toxicological Research, Food and Drug Administration Jefferson, Little Rock, Arkansas, USA

2 YongLin Biomedical Engineering Center, National Taiwan University, Taipei, Taiwan

3 Graduate Institute of Biomedical Engineering and Bioinformatics National Taiwan University, Taipei, Taiwan

4 Graduate Institute of Biostatistics and Biostatistics Center, China Medical University, Taichung, Taiwan

For all author emails, please log on.

BMC Bioinformatics 2013, 14:371  doi:10.1186/1471-2105-14-371

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/14/371


Received:12 August 2013
Accepted:20 December 2013
Published:26 December 2013

© 2013 Lu et al.; licensee BioMed Central Ltd.

This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Lung cancer is the leading cause of cancer-related death worldwide. Tremendous research efforts have been devoted to improving treatment procedures, but the average five-year overall survival rates are still less than 20%. Many biomarkers have been identified for predicting survival; challenges arise, however, in translating the findings into clinical practice due to their inconsistency and irreproducibility. In this study, we proposed an approach by identifying predictive genes through pathways.

Results

The microarrays from Shedden et al. were used as the training set, and the log-rank test was performed to select potential signature genes. We focused on 24 cancer-related pathways from 4 biological databases. A scoring scheme was developed by the Cox hazard regression model, and patients were divided into two groups based on the medians. Subsequently, their predictability and generalizability were evaluated by the 2-fold cross-validation and a resampling test in 4 independent datasets, respectively. A set of 16 genes related to apoptosis execution was demonstrated to have good predictability as well as generalizability in more than 700 lung adenocarcinoma patients and was reproducible in 4 independent datasets. This signature set was shown to have superior performances compared to 6 other published signatures. Furthermore, the corresponding risk scores derived from the set were found to associate with the efficacy of the anti-cancer drug ZD-6474 targeting EGFR.

Conclusions

In summary, we presented a new approach to identify reproducible survival predictors for lung adenocarcinoma, and the identified genes may serve as both prognostic and predictive biomarkers in the future.

Keywords:
Lung adenocarcinoma; Microarray; Pathway analysis; Prognostic biomarker; Predictive biomarker

Background

Lung cancer is the leading cause of cancer-related death in the United States and worldwide [1,2], more than 25% of cancer-related deaths in both men and women resulted from lung cancer. In the past few decades, considerable research effort has been devoted to elucidating the etiology of lung cancer and identifying possible biomarkers for predicting survival outcomes [3-6]. However, the overall five-year survival rate for lung cancer is still less than 20%. Although several studies have identified expression signatures associated with survival outcomes in their original discovery datasets, these expression signatures were often found to be irreproducible across studies. A previous report has shown that the largest number of overlapping predictive genes between two independent studies was only four, and most often even zero [7]. The lack of reproducibility in independent studies makes it very difficult to justify conducting prospective clinical validation studies and application to clinical practice. Therefore, how to effectively identify a set of predictive and reproducible biomarkers across different lung cancer studies poses a major challenge.

To address this issue, one possible approach for biomarker identification is to perform analysis based on biologically functional relevant gene sets rather than to examine the associations by traditional gene-by-gene approaches. Several reports have demonstrated that predictive genes that were identified by approaches considering biological pathway or cellular function information are more often reproduced and validated in independent studies [8-11]. For example, Kang et al. selected 23 effective genes to predict patient survival outcomes and chemotherapy responses in ovarian cancer from a pool of 151 genes summarized by DNA repair pathways [8]. An approach based on functional gene sets not only provides better understanding of biological meaning of identified gene markers, but also greatly increases statistical power of identification by considering only the number of pathways rather than the number of genes in the multiple comparison adjustment. The approach to performing gene set enrichment analyses for gene expression profiling has become a popular methodology even for genome-wide association studies [12,13].

In a recent study of an analysis of 47 published gene expression signatures for breast cancer [14], the authors showed that the predictive performance of several signatures was not superior to that obtained from random gene expression signatures, and sometimes even worse. There was a tendency for significant marker sets to depend on the size of the set; and over 90% of random signatures with more than 100 gene members were significant predictors for survival outcome [14]. This might be attributed to a lack of independence among the genes in the array, and a predictive model tending to become significant as more gene members were included. In order to reduce the possibility of identifying false-positive signatures, resample techniques can be performed to demonstrate significant findings, as compared to a randomly selected signature set with a same number of genes.

Genomic signatures can be classified into two major types: prognostic biomarkers and predictive biomarkers. Prognostic biomarkers aim to help physicians divide patients into distinct groups based on their risk factors and disease characteristics, which hints that different drug treatments including standard treatment, or advanced aggressive therapeutic procedures may be applied to groups of patients showing poor survival outcomes. Predictive biomarkers for a specific treatment are able to identify a subgroup of suitable patients for receiving the treatment, and those patients expected to have poor responses would be spared from the treatment. Compared with prognostic biomarkers, predictive biomarkers provide physicians direct suggestions for specific therapeutic methods for individual patients. Currently, most identified (published) signatures in lung cancer fall into the category of prognostic biomarkers; the lack of studies for predictive biomarkers is partly due to many considerations required before conducting a treatment-specific randomized clinical trial. Recently, Barretina et al. [15] used microarrays to investigate the gene expression profiles of 479 human cancer cell lines along with their responses after exposure to 24 anticancer drugs. Among the 24 drugs, 3 were designed to directly target EGFR, whose association with lung cancer has been widely reported [16-18]. This dataset provides a good template for evaluation of predictive biomarkers in lung cancer.

In the development of a predictive signature, there are two primary assessment considerations: 1) predictability (predictive performance) and 2) generalizability (reproducibility). Predictability is the ability of the signature to predict survival risk scores of patients who were not included in the signature development, but who are from a similar population. To evaluate predictability is to determine whether the signature can provide a relative ranking of patient risk scores correctly. A predictive signature that performed well in the development study might not be reproduced in performance when applied to other studies. Generalizability is to determine whether predictability is reproducible when applied to data generated independently in different circumstances, such as different locations or different times. A predictive signature needs to establish its predictability and generalizability before a prospective clinical validation is conducted.

In this study, we propose an approach for identifying prognostic gene signatures using 442 lung adenocarcinoma patients from the study of Shedden et al. [5]. The approach consists of a two-stage assessment: predictability and generalizability. The Shedden dataset was used for predictability assessment, and 4 additional independent lung cancer datasets were used for generalizability assessment. The Shedden (training) dataset was tested using 2-fold cross-validation. Generalizability of signature sets was evaluated and compared with several published lung cancer prognostic signatures using a randomization test. A set of 16 genes involved in the function of apoptotic execution phase was shown to have good predictability as well as generalizability in more than 700 lung adenocarcinoma patients, including the 442 patients from the Shedden et al. study. This signature set was also found to associate with the efficacy of the anti-cancer drug ZD-6474 targeting EGFR.

Results

Identification of significant survival predictors

Among the 12,753 genes investigated in the dataset of Shedden et al., log-rank tests were performed to exclude those genes determined to have no association with survival (p > 0.1, Step 1). A total of 2,852 genes (22.36%) were selected and their functions were annotated by four biological databases, including KEGG, BioCarta, PID and Reactome. We focused on 24 pathways that were closely related to the development of cancer cells, involving apoptosis, cell cycle and cell death regulations (Additional file 1: Table S1, Step 2).

Additional file 1: Table S1. Identified significant gene members (P < 0.1) showing associations to the survival outcomes in the 24 pathways investigated. Table S2: Characteristics of the six microarray datasets. Table S3: Prediction performances of the 11 pathways in lung squamous cell carcinoma. Table S4: Characteristics of the 442 lung adenocarcinoma patients analyzed in the study of Shedden et al. Table S5: Cox hazard regression model of scores and clinical variables in the study of Shedden et ala. Table S6: Linear regression analysis of the activity area of 23 drugs on the risk scores derived from the 16-gene signature. Figure S1: Kaplan-Meier survival curves of lung adenocarcinoma patients classified into three groups. For each dataset, the patients were classified into “High”, “Intermediate” and “Low” groups according to their summarized scores. (a) Shedden et al. (b) GSE3141 (c) GSE8894 (d) GSE11969 (e) Beer et al. Figure S2: Lung cancer cell lines with higher scores associated with higher activity area of ZD-6474. The 89 lung cancer cell lines from GSE36133 were divided into “High”, “Intermediate” and “Low” groups based on their scores. Box plot was utilized to illustrate their activity areas among three groups. Kruskal-Wallis test and Wilcoxon rank sum test were performed to assess their statistical differences.

Format: PDF Size: 520KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

For each pathway, the risk score of each patient was computed, and patients were divided into two groups according to the procedure described in the Method section. The log-rank test was performed to determine statistical significance of the signature set associated with survival outcomes for the pathway. Table 1 shows the p-values of 16 pathways that were significant using the Bonferroni correction (α = 0.05/24). A randomization test was performed and all 16 pathways were highly significant (results not shown).

Table 1. Predictive performances of 16 pathways

Predictability assessment (analytic validation of the training set)

Internal analytical validation was performed on the Shedden study to assess predictability of the signature sets using 2-fold cross-validation. The 442 samples were randomly divided into two (sub) sets of equal size, a training and a test set. In the training phase, gene filtering, Cox model fitting, total risk score calculation, and log-rank test were performed according to the procedures described in the Method section. The median of the risk scores was computed for each pathway.

In the test phase, a score of 0 was initially assigned to each patient. For each gene, a score of 1 was given to a patient if the Cox coefficient from the training set was greater than 0 and the patient’s expression level was higher or equal to the median, or if the coefficient was less than 0 and the expression level was less than the median. The total risk score of each patient was computed for each pathway (Step 3). Next, patients were classified into two risk groups based on the median of the risk scores from the training set. The log-rank test was performed to compare the two risk groups at the significance level of 0.05 (Step 4). Here we considered both the unadjusted p-value (α = 0.05) and the Bonferroni adjusted p-value (α = 0.05/24). The procedure was repeated, but the model was developed on the test set and applied to the training set. The entire procedure was repeated 50 times to generate different 2-fold partitions. The frequency of significant results out of the 100 repetitions was calculated for each pathway. The last two columns of Table 1 list the frequencies of the significant results for the 16 pathways. We selected the top 11 pathways which showed at least 10 significant counts at α = 0.05/24 (and at least 30 significant count at α = 0.05) for the generalizability assessment. These numbers can be regarded as the power for the predictability.

Generalizability assessment (analytic validation of the external datasets)

Generalizability requires that predictive performance of a model developed from one study is reproducible across different studies. Five additional microarray studies for a total of 6 studies (Additional file 1: Table S2) were evaluated. Among the 6 studies considered, 5 studies contained adenocarcinoma samples and 4 studies contained squamous cell carcinoma samples (i.e., 3 studies contained both adenocarcinoma and squamous data). Evaluation of generalizability is similar to the evaluation of predictability in which all 442 samples from the Shedden study were used as the training dataset and applied to each of 4 independent studies as a test dataset. Briefly, four microarray datasets were retrieved from the Gene Expression Omnibus (GEO) [19], and the quantile normalization algorithm was utilized to remove systematic biases. Gene expression levels of multiple probes annotated with the same gene symbol were summarized into a single value by using their means. Each independent dataset was then evaluated using the procedures described in the assessment of predictability.

Table 2 shows the p-values and the number of significant results (p ≤ 0.05) for the 11 most significant pathways (p ≤ 0.05/24) for the five adenocarcinoma datasets, including Shedden and four independent datasets. Several pathways were significant for 3 or more datasets; the pathway “apoptotic execution phase” was significant for all 5 datasets, an excellent criterion for generalizability.

Table 2. Predictive performances estimated by the log-rank tests of the 11 pathways for five lung adenocarcinoma datasets

In addition, a resampling test was performed to simulate chance significance for the five adenocarcinoma datasets. For each pathway, a null signature set consisting of randomly selected genes from the Shedden study was generated, where the numbers of genes were kept the same as the pathway. The null signature set was applied to the five datasets; the total number of significant results was compared to the observed number of significant results in Column 8 to determine if the selected signature set was superior to the null signature set. The simulation was repeated 1,000 times. The last column shows the p-value for the 11 pathways, where the p-value was defined as the proportion of the number of significances from the null signature set was greater or equal to the observed number in Column 8 out of the 1,000 repetitions.

The 11 pathways were also applied to four squamous cell carcinoma datasets, GSE3141, GSE4573, GSE8894, and GSE11969, and no statistical significance was identified for any of 11 pathways and 4 datasets (Additional file 1: Table S3). This suggested that these 11 pathways were specific to the lung adenocarcinoma.

The 16-gene signature

The 16 genes involved in the apoptotic execution phase pathway and statistical p-values of the log-rank test from Step 1 are listed in Table 3. Among them, the most significant gene was DNM1L, which concurred with high expression of PKP3 and DNM1L associated with poor survival in lung adenocarcinoma patients [20]. Figure 1 shows the Kaplan–Meier survival curves with the p-values from the log-rank test for the datasets. The proposed calculation of risk scores scheme and classification of patients into “High” and “Low” groups appeared to perform well in both training and test data. For example, in the study of Shedden et al., the median survival of the patients belonging to the “High” group is obviously shorter than that from the “Low” group (44.52 month versus 94.35 month). Similarly, the median survival also showed dramatic differences between the “High” and “Low” groups in GSE8894 (17.55 month versus 117.41 month). The p-values from fitting the Cox hazard regression model using the risk scores as an independent variable are shown in Figure 1. The p-values were consistent with the p-values from the log-rank test; a minor discrepancy is that the dataset GSE3141 has 6 ties at the median score resulting in lower discriminating ability. We also performed an analysis dividing the patients into three groups (Additional file 1: Figure S1), and an analysis of the squamous cell carcinoma patients across 4 independent datasets. The results are consistent with the results present above.

Table 3. List of the 16 genes identified and their p-values from the log-rank test

thumbnailFigure 1. Kaplan-Meier survival curves of lung adenocarcinoma patients divided by their summarized scores. For each dataset, the patients were classified into “High” or “Low” groups based on their median score. (a) Shedden et al. (b) GSE3141 (c) GSE8894 (d) GSE11969 (e) Beer et al.

The risk scores and four clinical variables were analyzed simultaneously using the multivariate Cox regression. The four clinical variables were age, gender, smoking, and grade (Additional file 1: Table S4). Additional file 1: Table S5 shows the coefficients of the fitted Cox regression. The proposed risk score was the most significant predictor as compared with the other four clinical variables.

Comparisons of the 16-gene signature with published lung cancer prognostic signatures

The predictive performances of the 16 gene signature were also compared with the published lung cancer prognostic signatures. Six signature sets from five studies were considered [3-5,21-23]. We collected the gene symbols from their original literatures and followed the same evaluation procedures described previously to test their predictability. The results are summarized in Table 4; it appeared that the 16-gene signature identified in this study was superior to those identified in other studies. Specifically, among the published signatures, the best performance was observed in the 10 genes reported in the study of Kratz et al. [24]. These 10 genes were able to predict four datasets with one on the border line (P = 0.12). The other signatures were effective predictors for 2 or 3 datasets. Therefore, the results suggested that our analysis approach not only was able to reproduce published gene signatures from other studies but also identified a set of predictive genes for lung adenocarcinoma.

Table 4. Comparisons of the predictive performances of the 16-gene signature with 6 published lung cancer signatures

Exploration of association between the 16-gene signature and drug response

Finally, we explored the ability of the 16-gene signature to serve as a predictive biomarker for drug response. To address this issue, we considered the microarrays of GSE36133 [15], which contained gene expression profiles and efficacy data of 23 drugs for 89 human lung cancer cell lines. The drug Irinotecan was not included in the analysis because the data were missing in more than 50% of the 89 cell lines. The expression data were retrieved from the GEO website and normalized by the quantile algorithm. Summarized pathway scores of identified genes were obtained by following the same procedures described previously. The efficacies of drugs on each cell line were represented by the variable activity area, with a higher value of the activity area representing higher inhibition ability of the corresponding drug in the cell line. The authors determined the activity area of a drug by measuring its proportion of relative growth inhibition compared to the untreated samples at different drug concentrations [15]. For each drug, a linear regression model was utilized to evaluate the association between the value of the activity area and the derived risk score. The results, summarized in Additional file 1: Table S6, indicated that the risk score was associated with three drugs, Nutlin-3, RAF215 and ZD-6474. Subsequently, the 89 cell lines were divided into three groups based on their scores and two non-parameter tests, Kruskal-Wallis test and Wilcoxon rank sum test, were performed. Only the drug, ZD-6474, targeting EGFR, showed significant differences in both statistical tests (Additional file 1: Figure S2), and better drug response was observed in the patients classified in the “High” group. This suggested that high-risk lung adenocarcinoma patients with poor survival may benefit from receiving ZD-6474 treatment. In summary, these results implied that our proposed pathway score is not only a prognostic biomarker for survival outcomes but also a predictive biomarker for selecting potentially useful drugs to treat lung adenocarcinoma patients.

Discussion

In the development of the 16-gene signature, the gene filtering procedure used the log-rank test to exclude genes showing no associations with survival outcomes (Step 1 in Figure 2). The p-value cut off was set at 0.1 in order to prevent excessive removal of genes. A similar strategy was utilized in a published report on ovarian cancer [8], in which the authors used a slightly looser threshold (P < 0.15) to retain the top quartile of associated genes. In our data, about 22% of the genes (2,852 out of 12,753) passed the threshold (P < 0.1). In other words, approximately 80% of the genes were removed by this step, which excluded the majority of genes examined by microarray. A more stringent cut off of p-values may help decrease the false-positive rates. However, two important questions may arise by using this approach. First, the proposed pathway-based analyses required a sufficient number of input genes in order to preserve the biological meaning of functional-relevant gene sets. Next, it is well-known that a huge discrepancy was observed across independent datasets, which may be attributed to different experimental protocols, distinct ethnicity, and dissimilar clinical parameters of investigated patients. Although a stringent threshold may provide better results for a single dataset, it often simultaneously increases the chance of overfitting the training model. Since the goal of this study is to identify predictive and reproducible genes across different studies, we prefer a slightly looser p-value cut off to retain information and the generality of results.

thumbnailFigure 2. Flowchart for identifying predictive genes associated with survival outcomes in lung adenocarcinoma.

Four biological databases were utilized to provide functional annotations for the selected genes, and our results revealed that many cancer-related pathways were possible predictors for survival outcomes in lung adenocarcinoma (Table 1). Among them, an internal validation test excluded 5 pathways that showed low predictability. Furthermore, in the external validation, the pathway that was shown to be reproducible across 5 datasets does not have the smallest p-value from the log-rank test results. This implied that filtering survival predictors based purely on the p-value may not be the best strategy because such approach may cause overfitting of the model to the training dataset. In addition, lung cancer is such a heterogeneous disease and independent datasets had different ethnic characteristics, various experimental platforms, and distinct clinical features of patients. A pathway having the highest reproducibility across independent studies may be more applicable to clinic use than a pathway with the most significant p-value in a single dataset. Furthermore, for the 11 pathways shown in Table 2, we collected the most significant gene from each pathway into a gene set. The same scoring and evaluation procedures described previously were performed in 5 lung adenocarcinoma datasets by using this gene set. The result showed that its prediction performance and consistency were inferior to that obtained from the 16 genes, suggesting that using the union of the most significant gene across different pathways may be not the best choice.

Several previous studies have reported that the 16 genes identified in this study were highly related to the development, progression and treatment of cancer cells [20,29-38]. DNM1L was associated with poor survival in lung adenocarcinoma patients when co-expressing with PKP3[20], and nuclear expression of DNM1L was correlated with not only poor prognosis for lung adenocarcinoma but also drug resistance during hypoxia [29]. Cleavage of DSG2 was mediated by junction opener 1 (JO-1), and downstream signaling combined with a monoclonal antibody targeting EGFR, Erbitux, provide better therapeutic outcomes in EGFR-positive lung cancer [30]. DSP has been reported as an overexpressing gene in high-risk patients with stage one non-small cell lung cancer (NSCLC), and is included in the 64-gene signature to predict survival outcomes [31]. The high mobility group 2 protein (HMG2) was able to increase the drug sensitivity of cisplatin in lung cancer cells by inhibiting repair of the DNA damage resulting from cisplatin [32]. A previous study demonstrated that KPNB1 was overexpressed in cervical cancer cells, and decreased expression of KPNB1 greatly reduced cell proliferation and triggered cell death procedures [33]. The expression of LMNB1 was significantly up-regulated in the plasma and tissue of hepatocellular carcinoma patients, and it was associated with tumor stages, tumor sizes, and number of nodules [34]. Low mRNA and protein expression of MAPT was correlated with high expression of TUBB3, which showed prognostic significance with disease-free survival and overall survival in patients with early breast cancer [35]. CLDN1 was a transcriptional activator of OCLN, and was also reported as not only a metastasis suppressor but also a possible prognostic predictor for lung adenocarcinoma [36]. PAK2 was a necessary interaction partner of ARHGDIB, and knockdown of PAK2 greatly reduced ARHGDIB-induced cell invasion and ARHGDIB-mediated chemoresistance in gastric cancer [37], and loss of SATB1 in lung cancer has been shown as a possible marker for poor survival [38].

Identification of possible prognostic biomarkers for various cancers has been widely investigated in the past two decades, and several successful studies have been reported [8,24,39,40]. For instance, the MammaPrint® Test divided breast cancer patients into high and low risk groups for distant metastases within 10 years by examining the expression signature of 70 genes [39,40], and it has been the only signature approved by the FDA for clinical use. Regarding lung cancer, in addition to the irreproducibility of identified biomarkers across independent datasets [7], gene expression profiles obtained from different microarray platforms pose another challenge. A predicting model developed using one microarray platform usually cannot be directly utilized in another microarray platform due to differences in their dynamic ranges of intensity values and lack of a normalization algorithm to adjust them to the same baseline. Therefore, a predictive model will become more useful when it is not necessary to rebuild the model using different parameters in independent datasets. In this study, the medians of proposed scores in the 5 lung adenocarcinoma datasets were 8, except for the Beer dataset. The median score in the Beer dataset was 7 based on only 14 genes studied, since two genes, DSP and STK24, were not examined in the corresponding microarray platform. In summary, our approach provides a consistent cutting threshold across different microarray platforms, and thus may enable application to independent studies.

To further investigate the proposed analysis procedures in this study, Cox hazard regression models were used to evaluate the top 5 pathways shown in Table 2. Generally, the risk scores obtained from the other 4 pathways were significantly associated with survival outcomes in at least 2 datasets (P < 0.05), suggesting that our approach is effective in selection of predictive genes from the whole gene pool. In addition, we followed the same procedures described previously and performed the three statistical tests to evaluate the drugs associated with the scores obtained from the second pathway, the Biocarta cell cycle pathway. The scores were significantly correlated with three drugs using a linear regression model (P < 0.05), and two of them, Erlotinib and Lapatinib, also passed the Kruskal-Wallis and Wilcoxon rank sum tests. Unexpectedly, these two drugs both target EGFR, concurring that treating lung cancer patients using EGFR inhibitors is a feasible approach. Therefore, our proposed methodology may facilitate classification of patients into different groups based on their drug responses.

Identification of prognostic biomarkers for lung cancer is useful but it may become more valuable if the predicting signature can simultaneously reveal the drug response. Although ZD-6474, also known as Vandetanib, targeting EGFR, has not been approved for treatment of NSCLC, it has been used in medullary thyroid cancer [41]. One randomized phase 2 clinical trial demonstrated the efficacy of Vandetanib in locally advanced or metastatic differentiated thyroid cancer [42]; another meta-analysis study including 14 trials indicated that NSCLC patients treated by Vandetanib showed better progression-free survival, especially the adenocarcinoma subtype [43]. This suggests that Vandetanib has high potential for approval and use in treatment of patients with lung cancer [41]. Therefore, since the efficacy of Vandetanib was associated with the score proposed to summarize the 16 genes (Additional file 1: Figure S2), this signature may serve as both prognostic and predictive biomarkers for lung adenocarcinoma patients in the future.

To further explore the potential of the 16-gene signature used as a predictive biomarker, we evaluated its performance by analyzing another NSCLC dataset with treatment information, GSE14814 [26]. The series matrix file of GSE14814 was retrieved from the GEO database. There were 90 lung cancer patients in the series matrix file but only 28 adenocarcinoma patients. We applied the same procedure to derive the risk scores of each lung adenocarcinoma patient. Unfortunately, no significant difference between “High” and “Low” groups was observed in the 28 lung adenocarcinoma patients using the 16-gene signature (P > 0.05). Among the 28 lung adenocarcinoma patients, there are 17 treated patients and 11 controls. Again, no significant differences were observed in these two sub-groups. These insignificant results might be attributed to the small sample size (N = 28). The 17 treated patients were insufficient for subgroup analysis of difference between high and low risk groups. In addition, we evaluated the performance of the 16-genes on the 52 lung squamous cell carcinoma patients. The result was similar to the previous analysis that the 16-gene signature can’t significantly predict the squamous cell carcinoma patients. The 16-gene signature cannot serve as a predictive signature in GSE14814.

Conclusions

In this study, we identified 16 predictive genes for lung adenocarcinoma patients via pathways. Four widely used biological databases were utilized to provide the functional annotations of genes. The risk scores derived from these 16 genes were reproduced in 4 independent studies, which account for a total of more than 700 lung adenocarcinoma patients. However, the risk scores showed no predictive ability for lung squamous cell carcinoma, suggesting that these 16 genes were subtype-specific for lung cancer. Lastly, statistical tests showed that the 16-gene signature was associated with the efficacy of an anti-cancer drug, ZD-6474, directly targeting EGFR. Therefore, these 16 genes may serve as not only prognostic biomarkers but also predictive biomarkers for lung adenocarcinoma, and have potential for clinical use in the future.

Methods

Processing of the training set

The microarray dataset from the study of Shedden et al. [5] was utilized as the training set to develop a prognostic signature for survival risk prediction. This dataset provided not only the largest number of lung adenocarcinoma patients currently in the world, but also comprehensive clinical information for further comparisons. The raw cel files of Affymetrix microarray retrieved from the website were imported into the Partek Genomics Suite version 6.4 to perform the pre-processing steps, including robust multiarray average and the quantile normalization method. After pre-processing, the gene symbol of each probe was obtained by searching the official annotation file version 32 provided by Affymetrix, Inc. Only probes annotated with one single gene remained for further analyses and the expression values of multiple probes showing the same gene symbol were summarized by a single value by using their mean. Consequently, a total of 12,753 genes were investigated in this study.

Identification of potential gene signatures by biological pathways

The procedure to identify significant survival predictors is illustrated in Figure 2. Specifically, for each gene, patients were divided into two groups based on the median of expression values. A patient was classified into the “High” group if his/her expression level was greater than or equal to the median and into the “Low” group if his/her expression level was less than the median. Next, the log-rank test was performed to compare the “High” versus “Low” groups for each gene. The significant genes were selected based on a pre-determined statistical criterion at p < 0.10 (Step 1).

Four biological databases, including KEGG [44], BioCarta, Pathway Interaction Database (PID) [45] and Reactome [46], were utilized to provide functional annotations of selected genes. Because it is well-known that apoptosis, cell cycle and cell death regulations are dominant players in regulating cancer cells [47,48], we selected 24 pathways that were related to these three functions for further investigations (Step 2).

The associations between gene expression and survival were evaluated using the Cox hazard regression model for each gene selected from Step 2 (24 pathways). Initially, a score of 0 was assigned to each patient. For each gene, a score of 1 was given to a patient 1) if the fitted Cox coefficient was greater than 0 and the patient’s expression level was greater or equal to the median, or 2) the Cox coefficient was less than 0 and the expression level was less than the median. The total risk score of each patient was computed by summing all genes within the same pathway (Step 3).

For each pathway, patients were classified into two groups based on the median of the risk scores. The log-rank test for difference between the two groups was performed; the pathway-specific significant signature sets were identified at α = 0.05/24 (Step 4). The significant signature sets were analytically evaluated to assess their predictability and generalizability.

Availability of supporting data

Shedden’s dataset: https://array.nci.nih.gov/caarray/project/details.action?project.id=182 webcite.

Abbreviations

GEO: Gene expression omnibus; NSCLC: Non-small cell lung cancer; PID: Pathway interaction database.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

TPL, EYC and JJC conceived the study. TPL and JJC developed the methodology, performed the analysis and wrote the manuscript. All authors read and approved the final manuscript.

Acknowledgements

The views presented in this paper are those of the authors and do not necessarily represent those of the U.S. Food and Drug Administration.

References

  1. Siegel R, Naishadham D, Jemal A: Cancer statistics, 2012.

    CA Cancer J Clin 2012, 62(1):10-29. PubMed Abstract | Publisher Full Text OpenURL

  2. Molina JR, Yang P, Cassivi SD, Schild SE, Adjei AA: Non-small cell lung cancer: epidemiology, risk factors, treatment, and survivorship.

    Mayo Clin Proc 2008, 83(5):584-594. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Beer DG, Kardia SL, Huang CC, Giordano TJ, Levin AM, Misek DE, Lin L, Chen G, Gharib TG, Thomas DG, et al.: Gene-expression profiles predict survival of patients with lung adenocarcinoma.

    Nat Med 2002, 8(8):816-824. PubMed Abstract | Publisher Full Text OpenURL

  4. Bild AH, Yao G, Chang JT, Wang Q, Potti A, Chasse D, Joshi MB, Harpole D, Lancaster JM, Berchuck A, et al.: Oncogenic pathway signatures in human cancers as a guide to targeted therapies.

    Nature 2006, 439(7074):353-357. PubMed Abstract | Publisher Full Text OpenURL

  5. Shedden K, Taylor JM, Enkemann SA, Tsao MS, Yeatman TJ, Gerald WL, Eschrich S, Jurisica I, Giordano TJ, Misek DE, et al.: Gene expression-based survival prediction in lung adenocarcinoma: a multi-site, blinded validation study.

    Nat Med 2008, 14(8):822-827. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  6. Lu TP, Tsai MH, Lee JM, Hsu CP, Chen PC, Lin CW, Shih JY, Yang PC, Hsiao CK, Lai LC, et al.: Identification of a novel biomarker, SEMA5A, for non-small cell lung carcinoma in nonsmoking women.

    Cancer Epidemiol Biomarkers Prev 2010, 19(10):2590-2597. PubMed Abstract | Publisher Full Text OpenURL

  7. Lau SK, Boutros PC, Pintilie M, Blackhall FH, Zhu CQ, Strumpf D, Johnston MR, Darling G, Keshavjee S, Waddell TK, et al.: Three-gene prognostic classifier for early-stage non small-cell lung cancer.

    J Clin Oncol 2007, 25(35):5562-5569. PubMed Abstract | Publisher Full Text OpenURL

  8. Kang J, D’Andrea AD, Kozono D: A DNA repair pathway-focused score for prediction of outcomes in ovarian cancer treated with platinum-based chemotherapy.

    J Natl Cancer Inst 2012, 104(9):670-681. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Lu TP, Lai LC, Tsai MH, Chen PC, Hsu CP, Lee JM, Hsiao CK, Chuang EY: Integrated analyses of copy number variations and gene expression in lung adenocarcinoma.

    PLoS One 2011, 6(9):e24829. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Bicaku E, Xiong Y, Marchion DC, Chon HS, Stickles XB, Chen N, Judson PL, Hakam A, Gonzalez-Bosquet J, Wenham RM, et al.: In vitro analysis of ovarian cancer response to cisplatin, carboplatin, and paclitaxel identifies common pathways that are also associated with overall patient survival.

    Br J Cancer 2012, 106(12):1967-1975. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Tsai CA, Chen JJ: Multivariate analysis of variance test for gene set analysis.

    Bioinformatics 2009, 25(7):897-903. PubMed Abstract | Publisher Full Text OpenURL

  12. Sun YV: Integration of biological networks and pathways with genetic association studies.

    Hum Genet 2012, 131(10):1677-1686. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  13. Tseng GC, Ghosh D, Feingold E: Comprehensive literature review and statistical considerations for microarray meta-analysis.

    Nucleic Acids Res 2012, 40(9):3785-3799. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  14. Venet D, Dumont JE, Detours V: Most random gene expression signatures are significantly associated with breast cancer outcome.

    PLoS Comput Biol 2011, 7(10):e1002240. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Barretina J, Caponigro G, Stransky N, Venkatesan K, Margolin AA, Kim S, Wilson CJ, Lehar J, Kryukov GV, Sonkin D, et al.: The Cancer Cell Line Encyclopedia enables predictive modelling of anticancer drug sensitivity.

    Nature 2012, 483(7391):603-607. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Reungwetwattana T, Weroha SJ, Molina JR: Oncogenic pathways, molecularly targeted therapies, and highlighted clinical trials in non-small-cell lung cancer (NSCLC).

    Clin Lung Cancer 2012, 13(4):252-266. PubMed Abstract | Publisher Full Text OpenURL

  17. Janku F, Garrido-Laguna I, Petruzelka LB, Stewart DJ, Kurzrock R: Novel therapeutic targets in non-small cell lung cancer.

    J Thorac Oncol 2011, 6(9):1601-1612. PubMed Abstract | Publisher Full Text OpenURL

  18. Petrelli F, Borgonovo K, Cabiddu M, Barni S: Efficacy of EGFR tyrosine kinase inhibitors in patients with EGFR-mutated non-small-cell lung cancer: a meta-analysis of 13 randomized trials.

    Clin Lung Cancer 2012, 13(2):107-114. PubMed Abstract | Publisher Full Text OpenURL

  19. Edgar R, Domrachev M, Lash AE: Gene Expression Omnibus: NCBI gene expression and hybridization array data repository.

    Nucleic Acids Res 2002, 30(1):207-210. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  20. Furukawa C, Daigo Y, Ishikawa N, Kato T, Ito T, Tsuchiya E, Sone S, Nakamura Y: Plakophilin 3 oncogene as prognostic marker and therapeutic target for lung cancer.

    Cancer Res 2005, 65(16):7102-7110. PubMed Abstract | Publisher Full Text OpenURL

  21. Lee ES, Son DS, Kim SH, Lee J, Jo J, Han J, Kim H, Lee HJ, Choi HY, Jung Y, et al.: Prediction of recurrence-free survival in postoperative non-small cell lung cancer patients by using an integrated model of clinical information and gene expression.

    Clin Cancer Res 2008, 14(22):7397-7404. PubMed Abstract | Publisher Full Text OpenURL

  22. Raponi M, Zhang Y, Yu J, Chen G, Lee G, Taylor JM, Macdonald J, Thomas D, Moskaluk C, Wang Y, et al.: Gene expression signatures for predicting prognosis of squamous cell and adenocarcinomas of the lung.

    Cancer Res 2006, 66(15):7466-7472. PubMed Abstract | Publisher Full Text OpenURL

  23. Matsuyama Y, Suzuki M, Arima C, Huang QM, Tomida S, Takeuchi T, Sugiyama R, Itoh Y, Yatabe Y, Goto H, et al.: Proteasomal non-catalytic subunit PSMD2 as a potential therapeutic target in association with various clinicopathologic features in lung adenocarcinomas.

    Mol Carcinog 2011, 50(4):301-309. PubMed Abstract | Publisher Full Text OpenURL

  24. Kratz JR, He J, Van Den Eeden SK, Zhu ZH, Gao W, Pham PT, Mulvihill MS, Ziaei F, Zhang H, Su B, et al.: A practical molecular assay to predict survival in resected non-squamous, non-small-cell lung cancer: development and international validation studies.

    Lancet 2012, 379(9818):823-832. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  25. Chen HY, Yu SL, Chen CH, Chang GC, Chen CY, Yuan A, Cheng CL, Wang CH, Terng HJ, Kao SF, et al.: A five-gene signature and clinical outcome in non-small-cell lung cancer.

    N Engl J Med 2007, 356(1):11-20. PubMed Abstract | Publisher Full Text OpenURL

  26. Zhu CQ, Ding K, Strumpf D, Weir BA, Meyerson M, Pennell N, Thomas RK, Naoki K, Ladd-Acosta C, Liu N, et al.: Prognostic and predictive gene signature for adjuvant chemotherapy in resected non-small-cell lung cancer.

    J Clin Oncol 2010, 28(29):4417-4424. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  27. Chen DT, Hsu YL, Fulp WJ, Coppola D, Haura EB, Yeatman TJ, Cress WD: Prognostic and predictive value of a malignancy-risk gene signature in early-stage non-small cell lung cancer.

    J Natl Cancer Inst 2011, 103(24):1859-1870. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  28. Wan YW, Beer DG, Guo NL: Signaling pathway-based identification of extensive prognostic gene signatures for lung adenocarcinoma.

    Lung Cancer 2012, 76(1):98-105. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  29. Chiang YY, Chen SL, Hsiao YT, Huang CH, Lin TY, Chiang IP, Hsu WH, Chow KC: Nuclear expression of dynamin-related protein 1 in lung adenocarcinomas.

    Mod Pathol 2009, 22(9):1139-1150. PubMed Abstract | Publisher Full Text OpenURL

  30. Beyer I, van Rensburg R, Strauss R, Li Z, Wang H, Persson J, Yumul R, Feng Q, Song H, Bartek J, et al.: Epithelial junction opener JO-1 improves monoclonal antibody therapy of cancer.

    Cancer Res 2011, 71(22):7080-7090. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  31. Lu Y, Lemon W, Liu PY, Yi Y, Morrison C, Yang P, Sun Z, Szoke J, Gerald WL, Watson M, et al.: A gene expression signature predicts survival of patients with stage I non-small cell lung cancer.

    PLoS Med 2006, 3(12):e467. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  32. Arioka H, Nishio K, Ishida T, Fukumoto H, Fukuoka K, Nomoto T, Kurokawa H, Yokote H, Abe S, Saijo N: Enhancement of cisplatin sensitivity in high mobility group 2 cDNA-transfected human lung cancer cells.

    Jpn J Cancer Res 1999, 90(1):108-115. PubMed Abstract | Publisher Full Text OpenURL

  33. van der Watt PJ, Maske CP, Hendricks DT, Parker MI, Denny L, Govender D, Birrer MJ, Leaner VD: The Karyopherin proteins, Crm1 and Karyopherin beta1, are overexpressed in cervical cancer and are critical for cancer cell survival and proliferation.

    Int J Cancer 2009, 124(8):1829-1840. PubMed Abstract | Publisher Full Text OpenURL

  34. Sun S, Xu MZ, Poon RT, Day PJ, Luk JM: Circulating Lamin B1 (LMNB1) biomarker detects early stages of liver cancer in patients.

    J Proteome Res 2010, 9(1):70-78. PubMed Abstract | Publisher Full Text OpenURL

  35. Pentheroudakis G, Batistatou A, Kalogeras KT, Kronenwett R, Wirtz RM, Bournakis E, Eleftheraki AG, Pectasides D, Bobos M, Papaspirou I, et al.: Prognostic utility of beta-tubulin isotype III and correlations with other molecular and clinicopathological variables in patients with early breast cancer: a translational Hellenic Cooperative Oncology Group (HeCOG) study.

    Breast Cancer Res Treat 2011, 127(1):179-193. PubMed Abstract | Publisher Full Text OpenURL

  36. Chao YC, Pan SH, Yang SC, Yu SL, Che TF, Lin CW, Tsai MS, Chang GC, Wu CH, Wu YY, et al.: Claudin-1 is a metastasis suppressor and correlates with clinical outcome in lung adenocarcinoma.

    Am J Respir Crit Care Med 2009, 179(2):123-133. PubMed Abstract | Publisher Full Text OpenURL

  37. Cho HJ, Baek KE, Kim IK, Park SM, Choi YL, Nam IK, Park SH, Im MJ, Yoo JM, Ryu KJ, et al.: Proteomics-based strategy to delineate the molecular mechanisms of RhoGDI2-induced metastasis and drug resistance in gastric cancer.

    J Proteome Res 2012, 11(4):2355-2364. PubMed Abstract | Publisher Full Text OpenURL

  38. Selinger CI, Cooper WA, Al-Sohaily S, Mladenova DN, Pangon L, Kennedy CW, McCaughan BC, Stirzaker C, Kohonen-Corish MR: Loss of special AT-rich binding protein 1 expression is a marker of poor survival in lung cancer.

    J Thorac Oncol 2011, 6(7):1179-1189. PubMed Abstract | Publisher Full Text OpenURL

  39. van de Vijver MJ, He YD, Van’t Veer LJ, Dai H, Hart AA, Voskuil DW, Schreiber GJ, Peterse JL, Roberts C, Marton MJ, et al.: A gene-expression signature as a predictor of survival in breast cancer.

    N Engl J Med 2002, 347(25):1999-2009. PubMed Abstract | Publisher Full Text OpenURL

  40. Veer LJ V ‘t, Dai H, van de Vijver MJ, He YD, Hart AA, Mao M, Peterse HL, Van der Kooy K, Marton MJ, Witteveen AT, et al.: Gene expression profiling predicts clinical outcome of breast cancer.

    Nature 2002, 415(6871):530-536. PubMed Abstract | Publisher Full Text OpenURL

  41. Chu CT, Sada YH, Kim ES: Vandetanib for the treatment of lung cancer.

    Expert Opin Investig Drugs 2012, 21(8):1211-1221. PubMed Abstract | Publisher Full Text OpenURL

  42. Leboulleux S, Bastholt L, Krause T, de la Fouchardiere C, Tennvall J, Awada A, Gomez JM, Bonichon F, Leenhardt L, Soufflet C, et al.: Vandetanib in locally advanced or metastatic differentiated thyroid cancer: a randomised, double-blind, phase 2 trial.

    Lancet Oncol 2012, 13(9):897-905. PubMed Abstract | Publisher Full Text OpenURL

  43. Wu X, Jin Y, Cui IH, Xu Z, Zhang Y, Zhang X, Tang C, Gong Y, Chen J: Addition of vandetanib to chemotherapy in advanced solid cancers: a meta-analysis.

    Anticancer Drugs 2012, 23(7):731-738. PubMed Abstract | Publisher Full Text OpenURL

  44. Kanehisa M, Araki M, Goto S, Hattori M, Hirakawa M, Itoh M, Katayama T, Kawashima S, Okuda S, Tokimatsu T, et al.: KEGG for linking genomes to life and the environment.

    Nucleic Acids Res 2008, 36:D480-D484. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  45. Schaefer CF, Anthony K, Krupa S, Buchoff J, Day M, Hannay T, Buetow KH: PID: the Pathway Interaction Database.

    Nucleic Acids Res 2009, 37(Database issue):D674-D679. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  46. Matthews L, Gopinath G, Gillespie M, Caudy M, Croft D, de Bono B, Garapati P, Hemish J, Hermjakob H, Jassal B, et al.: Reactome knowledgebase of human biological pathways and processes.

    Nucleic Acids Res 2009, 37(Database issue):D619-D622. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  47. Cakir E, Yilmaz A, Demirag F, Oguztuzun S, Sahin S, Yazici UE, Aydin M: Prognostic significance of micropapillary pattern in lung adenocarcinoma and expression of apoptosis-related markers: caspase-3, bcl-2, and p53.

    APMIS 2011, 119(9):574-580. PubMed Abstract | Publisher Full Text OpenURL

  48. Han SW, Roman J: Targeting apoptotic signaling pathways in human lung cancer.

    Curr Cancer Drug Targets 2010, 10(6):566-574. PubMed Abstract | Publisher Full Text OpenURL