Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Highly Accessed Software

The MULTICOM toolbox for protein structure prediction

Jianlin Cheng123*, Jilong Li1, Zheng Wang1, Jesse Eickholt1 and Xin Deng1

Author affiliations

1 Department of Computer Science, University of Missouri-Columbia, Columbia, MO, 65211, USA

2 Informatics Institute, University of Missouri-Columbia, Columbia, MO, 65211, USA

3 C. Bond Life Science Center, University of Missouri-Columbia, Columbia, MO, 65211, USA

For all author emails, please log on.

Citation and License

BMC Bioinformatics 2012, 13:65  doi:10.1186/1471-2105-13-65


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/13/65


Received:20 January 2012
Accepted:30 April 2012
Published:30 April 2012

© 2012 Cheng et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

As genome sequencing is becoming routine in biomedical research, the total number of protein sequences is increasing exponentially, recently reaching over 108 million. However, only a tiny portion of these proteins (i.e. ~75,000 or < 0.07%) have solved tertiary structures determined by experimental techniques. The gap between protein sequence and structure continues to enlarge rapidly as the throughput of genome sequencing techniques is much higher than that of protein structure determination techniques. Computational software tools for predicting protein structure and structural features from protein sequences are crucial to make use of this vast repository of protein resources.

Results

To meet the need, we have developed a comprehensive MULTICOM toolbox consisting of a set of protein structure and structural feature prediction tools. These tools include secondary structure prediction, solvent accessibility prediction, disorder region prediction, domain boundary prediction, contact map prediction, disulfide bond prediction, beta-sheet topology prediction, fold recognition, multiple template combination and alignment, template-based tertiary structure modeling, protein model quality assessment, and mutation stability prediction.

Conclusions

These tools have been rigorously tested by many users in the last several years and/or during the last three rounds of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7-9) from 2006 to 2010, achieving state-of-the-art or near performance. In order to facilitate bioinformatics research and technological development in the field, we have made the MULTICOM toolbox freely available as web services and/or software packages for academic use and scientific research. It is available at http://sysbio.rnet.missouri.edu/multicom_toolbox/ webcite.

Keywords:
Protein structure prediction; Bioinformatics tool; Secondary structure; Solvent accessibility; Domain; Contact map; Tertiary structure; Protein model quality assessment; Fold recognition; Protein disorder

Background

The central dogma of protein science is that protein sequence specifies protein structure; and protein structure determines protein function. Therefore, understanding protein structure is crucial for elucidating protein function and has fundamental significance in biomedical sciences including protein function analysis, protein design, protein engineering, genome annotation, and drug design. Since the experimental determination of the first two protein structures - myoglobin and haemoglobin - using X-ray crystallography [1,2], the structures of more and more proteins have been solved by either X-ray crystallography or Nuclear Magnetic Resonance (NMR) techniques. Currently, there are about 75,000 protein sequences with determined structures deposited in the Protein Data Bank (PDB), which account for about 0.07% of the total known protein sequences (i.e. > 108 million). With the exponential growth of protein sequences with unsolved structures produced by various high-throughput, next generation sequencing techniques, predicting protein structure from sequence, which is critical for filling the sequence-structure gap [3], has become one of the most fundamental problems in structural bioinformatics and genomics. Accurate high-throughput protein structure prediction tools are urgently needed for both scientific research as well as the bio-tech industry. These tools will also fulfill a very important and major goal of the structural genomics project, namely to provide a rather complete set of experimentally determined structures for predicting the structure of about 99.9% of proteins with unsolved structures [3].

The protein structure prediction problem is usually decomposed and attacked from the three different dimensional levels: 1D structure prediction, 2D structure prediction, and 3D structure prediction [4]. One-dimensional (1D) structure prediction is the prediction of protein structural features such as secondary structures, solvent accessibilities, disordered residues or domain boundaries along one-dimensional sequences. Since 1D prediction is usually the first step to obtain protein structure, the largest number of methods and tools had been developed for it, such as Porter [5], SAM [6], SSpro [7,8], PSIPRED [9], SABLE [10-13], YASSPP [14], Jpred [15], PREDATOR [16-18], and GOR [19] for secondary structure prediction; NetSurfP [20], ACCpro [7,21] and Real-SPINE [22] for solvent accessibility prediction; PONDR [23,24], MFDp [25], DISOPRED [26], SPINE-D [27], PrDOS [28], Spritz [8], POODLE [29-31], IUPRred [32,33], DISOclust [34], and IntFOLD-DR [35] for disorder prediction; DomPred [36], DomSVR [37], PPRODO [38], CHOPnet [39], DoBo [40] and SSEP-Domain [41] for domain boundary prediction; and PredictProtein [42], Distill [43], and SCRATCH [7] for all four kinds of 1D predictions.

Two-dimensional (2D) structure prediction is to predict the spatial relationships (e.g., residue-residue contacts, disulfide bonds, or beta-residue pairings) of two residues. 2D prediction is a challenging and increasingly important problem [44]. Some methods and tools for 2D prediction are PROFcon [45], Distill [43], TMHcon [46], DiANNA [47], GDAP [48], CYSPRED [49], BETAWRAP [50], SVM-BetaPred [44], BETTY [51], ProC_S3 [52], FragHMMent [53], SVMSEQ [54], and SAM [55].

Three-dimensional (3D) structure prediction is to predict the 3D coordinates of each residue [56-61], which is the ultimate goal of structure prediction. Some popular tools are I-TASSER [62-64], MODELLER [65,66], HHpred [67], QUARK [68], chunk-TASSER [69], Rosetta [61], Pcons-net [70], SAM [71], Raptor-X [72], SparksX [73], and MULTICOM. 1D, 2D, and 3D protein structure prediction methods are routinely evaluated in the Critical Assessment of Techniques for Protein Structure Prediction (CASP) [74] - a community-wide experiment for blind protein structure prediction that has been held every two years since 1994. CASP experiments have driven the development of protein structure prediction methods by objectively assessing the state of the art of the most active and imperative protein structure prediction problems. The last two CASPs (CASP8, 2008 and CASP9, 2010) [75] focused on trying to solve the most pressing structure prediction problems: disorder region prediction (1D) [76], residue-residue contact prediction (2D) [77], protein tertiary structure prediction (3D) [78-80], evaluation of 3D models [81-87], and protein model refinement [74,88,89].

During the last several years, we have developed a series of tools for predicting protein structure and structural features at the 1D, 2D, and 3D levels, including secondary structure prediction, solvent accessibility prediction, disorder region prediction, domain boundary prediction, contact map prediction, disulfide bond prediction, beta-sheet topology prediction, protein fold recognition, multiple template combination and alignment, protein tertiary structure modeling, protein model quality assessment, and mutation stability prediction. Most of these tools have been rigorously tested by many users in the last several years and/or during the last three rounds of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7-9) achieving state-of-the-art or near performance. In order to facilitate bioinformatics research and technological development in the field, we have incorporated updates and improvements accumulated over years into these tools and packed them together into one single comprehensive MULTICOM toolbox equipped with tutorials, documentation, software executables, some source code, web service, and online mailing list for technical support.

The organization of the MULTICOM toolbox is shown in Figure 1. The 1D protein structure prediction tools are comprised of PSpro for the prediction of secondary structure and relative solvent accessibility, PreDisorder for disordered residue prediction, and DoBo for domain boundary prediction. The 2D protein structure prediction tools include SVMcon and NNcon for residue-residue contact prediction, DIpro for disulfide bond prediction, and BETApro for beta-sheet pairing prediction. The 3D protein structure prediction tools are comprised of MULTICOM for tertiary structure prediction and APOLLO for protein model quality assessment. The MULTICOM toolbox also contains several other protein bioinformatics tools including SeqRate for protein folding rate prediction, MUpro for the prediction of stability changes caused by single-residue mutation, MSACompro for multiple protein sequence alignment, and HMMEditor for visualization of protein Hidden Markov models. The entire MULTICOM toolbox is freely available for academic use and scientific research at http://sysbio.rnet.missouri.edu/multicom_toolbox/ webcite. Users may download and install most of the tools locally or access them through web services.

thumbnailFigure 1. The organization of the MULTICOM toolbox.

Methods and benchmarks

1D structure prediction tools

PSpro2.0 for secondary structure and relative solvent accessibility prediction

PSpro2.0 is an improved and combined version of the popular tools SSpro/ACCpro 4 [7,8,21] for the prediction of protein secondary structure and relative solvent accessibility. It integrates both homology-based and ab initio methods to make predictions. The ab initio approach uses a 1-D recursive neural networks (1D-RNN) [7,90] and takes the profile of a query protein sequence as input to predict its secondary structures (i.e. helix, strand, and loop) or relative solvent accessibility (i.e. exposed and buried) at 20 different exposure thresholds (i.e. 0%, 5%, 10%, …, 95%). The sequence profile was generated by using PSI-BLAST to search the query sequence against a Non-Redundant protein (NR) sequence database, which has been updated to the most recent version. The PSpro2.0 allows users to plug in any version of the NR database of their choice.

The homology-based method in PSpro2.0 is called to make predictions if a significant homologous template protein can be found for a query protein in the Protein Data Bank (PDB) [91]. The homology-based method uses BLAST to search the query sequence against a locally compiled version of the PDB database to identify homologous hits. Information regarding the alignment between the query and the most significant hit, including the alignment e-value, the number of amino acids aligned, number of gaps, sequence identity, is gathered and used by a linear regression function to predict the accuracy of transferring the secondary structure and solvent accessibility of the hit to the query protein. The linear regression function was trained on a set of query-template alignments with known alignment information and transferring accuracy. If the predicted transferring accuracy is > = 0.82 for secondary structure (resp. > = 0.80 for relative solvent accessibility), the secondary structure (resp. relative solvent accessibility) is transferred from the hit to the query as predictions. Otherwise, ab initio predictions will be used. The combination of the ab initio method and homology-based method can automatically apply the most appropriate method for the query proteins having or not having significant homology with a known protein structure in order to improve the prediction performance. In order to take advantage of abundant new protein structures in the PDB, PSpro2.0 uses an updated local version of the PDB database comprised of 62,607 proteins. The new local PDB database is a few times larger than the old one used with SSpro/ACCpro 4 which had 22,064 proteins.

We benchmarked PSpro2.0 on the protein targets of the last two Critical Assessments of Techniques for Protein Structure Prediction (CASP8 in 2008 and CASP9 in 2010). The CASP datasets were chosen because of their wide adoption in the field, their balance of easy (homology-based) and hard (ab initio or weak homology) targets, and their relatively large size. When the homology-based method was tested, the target proteins in the CASP8 and CASP9 data sets were removed from the local PDB database in order to avoid using themselves to make predictions. 100 CASP9 targets and 119 CASP8 targets that were not present in the local PDB database were used in this test.

Table 1 reports the accuracy of secondary structure prediction and relative solvent accessibility prediction at a 25% threshold for both the combined method and the ab initio method alone. Here the accuracy is defined simply as the percent of correct predictions, i.e. the standard Q3 score for three-category secondary structure prediction, and the Q2 score for two-category relative solvent accessibility prediction. The results show that the accuracy of secondary structure prediction and relative solvent accessibility prediction of the combined method is in the range [80.8%, 83.3%] and [74.6%, 77.5%], respectively, higher than [76.6%, 77.7%] and [74.2%, 75.9%] of the ab initio method. Using homology prediction seems to improve secondary structure prediction more than relative solvent accessibility prediction. Combining homology and ab initio approaches seems to improve secondary structure prediction more than solvent accessibility prediction.

Table 1. The accuracy of the prediction of secondary structure (SS) and relative solvent accessibility (SA) on 100 CASP9 targets and 119 CASP8 targets, respectively

PreDisorder1.1 for protein disorder prediction

PreDisorder1.1 is an efficient and reliable ab initio prediction tool for protein disorder regions on the genomic scale. PreDisorder uses only sequence-related information in conjunction with neural networks to predict the disorder probability of each residue of a protein sequence. The earlier and most recent versions of PreDisorder had been consistently ranked as one of the top protein disorder predictors in the last three Critical Assessments of Techniques for Protein Structure Prediction (CASP7, 8, 9) in 2006, 2008, and 2010, respectively [92,93]. Evaluated on 117 CASP8 targets and 117 CASP9 targets separately, PreDisorder yielded an AUC score of 0.86 and 0.82, respectively [92,93]. AUC score represents the area under the Receiver Operating Characteristic (ROC) curve (true positive rates versus false positive rates) of disorder predictions. Considering different methods may use different criteria to set a probability threshold to make order/disorder decisions, we also calculated the break-even score and its corresponding decision threshold on predicted disorder probabilities. The break-even score is the value at which the sensitivity (i.e. recall) and specificity (i.e. precision) of disorder predictions are equal. The break-even scores on the CASP8 and CASP9 dataset are in the range [0.45, 0.56] using a probability threshold of around 0.5. Figures 2 and 3 illustrate the plots of sensitivity versus specificity over a varying decision threshold from 0.1 to 0.9 at step of 0.005 on the CASP8 and CASP9 data sets, respectively. The intersections in the figures denote the break-even points/scores.

thumbnailFigure 2. The plot of sensitivity and specificity (y axis) against different probability thresholds of classifying residues as disordered residues on CASP8 targets.

thumbnailFigure 3. The plot of sensitivity and specificity (y axis) against different probability thresholds of classifying residues as disordered residues on CASP9 targets.

DoBo for protein domain boundary prediction

Protein domain boundary prediction is often used as a means to decompose the modeling of a large, multi-domain protein in to smaller, more manageable pieces. In order for such a technique to be applicable to hard, free modeling targets it should not rely extensively on templates or known structures to delineate protein domain boundaries. DoBo [40] is the sequence based protein domain boundary predictor we have developed and included in the MULTICOM toolbox. It leverages evolutionary information contained in multiple sequence alignments to identify potential domain boundary sites. These candidate sites are then classified using a support vector machine. Predicted domain boundary sites are finally scored and a confidence value provided.

We recently evaluated DoBo on 14 continuous, multi-domain CASP9 targets [40]. DoBo is able to recall 70% of the domain boundaries, which occur at least 40 residues from the N or C terminal end of the sequence. The precision of the domain boundary prediction is 49%. Here, a domain boundary prediction is considered correct if it occurs within 20 residues of a true domain boundary. Furthermore, on a large benchmark dataset using a 10 fold cross validation procedure, DoBo achieves a break-even point of 60% (ie, precision equals recall) for domain boundary predictions [40].

2D structure prediction tools

NNcon and SVMcon for general residue-residue contact prediction

Residue-residue contact prediction continues to be an area of active research and becoming of greater importance in the latest rounds of CASP. Of particular importance to tertiary structure prediction are sequence based (ie ab-initio) contact prediction methods and recent work by Wu et al. has shown that predicted contact information can be used to significantly improve predictions for free modeling targets [94]. The MULTICOM toolbox contains two general residue-residue contact predictors – NNCon [95] and SVMcon [96]. NNcon [95] is a sequence-based, ab initio method to predict intra-chain protein residue-residue contacts. NNcon uses a set of two-dimensional (2D) recursive neural network ensembles [90] which predict the probability that the distance between any two residues are below a threshold (i.e. in contact). Features used for each residue include a sequence profile, secondary structure and solvent accessibility.

SVMcon [96] is an ab initio method based on a support vector machine (SVM). For each residue pair, a set of features including secondary structure, solvent accessibility and a sequence profile is encoded for a 9-residue window centered on each residue. This feature vector is fed into a SVM trained on a large dataset which classifies the residue-residue pair.

Both of our predictors participated in the most recent rounds of CASP (CASP8 and CASP9) and ranked among the top residue-residue contact predictors [97]. As an additional assessment, we evaluated both NNcon and SVMcon on all CASP9 targets. Table 2 shows the accuracy for medium and long range predicted contacts. Here, two amino acid residues are said to be in contact if the distance between their Cβ atoms (Cα for glycine) in the experimental structure is less than 8 Å. Long range contacts are defined as residues in contact whose separation in the sequence is greater than or equal to 24 residues. Medium range contacts are defined by interacting residues which are 12 to 23 residues apart in the sequence. These definitions were used in accordance with previous studies and CASP residue-residue contact assessments [97,98]. A common evaluation metric for residue-residue contact predictions is the accuracy of the top L/5 or L/10 predictions where L is the length of the protein in residues and the predictions are ranked using a score provided for each prediction. Accuracy is defined as the number of correctly predicted residue-residue contacts divided by the total number of contact predictions considered. For medium range contacts, NNcon and SVMcon are capable of achieving accuracies at or above 35% when considering the top L/10 predictions and accuracies near 31% when considering the top L/5 predictions. For long range contacts, SVMcon performed notably better on the CASP9 targets with accuracies of 27% and 24% for the top L/10 and L/5 predictions, respectively, while NNcon obtained accuracies of 21% and 18%.

Table 2. Accuracy for NNcon and SVMcon contact predictions on all CASP9 targets

DIpro2.0 for protein disulfide bond prediction

DIpro2.0 is a tool that uses kernel methods, two-dimensional recursive neural networks, and weighted graph matching for large-scale protein disulfide bridge prediction [99,100]. Given a protein sequence, it can predict if a cysteine in the protein participates in a disulfide bond and how bonding cysteines are connected. The method can handle proteins with arbitrary number of disulfide bonds. Benchmarked on a large disulfide bond data set [99], the specificity and sensitivity of classifying individual residues as bonded or non-bonded are 87% and 89%, respectively, and the accuracy of overall disulfide connectivity pattern prediction is 51%. Some other disulfide bond prediction tools are DiANNA [47], GDAP [48], and CYSPRED [49].

BETApro1.0 for protein beta-sheet structure prediction

BETApro1.0 integrates two-dimensional recursive neural networks and graph algorithms with protein sequence profiles and predicted structural features (e.g. secondary structure and relative solvent accessibility) to predict specific beta residue pairs, beta strand pairs, strand alignments, strand pairing direction, and beta-sheet topology for beta sheets in a protein [101]. BETApro1.0 was evaluated on a large dataset using different standard measures [101]. At the break-even point, the specificity and sensitivity of beta-residue pairing predictions is 41%. At 59% specificity, the sensitivity of beta strand pairing predictions is 54%. Some other beta-sheet prediction tools are BETAWRAP [50], SVM-BetaPred [44], and BETTY [51].

3D structure prediction and evaluation tools

MULTICOM for tertiary structure prediction

MULTICOM [102], an automated multi-level combination method, combines complementary and alternative templates, alignments, and models to predict protein tertiary structures. Several implementations of this approach with minor differences were tested in the last two Critical Assessments of Techniques for Protein Structure Predictions (CASP8 and CASP9) in 2008 and 2010, respectively [102]. One significant improvement on multi-template combination benchmarked in CASP9 is to check the structural consistency between multiple template candidates. This procedure avoids potential atom clashes caused by conflicting structural conformations from inconsistent templates. The structural similarity of a pair of query-template alignments was checked by comparing the structures of two templates after they are aligned to the same regions of the query using TM-Align [103]. Only structurally similar query-template alignments are combined. Both MULTICOM-server and MULTICOM-human predictors were ranked among the best in CASP8 and CASP9.

Table 3 illustrates the evaluation results of one MULTICOM server predictor and one MULTICOM human predictor. The evaluation was conducted on 107 CASP9 targets, whose native structures were downloaded from the Protein Data Bank [104]. We used TM-Score [103] to compare predicted models with native structures to calculate their similarity scores in terms of both GDT-TS score [105] and TM-Score [103]. GDT-TS scores or TM-Scores are in the range [0, 100], where 0 means completely different and 100 exactly the same. Generally, a TM-Score of 50 indicates a reasonable model with largely correctly predicted topology and a score greater than 80 is a high-quality model. On average, the GDT-TS score and TM-Score of the first MULTICOM server models are 59.28 and 66.76, respectively, indicating the average quality of server models is good. The average score of MULTICOM-server models is 2–4 points lower than MULTICOM-human’s, one of the best CASP9 human predictors that made predictions by exploring the entire CASP9 model pool. This suggests that the automatically generated MULTICOM-server predictions are approaching the best performance among CASP9 models. Figure 4 shows good-quality models predicted by MULTICOM-server on four CASP9 targets.

Table 3. The average GDT-TS and TM scores of top-one and best-of-five models of MULTICOM predictors on 107 CASP9 targets

thumbnailFigure 4. Superimpositions of predicted models (blue) and native structures (orange) of four CASP9 targets. (A) T0520, TM-Score = 85, (B) T0527, TM-Score = 74, (C) T0634, TM-Score = 88, (D) T0641, TM-Score = 91.

APOLLO for protein model quality assessment

APOLLO is a software package that can predict global and residue-specific qualities of individual or multiple protein models without knowing native structures [106]. For an individual model, APOLLO uses a machine learning method (support vector machine) to predict its absolute global [107] and residue-specific qualities [106]. The absolute global quality of a model is the overall structural similarity between the model and its native structure in terms of GDT-TS score, whereas the absolute residue-specific qualities are the structural deviations at each residue position in terms of Angstrom (Å). The features used in the machine learning algorithm include amino acid sequence and the differences between predicted (predicted from amino acid sequence) and parsed (parsed from protein model) secondary structures, solvent accessibilities, and residue-residue contact probabilities. For multiple models, APOLLO uses a pair-wise comparison method to predict their relative global qualities [108]. This algorithm performs a full pair-wise comparison of each model against all the others by the structural alignment program TM-Score [103]; and the average structural similarity scores are used as the predicted global qualities. APOLLO also employs a hybrid approach to refine absolute quality scores. It selects the top five models ranked by initial quality scores as reference models and then superimposes every model with each of the reference models by TM-Score [109]. The average GDT-TS score resulted from the superimpositions is used as the predicted global quality.

We evaluated the APOLLO software package on the models of 107 valid CASP9 targets whose experimental structures were available in the Protein Data Bank [104]. For global quality prediction, the average Pearson’s correlations between predicted and real quality scores of pair-wise, hybrid, and machine learning methods are 0.917, 0.870, and 0.671, respectively [106]. For residue-specific quality prediction, APOLLO has an average error deviation of 2.60 and 3.18 Å on the residues whose actual distances to the native are < = 10 and 20 Å, respectively [106].

Other protein bioinformatics tools

MUpro1.0 for protein mutation stability prediction

MUpro1.0 [110] is a tool using support vector machines to predict protein stability changes for single amino acid mutations. It can predict the amount of the energy change caused by an amino acid mutation from a protein sequence, a protein structure, or both. MUpro1.0 was evaluated on a large dataset of single amino acid mutations [110]. It predicted the direction (positive versus negative) of the mutation-induced energy changes at 84% accuracy. The method can also reliably predict the absolute value of an energy change. Some mutation stability prediction tools are PoPMuSiC [111], SDM [112], I-Mutant2.0 [113], and CUPSAT [114].

SeqRate for protein folding rate prediction

SeqRate [115] is a sequence-based tool for large-scale protein folding rate prediction. It uses a Support Vector Machine regression method with a set of features derived from protein sequences alone to make predictions. The tool can predict both folding kinetic types and real-value folding rates. The folding kinetic type prediction accuracy of SeqRate on a standard benchmark is 80% [115].

MSACompro1.2.0 for protein multiple sequence alignment with predicted structural features

MSACompro1.2.0 [116] is a new tool that integrates predicted secondary structure, solvent accessibility, and contact map information with protein sequences to improve protein multiple sequence alignment. MSACompro1.2.0 was evaluated on the BAliBASE 3.0 datasets [117], yielding an average alignment Sum of Pair score (SP score) of 88.85 and the average alignment True Column score (TC score) of 61.31. The results showed that incorporating protein structural features into multiple sequence alignment improves alignment accuracy over existing tools without using structural features.

HMMEditor for visualization of hidden Markov models of protein sequence family

HMMEditor [118] is a visual, interactive editor for visualizing and manipulating profile Hidden Markov Models of a protein family. It provides a series of functions to visualize the profile HMM architecture, transition probabilities, and emission probabilities. It also allows users to align a sequence against the profile HMM and visualize the corresponding Viterbi path.

Software packages, web services, documentation, and user support

Most tools in the MULTICOM toolbox are available as both downloadable software packages and online web services at the one-stop web site http://sysbio.rnet.missouri.edu/multicom_toolbox/ webcite (Figure 5). Some tools that are only available as web services will be released as software packages in the near future. The documentation and relevant publications of these tools are also available at the same web site. Table 4 summarizes the availability and running environment of the MULTICOM tools.

thumbnailFigure 5. The MULTICOM toolbox web site.

Table 4. The availability and running environment of the MULTICOM tools

The MULTICOM toolbox has been implemented in different programming languages including C++, Java, and Perl. The tools have been extensively tested on the Linux platform. We expect to gradually release some standalone tools for other popular platforms such as Windows and Mac. Most of the tools in the toolbox are available as online web services, which makes it easy for users to make predictions on a small scale without a need to install the software. The web interface is generally simple and intuitive and requires a minimum amount of information from the user. The results may be sent to users by email or be presented in the browser. Most tools are also available as software packages that can be downloaded by users for large-scale prediction or other purposes. In general, installing these tools is straightforward and often only requires unzipping the software, setting a few paths in a configuration file, and running a configuration script. The package of each tool includes a readme file that contains both installation instructions and a quick guide on using the tool. One or more test examples with expected results are often provided with the package for users to test an installation.

In order to facilitate the use of the tools, the user manuals for these tools have been developed in PDF and HTML format and are available at the MULTICOM web site. The user manuals usually include step-by-step installation instructions, application examples, references to more technical documents, and frequently asked questions (FAQ) and solutions. In order to better serve users and gather community feedback to improve the toolbox, a mailing list is created. After subscribing the MULTICOM mailing list (multicom_toolbox@googlegroups.com), a user can post a message to the mailing list and view the collection of all prior postings. The technical support of the MULTICOM toolbox regularly reads the message postings and answers questions. Collected improvements will be released in future versions of the toolbox.

Conclusion

We developed a comprehensive MULTICOM toolbox consisting of a number of protein structure and structural feature prediction tools. These tools have been extensively tested and used internally and externally during the last several years yielding good performance. All the tools are freely available as software packages and/or online web services for academic use and scientific research at the MULTICOM web site. This makes them useful for large-scale annotation of structure and function of vast protein sequence resources generated in the genomic era. In the future, we will continue to improve the performance, usability, and documentation of these tools, make them available to more platforms (e.g. Windows and Mac), and add new protein structure and function prediction tools into the toolbox. Improvements and new developments will be released on the MULTICOM toolbox web site.

Competing interests

The authors declare that they have no competing interests.

Authors’ Contributions

JC conceived the system. JC, JL, ZW, JE, XD designed, developed and tested the system. JC, JL, ZW, JE, XD authored, edited and approved the manuscript. All authors read and approved the final manuscript.

Acknowledgements

The work is partially supported by a NIH grant (5R01GM093123) to JC, a NLM fellowship to JE, and a Shumaker fellowship to ZW.

References

  1. Kendrew J, Dickerson R, Strandberg B, Hart R, Davies D, Phillips D, Shore V: Structure of myoglobin: a three-dimensional Fourier synthesis at 2å resolution.

    Nature 1960, 185(4711):422-427. PubMed Abstract | Publisher Full Text OpenURL

  2. Perutz M, Rossmann M, Cullis A, Muirhead H, Will G, North A: Structure of haemoglobin: a three-dimensional Fourier synthesis at 5.5å resolution, obtained by X-ray analysis.

    Nature 1960, 185(4711):416-422. PubMed Abstract | Publisher Full Text OpenURL

  3. Fox BG, Goulding C, Malkowski MG, Stewart L, Deacon A: Structural genomics: from genes to structures with valuable materials and many questions in between.

    Nat Methods 2008, 5(2):129-132. PubMed Abstract | Publisher Full Text OpenURL

  4. Rost B, Liu J, Przybylski D, Nair R, Wrzeszczynski KO, Bigelow H, Ofran Y: Prediction of protein structure through evolution.

    Handbook of Chemoinformatics 2003, 1789-1811. OpenURL

  5. Pollastri G, Mclysaght A: Porter: a new, accurate server for protein secondary structure prediction.

    Bioinformatics 2005, 21(8):1719-1720. PubMed Abstract | Publisher Full Text OpenURL

  6. Karplus K, Karchin R, Draper J, Casper J, Mandel-Gutfreund Y, Diekhans M, Hughey R: Combining local-structure, fold-recognition, and new fold methods for protein structure prediction.

    Proteins: Structure, Function, and Bioinformatics 2003, 53(S6):491-496. Publisher Full Text OpenURL

  7. Cheng J, Randall A, Sweredoski M, Baldi P: SCRATCH: a protein structure and structural feature prediction server.

    Nucleic Acids Res 2005, 33(Web Server Issue):W72-W76. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  8. Vullo A, Bortolami O, Pollastri G, Tosatto SCE: Spritz: a server for the prediction of intrinsically disordered regions in protein sequences using kernel machines.

    Nucleic Acids Res 2006, 34:W164-W168. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. McGuffin L, Bryson K, Jones D: The PSIPRED protein structure prediction server.

    Bioinformatics 2000, 16(4):404. PubMed Abstract | Publisher Full Text OpenURL

  10. Adamczak R, Porollo A, Meller J: Accurate prediction of solvent accessibility using neural networks–based regression.

    Proteins: Structure, Function, and Bioinformatics 2004, 56(4):753-767. Publisher Full Text OpenURL

  11. Adamczak R, Porollo A, Meller J: Combining prediction of secondary structure and solvent accessibility in proteins.

    Proteins: Structure, Function, and Bioinformatics 2005, 59(3):467-475. Publisher Full Text OpenURL

  12. Wagner M, Adamczak R, Porollo A, Meller J: Linear regression models for solvent accessibility prediction in proteins.

    J Comput Biol 2005, 12(3):355-369. PubMed Abstract | Publisher Full Text OpenURL

  13. Porollo A, Adamczak R, Wagner M, Meller J: Maximum feasibility approach for consensus classifiers: Applications to protein structure prediction.

    2003, 2003:75-76.

  14. Karypis G: YASSPP: better kernels and coding schemes lead to improvements in protein secondary structure prediction.

    Proteins: Structure, Function, and Bioinformatics 2006, 64(3):575-586. Publisher Full Text OpenURL

  15. Cole C, Barber JD, Barton GJ: The Jpred 3 secondary structure prediction server.

    Nucleic Acids Res 2008, 36(suppl 2):W197-W201. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Frishman D, Argos P: Incorporation of long-distance interactions into a secondary structure prediction algorithm.

    Protein Eng 1996, 9(2):133-142. PubMed Abstract | Publisher Full Text OpenURL

  17. Frishman D, Argos P: Knowledge-based protein secondary structure assignment.

    Proteins: Structure, Function, and Bioinformatics 1995, 23(4):566-579. Publisher Full Text OpenURL

  18. Kabsch W, Sander C: Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features.

    Biopolymers 1983, 22(12):2577-2637. PubMed Abstract | Publisher Full Text OpenURL

  19. Sen TZ, Jernigan RL, Garnier J, Kloczkowski A: GOR V server for protein secondary structure prediction.

    Bioinformatics 2005, 21(11):2787-2788. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  20. Petersen B, Petersen TN, Andersen P, Nielsen M, Lundegaard C: A generic method for assignment of reliability scores applied to solvent accessibility predictions.

    BMC Struct Biol 2009, 9(1):51. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  21. Pollastri G, Baldi P, Fariselli P, Casadio R: Prediction of coordination number and relative solvent accessibility in proteins.

    Proteins: Structure, Function, and Bioinformatics 2002, 47(2):142-153. Publisher Full Text OpenURL

  22. Faraggi E, Xue B, Zhou Y: Improving the prediction accuracy of residue solvent accessibility and real-value backbone torsion angles of proteins by guided-learning through a two-layer neural network.

    Proteins: Structure, Function, and Bioinformatics 2009, 74(4):847-856. Publisher Full Text OpenURL

  23. Iakoucheva LM, Kimzey AL, Masselon CD, Bruce JE, Garner EC, Brown CJ, Dunker AK, Smith RD, Ackerman EJ: Identification of intrinsic order and disorder in the DNA repair protein XPA.

    Protein Sci 2001, 10(3):560-571. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  24. Dunker AK, Cortese MS, Romero P, Iakoucheva LM, Uversky VN: Flexible nets.

    FEBS J 2005, 272(20):5129-5148. PubMed Abstract | Publisher Full Text OpenURL

  25. Mizianty MJ, Stach W, Chen K, Kedarisetti KD, Disfani FM, Kurgan L: Improved sequence-based prediction of disordered regions with multilayer fusion of multiple information sources.

    Bioinformatics 2010, 26(18):i489-i496. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. Ward JJ, McGuffin LJ, Bryson K, Buxton BF, Jones DT: The DISOPRED server for the prediction of protein disorder.

    Bioinformatics 2004, 20(13):2138-2139. PubMed Abstract | Publisher Full Text OpenURL

  27. Zhang T, Faraggi E, Xue B, Dunker A, Uversky VN, Zhou Y: SPINE-D: Accurate Prediction of Short and Long Disordered Regions by a Single Neural-Network Based Method.

    J Biomol Struct Dyn 2012, 29(4):799-813. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  28. Ishida T, Kinoshita K: PrDOS: prediction of disordered protein regions from amino acid sequence.

    Nucleic Acids Res 2007, 35(suppl 2):W460-W464. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  29. Shimizu K, Hirose S, Noguchi T: POODLE-S: web application for predicting protein disorder by using physicochemical features and reduced amino acid set of a position-specific scoring matrix.

    Bioinformatics 2007, 23(17):2337-2338. PubMed Abstract | Publisher Full Text OpenURL

  30. Hirose S, Shimizu K, Kanai S, Kuroda Y, Noguchi T: POODLE-L: a two-level SVM prediction system for reliably predicting long disordered regions.

    Bioinformatics 2007, 23(16):2046-2053. PubMed Abstract | Publisher Full Text OpenURL

  31. Shimizu K, Muraoka Y, Hirose S, Tomii K, Noguchi T: Predicting mostly disordered proteins by using structure-unknown protein data.

    BMC Bioinforma 2007, 8(1):78. BioMed Central Full Text OpenURL

  32. Dosztányi Z, Csizmok V, Tompa P, Simon I: The pairwise energy content estimated from amino acid composition discriminates between folded and intrinsically unstructured proteins.

    J Mol Biol 2005, 347(4):827-839. PubMed Abstract | Publisher Full Text OpenURL

  33. Dosztányi Z, Csizmok V, Tompa P, Simon I: IUPred: web server for the prediction of intrinsically unstructured regions of proteins based on estimated energy content.

    Bioinformatics 2005, 21(16):3433-3434. PubMed Abstract | Publisher Full Text OpenURL

  34. McGuffin L: The ModFOLD server for the quality assessment of protein structural models.

    Bioinformatics 2008, 24(4):586. PubMed Abstract | Publisher Full Text OpenURL

  35. Roche DB, Buenavista MT, Tetchner SJ, McGuffin LJ: The IntFOLD server: an integrated web resource for protein fold recognition, 3D model quality assessment, intrinsic disorder prediction, domain prediction and ligand binding site prediction.

    Nucleic Acids Res 2011, 39(suppl 2):W171-W176. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  36. Marsden RL, McGuffin LJ, Jones DT: Rapid protein domain assignment from amino acid sequence using predicted secondary structure.

    Protein Sci 2002, 11(12):2814-2824. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  37. Chen P, Liu C, Burge L, Li J, Mohammad M, Southerland W, Gloster C, Wang B: DomSVR: domain boundary prediction with support vector regression from sequence information alone.

    Amino Acids 2010, 39(3):713-726. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  38. Sim J, Kim SY, Lee J: PPRODO: prediction of protein domain boundaries using neural networks.

    Proteins: Structure, Function, and Bioinformatics 2005, 59(3):627-632. Publisher Full Text OpenURL

  39. Liu J, Rost B: Sequence-based prediction of protein domains.

    Nucleic Acids Res 2004, 32(12):3522-3530. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  40. Eickholt J, Deng X, Cheng J: DoBo: Protein domain boundary prediction by integrating evolutionary signals and machine learning.

    BMC Bioinforma 2011, 12:43. BioMed Central Full Text OpenURL

  41. Gewehr JE, Zimmer R: SSEP-Domain: protein domain prediction by alignment of secondary structure elements and profiles.

    Bioinformatics 2006, 22(2):181-187. PubMed Abstract | Publisher Full Text OpenURL

  42. Rost B, Yachdav G, Liu J: The predictprotein server.

    Nucleic Acids Res 2004, 32(suppl 2):W321-W326. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  43. Baú D, Martin A, Mooney C, Vullo A, Walsh I, Pollastri G: Distill: a suite of web servers for the prediction of one-, two-, and three-dimensional structural features of proteins.

    BMC Bioinforma 2006, 7(1):402. BioMed Central Full Text OpenURL

  44. Singh S, Hajela K, Ramani A: SVM-BetaPred: prediction of right-handed ß-helix fold from protein sequence using SVM.

    Pattern Recognition in Bioinformatics 2007, 108-119. OpenURL

  45. Punta M, Rost B: PROFcon: novel prediction of long-range contacts.

    Bioinformatics 2005, 21(13):2960-2968. PubMed Abstract | Publisher Full Text OpenURL

  46. Fuchs A, Kirschner A, Frishman D: Prediction of helix–helix contacts and interacting helices in polytopic membrane proteins using neural networks.

    Proteins: Structure, Function, and Bioinformatics 2009, 74(4):857-871. Publisher Full Text OpenURL

  47. Ferre F, Clote P: DiANNA: a web server for disulfide connectivity prediction.

    Nucleic Acids Res 2005, 33(suppl 2):W230-W232. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  48. O’Connor BD, Yeates TO: GDAP: a web tool for genome-wide protein disulfide bond prediction.

    Nucleic Acids Res 2004, 32(suppl 2):W360-W364. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  49. Fariselli P, Riccobelli P, Casadio R: Role of evolutionary information in predicting the disulfide-bonding state of cysteine in proteins.

    Proteins: Structure, Function, and Bioinformatics 1999, 36(3):340-346. Publisher Full Text OpenURL

  50. Bradley P, Cowen L, Menke M, King J, Berger B: Betawrap: Successful prediction of parallel β-helices from primary sequence reveals an association with many microbial pathogens.

    Proc Natl Acad Sci 2001, 98(26):14819-14824. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  51. Zimmermann O, Wang L, Hansmann UHE: BETTY: Prediction of β-Strand Type from Sequence.

    In Silico Biol 2007, 7(4):535-542. PubMed Abstract | Publisher Full Text OpenURL

  52. Li Y, Fang Y, Fang J: Predicting residue–residue contacts using random forest models.

    Bioinformatics 2011, 27(24):3379-3384. PubMed Abstract | Publisher Full Text OpenURL

  53. Björkholm P, Daniluk P, Kryshtafovych A, Fidelis K, Andersson R, Hvidsten TR: Using multi-data hidden Markov models trained on local neighborhoods of protein structure to predict residue–residue contacts.

    Bioinformatics 2009, 25(10):1264-1270. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  54. Wu S, Zhang Y: A comprehensive assessment of sequence-based and template-based methods for protein contact prediction.

    Bioinformatics 2008, 24(7):924-931. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  55. Shackelford G, Karplus K: Contact prediction using mutual information and neural nets.

    Proteins: Structure, Function, and Bioinformatics 2007, 69(S8):159-164. Publisher Full Text OpenURL

  56. Zhang Y, Skolnick J: The protein structure prediction problem could be solved using the current PDB library.

    Proc Natl Acad Sci 2005, 102(4):1029-1034. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  57. Baker D, Sali A: Protein structure prediction and structural genomics.

    Science 2001, 294(5540):93-96. PubMed Abstract | Publisher Full Text OpenURL

  58. Zhang Y: Progress and challenges in protein structure prediction.

    Curr Opin Struct Biol 2008, 18(3):342-348. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  59. Zhou H, Zhou Y: SPEM: improving multiple sequence alignment with sequence profiles and predicted secondary structures.

    Bioinformatics 2005, 21(18):3615-3621. PubMed Abstract | Publisher Full Text OpenURL

  60. Xu J, Li M, Kim D, Xu Y: RAPTOR: optimal protein threading by linear programming.

    J Bioinforma Comput Biol 2003, 1(1):95-117. Publisher Full Text OpenURL

  61. Simons K, Kooperberg C, Huang E, Baker D: Assembly of protein tertiary structures from fragments with similar local sequences using simulated annealing and Bayesian scoring functions.

    J Mol Biol 1997, 268(1):209-225. PubMed Abstract | Publisher Full Text OpenURL

  62. Roy A, Kucukural A, Zhang Y: I-TASSER: a unified platform for automated protein structure and function prediction.

    Nat Protoc 2010, 5(4):725-738. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  63. Zhang Y: I-TASSER: Fully automated protein structure prediction in CASP8.

    Proteins: Structure, Function, and Bioinformatics 2009, 77(S9):100-113. Publisher Full Text OpenURL

  64. Zhang Y: I-TASSER server for protein 3D structure prediction.

    BMC Bioinforma 2008, 9(1):40. BioMed Central Full Text OpenURL

  65. Šali A, Potterton L, Yuan F, van Vlijmen H, Karplus M: Evaluation of comparative protein modeling by MODELLER.

    Proteins: Structure, Function, and Bioinformatics 1995, 23(3):318-326. Publisher Full Text OpenURL

  66. Fiser A, Sali A: Modeller: generation and refinement of homology-based protein structure models.

    Methods Enzymol 2003, 374:461-491. PubMed Abstract | Publisher Full Text OpenURL

  67. Soding J, Biegert A, Lupas A: The HHpred interactive server for protein homology detection and structure prediction.

    Nucleic Acids Res 2005, 33(Web Server Issue):W244-W248. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  68. Xu D, Zhang Y: Ab initio protein structure assembly using continuous structure fragments and optimized knowledge‐based force field.

    Proteins: Structure, Function, and Bioinformatics 2012. OpenURL

  69. Zhou H, Skolnick J: Ab initio protein structure prediction using chunk-TASSER.

    Biophys J 2007, 93(5):1510-1518. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  70. Wallner B, Larsson P, Elofsson A: Pcons. net: protein structure prediction meta server.

    Nucleic Acids Res 2007, 35(suppl 2):W369-W374. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  71. Karplus K, Barrett C, Hughey R: Hidden Markov models for detecting remote protein homologies.

    Bioinformatics 1998, 14(10):846-856. PubMed Abstract | Publisher Full Text OpenURL

  72. Peng J, Xu J: Low-homology protein threading.

    Bioinformatics 2010, 26(12):i294-i300. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  73. Yang Y, Faraggi E, Zhao H, Zhou Y: Improving protein fold recognition and template-based modeling by employing probabilistic-based matching between predicted one-dimensional structural properties of query and corresponding native properties of templates.

    Bioinformatics 2011, 27(15):2076-2082. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  74. Moult J, Fidelis K, Kryshtafovych A, Rost B, Hubbard T, Tramontano A: Critical assessment of methods of protein structure prediction-round VII.

    Proteins: Structure, Function, and Bioinformatics 2007, 69(Suppl 8):3-9. OpenURL

  75. Moult J, Fidelis K, Kryshtafovych A, Tramontano A: Critical assessment of methods of protein strucutre prediction – round IX.

    Protiens 2011, 79(S10):1-5. Publisher Full Text OpenURL

  76. Monastyrskyy B, Fidelis K, Moult J, Tramontano A, Kryshtafovych A: Evaluation of disorder predictions in CASP9.

    Proteins 2011, 79(S10):107-118. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  77. Monastyrskyy B, Fidelis K, Tramontano A, Kryshtafovych A: Evaluation of residue-residue contact prediction in CASP9.

    Proteins 2011, 79(S10):119-125. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  78. Cozzetto D, Kryshtafovych A, Fidelis K, Moult J, Rost B, Tramontano A: Evaluation of template-based models in CASP8 with standard measures.

    Proteins: Structure, Function, and Bioinformatics 2009, 77(Suppl 9):000-000. OpenURL

  79. Mariani V, Kiefer F, Schmidt T, Haas J, Schwede T: Assessment of template based protein structure predictions in CASP9.

    Proteins 2011, 79(S10):37-58. PubMed Abstract | Publisher Full Text OpenURL

  80. Kinch L, Shi SY, Cong Q, Cheng H, Liao Y, Grishin NV: CASP9 assessment of free modeling target predictions.

    Proteins 2011, 79(S10):59-73. PubMed Abstract | Publisher Full Text OpenURL

  81. Benkert P, Tosatto S, Schomburg D: QMEAN: a comprehensive scoring function for model quality assessment.

    Proteins 2008., 71(1) OpenURL

  82. Cozzetto D, Kryshtafovych A, Tramontano A: Evaluation of CASP8 model quality predictions.

    Proteins: Structure, Function, and Bioinformatics 2009, 77(S9):157-166. Publisher Full Text OpenURL

  83. Eisenberg D, Luthy R, Bowie J: VERIFY3D: assessment of protein models with three-dimensional profiles.

    Methods Enzymol 1997, 277:396-404. PubMed Abstract OpenURL

  84. Larsson P, Skwark M, Wallner B, Elofsson A: Assessment of global and local model quality in CASP8 using Pcons and ProQ.

    Proteins 2009, 77(S9):167-172. PubMed Abstract | Publisher Full Text OpenURL

  85. McGuffin L, Roche D: Rapid model quality assessment for protein structure predictions using the comparison of multiple models without structural alignments.

    Bioinformatics 2010, 26(2):182-188. PubMed Abstract | Publisher Full Text OpenURL

  86. Paluszewski M, Karplus K: Model Quality Assessment using Distance Constraints from Alignments.

    Proteins 2008, 75:540-549. OpenURL

  87. Kryshtafovych A, Fidelis K, Tramontano A: Evaluation of model quality predictions in CASP9.

    Proteins 2011, 79(S10):91-109. PubMed Abstract | Publisher Full Text OpenURL

  88. Moult J, Fidelis K, Kryshtafovych A, Rost B, Tramontano A: Critical assessment of methods of protein structure prediction (CASP)-round VIII.

    2009.

    (Accpeted)

  89. MacCallum JL, Perez A, Schnieders MJ, Hua L, Jacobson MP, Dill KA: Assessment of protein structure refinement in CASP9.

    Proteins 2011, 79(S10):74-90. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  90. Baldi P, Pollastri G: The principled design of large-scale recursive neural network architectures–DAG-RNNs and the protein structure prediction problem.

    J Mach Learn Res 2003, 4:575-602. OpenURL

  91. Bernstein FC, Koetzle TF, Williams GJB, Meyer EF: The protein data bank: A computer-based archival file for macromolecular structures*.

    J Mol Biol 1977, 112(3):535-542. PubMed Abstract | Publisher Full Text OpenURL

  92. Deng X, Eickholt J, Cheng J: PreDisorder: ab initio sequence-based prediction of protein disordered regions.

    BMC Bioinforma 2009, 10(1):436. BioMed Central Full Text OpenURL

  93. Deng X, Eickholt J, Cheng J: A comprehensive overview of computational protein disorder prediction methods.

    Mol BioSyst 2011, 8. OpenURL

  94. Wu S, Szilagyi A, Zhang Y: Improving protein structure prediction using multiple sequence-based contact predictions.

    Structure 2011, 19(8):1182-1191. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  95. Tegge AN, Wang Z, Eickholt J, Cheng J: NNcon: improved protein contact map prediction using 2D-recursive neural networks.

    Nucleic Acids Res 2009, 37(suppl 2):W515-W518. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  96. Cheng J, Baldi P: Improved residue contact prediction using support vector machines and a large feature set.

    BMC Bioinforma 2007, 8(1):113. BioMed Central Full Text OpenURL

  97. Ezkurdia I, Graña O, Izarzugaza JMG, Tress ML: Assessment of domain boundary predictions and the prediction of intramolecular contacts in CASP8.

    Proteins: Structure, Function, and Bioinformatics 2009, 77(S9):196-209. Publisher Full Text OpenURL

  98. Izarzugaza JMG, Graña O, Tress ML, Valencia A, Clarke ND: Assessment of intramolecular contact predictions for CASP7.

    Proteins: Structure, Function, and Bioinformatics 2007, 69(S8):152-158. Publisher Full Text OpenURL

  99. Cheng J, Saigo H, Baldi P: Large scale prediction of disulphide bridges using kernel methods, two dimensional recursive neural networks, and weighted graph matching.

    Proteins: Structure, Function, and Bioinformatics 2006, 62(3):617-629. OpenURL

  100. Baldi P, Cheng J, Vullo A: Large-scale prediction of disulphide bond connectivity. The MIT Press, Cambridge, MA; 2004:97-104. [Advances in Neural Information Processing Systems 17: 2004] OpenURL

  101. Cheng J, Baldi P: Three-stage prediction of protein β-sheets by neural networks, alignments and graph algorithms.

    Bioinformatics 2005, 21(suppl 1):i75-i84. PubMed Abstract | Publisher Full Text OpenURL

  102. Wang Z, Eickholt J, Cheng J: MULTICOM: a multi-level combination approach to protein structure prediction and its assessments in CASP8.

    Bioinformatics 2010, 26(7):882-888. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  103. Zhang Y, Skolnick J: Scoring function for automated assessment of protein structure template quality.

    Proteins: Structure, Function, and Bioinformatics 2004, 57(4):702-710. Publisher Full Text OpenURL

  104. Berman H, Westbrook J, Feng Z, Gilliland G, Bhat T, Weissig H, Shindyalov I, Bourne P: The protein data bank.

    Nucleic Acids Res 2000, 28(1):235-242. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  105. Zemla A: LGA: a method for finding 3D similarities in protein structures.

    Nucleic Acids Res 2003, 31(13):3370-3374. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  106. Wang Z, Eickholt J, Cheng J: APOLLO: a quality assessment service for single and multiple protein models.

    Bioinformatics 2011, 27(12):1715-1716. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  107. Wang Z, Tegge AN, Cheng J: Evaluating the absolute quality of a single protein model using structural features and support vector machines.

    Proteins: Structure, Function, and Bioinformatics 2009, 75(3):638-647. Publisher Full Text OpenURL

  108. Cheng J, Wang Z, Tegge A, Eickholt J: Prediction of global and local quality of CASP8 models by MULTICOM series.

    Proteins 2009, 77(S9):181-184. PubMed Abstract | Publisher Full Text OpenURL

  109. Wang Z, Cheng J: An iterative self-refining and self-evaluating approach for protein model quality estimation.

    Protein Sci 2012, 21(1):142-151. PubMed Abstract | Publisher Full Text OpenURL

  110. Cheng J, Randall A, Baldi P: Prediction of protein stability changes for single site mutations using support vector machines.

    Proteins: Structure, Function, and Bioinformatics 2006, 62(4):1125-1132. OpenURL

  111. Gilis D, Rooman M: PoPMuSiC, an algorithm for predicting protein mutant stability changes. Application to prion proteins.

    Protein Engineering 2000, 13(12):849-856. PubMed Abstract | Publisher Full Text OpenURL

  112. Worth CL, Preissner R, Blundell TL: SDM—a server for predicting effects of mutations on protein stability and malfunction.

    Nucleic Acids Res 2011, 39(suppl 2):W215-W222. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  113. Capriotti E, Fariselli P, Casadio R: I-Mutant2. 0: predicting stability changes upon mutation from the protein sequence or structure.

    Nucleic Acids Res 2005, 33(suppl 2):W306-W310. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  114. Parthiban V, Gromiha MM, Schomburg D: CUPSAT: prediction of protein stability upon point mutations.

    Nucleic Acids Res 2006, 34(suppl 2):W239-W242. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  115. Lin G, Wang Z, Xu D, Cheng J: SeqRate: sequence-based protein folding type classification and rates prediction.

    BMC Bioinforma 2010, 11(Suppl 3):S1. BioMed Central Full Text OpenURL

  116. Deng X, Cheng J: MSACompro: Protein Multiple Sequence Alignment Using Predicted Secondary Structure, Solvent Accessibility, and Residue-Residue Contacts.

    BMC Bioinforma 2011, 12:472. BioMed Central Full Text OpenURL

  117. Thompson JD, Koehl P, Ripp R, Poch O: BAliBASE 3.0: latest developments of the multiple sequence alignment benchmark.

    Proteins: Structure, Function, and Bioinformatics 2005, 1:127-136. OpenURL

  118. Dai J, Cheng J: HMMEditor: a visual editing tool for profile hidden Markov model.

    BMC genomics 2008, 9(Suppl 1):S8. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL