Open Access

A Time-Series-Based Feature Extraction Approach for Prediction of Protein Structural Class

EURASIP Journal on Bioinformatics and Systems Biology20082008:235451

DOI: 10.1155/2008/235451

Received: 28 May 2007

Accepted: 10 March 2008

Published: 26 March 2008


This paper presents a novel feature vector based on physicochemical property of amino acids for prediction protein structural classes. The proposed method is divided into three different stages. First, a discrete time series representation to protein sequences using physicochemical scale is provided. Later on, a wavelet-based time-series technique is proposed for extracting features from mapped amino acid sequence and a fixed length feature vector for classification is constructed. The proposed feature space summarizes the variance information of ten different biological properties of amino acids. Finally, an optimized support vector machine model is constructed for prediction of each protein structural class. The proposed approach is evaluated using leave-one-out cross-validation tests on two standard datasets. Comparison of our result with existing approaches shows that overall accuracy achieved by our approach is better than exiting methods.

1. Introduction

Determination of protein structure from its primary sequence is an active area of research in bioinformatics. The knowledge of protein structures plays an important role in understanding their functions. Understanding the rules relating the amino acid sequence to the three-dimensional structure of the protein is one of the major goals of contemporary molecular biology. However, despite more than three decades of both experimental and theoretical efforts prediction of protein structure still remains one of the most difficult issues.

The concept of protein structural classes was originally introduced by Levitt and Chothia [1] based on a visual inspection of polypeptide chain topologies in a dataset of 31 globular proteins. A protein (domain) is usually classified into one of the following four structural classes: , , , and . Structural class categorizes various proteins into groups that share similarities in the local folding patterns. The and classes represent structures that consist of mainly α-helices and β-strands, respectively. The and classes contain both α-helices and β-sheets where the class includes mainly parallel α-helices and β-strands and class includes those in which α-helices and β-strands are largely segregated. Prediction of structural classes is based on identifying these folding patterns based on thousands of already categorized proteins, and applying these patterns to unknown structures but known amino acid sequences. Structural Classification of Proteins (SCOP) [2] is one of the most accurate classifications of protein structural classes and has been constructed by visual inspection and comparison of structures by experts.

In the past two decades several computational techniques for prediction of protein structural classes have been proposed. Prediction is usually a two-step process. In the first step a fixed length feature vector is formed from protein sequences which are of different length. The second step involves a classification algorithm. Klein and Delisi [3] proposed a method for predicting protein structural classes from amino acid sequence. Later on, Klein [4] presented a discriminant analysis based technique for this problem. Zhou et al. [5] in 1992 proposed a weighting method to predict protein structural class from amino acids. A maximum component coefficient method was proposed by Zhang and Chou [6]. A neural network based approach [7] for protein structural classes was also developed using six hydrophobic amino acid patterns together with amino acid composition. A new algorithm that takes into account the coupling effect among different amino acid components of a protein by a covariance matrix is proposed in [8]. In [9], Chou and Zhang introduced Mahalanobis distance to reflect the coupling effect among different amino acids components, improving the accuracy of the current problem. A support vector machine (SVM) method using amino acid composition features for prediction of protein structural class was presented by Cai et al. [10] in 2001 and is one of the most accurate methods for classification. A supervised fuzzy clustering approach based on amino acid composition features was introduced by Shen et al. [11]. A combined approach, LogitBoost, was proposed by Feng et al. [12]. It combines many weak classifiers together to build a stronger classifier. In 2006, Cao et al. [13] proposed a rough set algorithm based on amino acid compositions and 8 physicochemical properties data.

In this paper, a three step procedure is proposed for prediction of protein structural class. The main contribution of this paper is in providing a novel feature vector which is obtained by applying a wavelet-based time-series analysis approach. The proposed feature extraction from protein sequence is inspired from the work of Vannucci and Lio [14] on transmembrane proteins. The fixed length feature vector for classification proposed is derived from ten physicochemical properties of protein sequences. The physicochemical properties are used to convert the protein sequences from symbolic domain to numeric domain and to derive a time series representation for protein sequences. Features are extracted by applying a wavelet-based analysis technique for time series data on mapped protein sequences. The feature vector summarizes the variation of physicochemical properties in the protein sequence. Finally, a support vector machine is trained using the novel feature vector and the parameters are optimized for generating accurate model (providing highest prediction accuracy).

Leave-one-out cross-validation also called jackknife test was performed on the datasets that were constructed by Zhou [15] from SCOP. The datasets were also used by Cai et al. [10], Cao et al. [13] for their experiments. An overall accuracy of 82.97% and 93.94% was achieved for 277 domains and 498 domains datasets, respectively, using the proposed approach.

The paper is organized as follows. In Section 2, we describe the steps followed for extracting wavelet variance features from protein sequences. A brief introduction to support vector machine (SVM) is also provided in this section. Section 3 provides the experiment results obtained for datasets of structural protein sequences. Conclusion follows in Section 4.

2. Method

The proposed approach for identification of structural classes of proteins is divided into three different stages: amino acid mapping, feature extraction, and classification. In the first stage the protein sequences are mapped to various physicochemical scales as provided in the literature. After this mapping procedure the protein sequences become discrete time series data. The second stage involves construction of fixed length feature vector for classification. The feature vector is generated by combining wavelet variance [16] features extracted from different physicochemical scales used for mapping stage. Finally, an SVM-based classification is performed based on the novel extracted features to identify the structural class of a protein sequence.

2.1.Amino Acid Mapping

In this stage, ten different physicochemical amino acid properties were used. The first is the average flexibility indices provided by Bhaskaran and Ponnuswamy [17]. The second is the normalized hydrophobicity scales provided by Cid et al. [18]. The third is the transfer free energy given by M. Charton and B. I. Charton [19] and cited by Simon [20]. The fourth is the residue accessible surface area in folded protein provided by Chothia [21]. The fifth is the relative mutability obtained by multiplying the number of observed mutations by the frequency of occurrence of the individual amino acids and is provided by Dayhoff et al. [22]. The sixth is the isoelectric point provided by Zimmerman et al. [23]. The seventh is the polarity of amino acids provided by Grantham [24]. The eight is the volume of amino acid provided by Fauchere et al. [25]. The ninth is the composition of the amino acids provided by Grantham [24]. The tenth is the molecular weight of the amino acids given by Fasman [26]. The numerical indices representing physicochemical property of amino acids were downloaded from

2.2. Feature Construction

The representation of a protein sequence by a fixed length feature vector is one of the primary tasks of any protein classification technique. In this section, we present a wavelet-based time-series approach for constructing feature vector. Wavelet transform is a technique that decomposes a signal into several groups (vectors) of coefficients. Different coefficient vectors contain information about characteristics of the sequence at different scales. The proposed feature vector contains information about the variability of ten physiochemical properties of protein sequences over different scales. The variability of physiochemical properties is represented in terms of wavelet variance [16].

In the present work, a variation of the orthonormal discrete wavelet transform (DWT) [2728], called the maximal overlap DWT (MODWT) [29] is applied for feature extraction. In past, MODWT has been applied for analysis of atmospheric data [30] and economic time series data [3132]. The MODWT is a highly redundant and nonorthogonal transform. The MODWT was selected over DWT because it can handle any sample size N, while J th order DWT restricts the sample size to multiple of . The property is very useful for analysis of protein sequences, as the length of the sequences is not a multiple of . In addition, MODWT yields an estimator of the variance of the wavelet coefficients that is statistically more efficient than the corresponding estimator based on the DWT.

Let P be an N-dimensional column vector containing the mapped protein sequence series where N is the length of the protein sequence. It is assumed that was collected at time t Δt, where Δt is the time interval between consecutive observation (in the present case Δt is equal to 1 amino acid). The MODWT of P for maximum level J is given by
where Q is a column vector of length , and is an real-valued nonorthogonal matrix. The vector of MODWT coefficients given in (1) may be decomposed into vectors:
where (where ) and are column vectors of length N. The vector contains the MODWT wavelet coefficients associated with change in P on scale of length , while is a vector containing the MODWT scaling coefficients associated variation at scales of length and higher. In addition to MODWT coefficients, the matrix can be decomposed into submatrices, each of them and is given by
Instead of using the wavelet and scaling filters, the MODWT utilizes the rescaled filters, that is, and (where, ). The terms and are wavelet and scaling filters, respectively. The wavelet filter approximates high-pass filter, and the scaling filter approximates low pass filter. Details regarding wavelet and scaling filters can be found in [29]. The dimensional submatrix is constructed by circularly shifting the rescaled wavelet filter by integer units to the right so that
Similarly, can be obtained. The MODWT is an energy-preserving transform [2933] and is given as
The sample variance (empirical power) of P is decomposed into pieces that are associated with scales
where is the sample variance of P, and is its mean. The term represents the contribution to the sample variance of P due to change at scale . For example, the average flexibility indices property of a protein sequence in terms of wavelet variance vector is given as follows:
where J is the maximum level of decomposition of the time series data, that is, protein sequence. Similarly, wavelet variance vectors for hydrophobicity, transfer free energy, residue accessible surface area, relative mutability, isoelectric point, polarity, volume, composition, and molecular weight are calculated and are represented by respectively. The feature vector is constructed by concatenating all seven wavelet variance vectors and is given as follows:

The physiochemical variation of a protein sequence is summarized in the proposed feature vector. The dimension of is equal to and is dependent on the number of levels (J) to which the time series data (i.e., protein sequence) has to be decomposed. The value of J is further dependent on the length of time series data (i.e, protein sequence length) and , where N is the number of observation points in the time series or the length of protein. As most of the protein sequences taken up for the experiment have length greater than 32, we have selected . In this study, Daubechies [27] wavelet has been used for analysis.

2.3. Classification

The SVM was proposed by Cortes and Vapnik [34] as a very effective technique for pattern classification. SVM is based on the principle of structural risk minimization (SRM), which bounds the generalization error to the sum of training set error and a term depending on the Vapnik-Chervonenkis dimension [34] of the learning machine. The SVM induction principle minimizes an upper bound on the error rate of a learning machine on test data (i.e., generalization error), rather than minimizing the training error itself which is used in empirical risk minimization. This helps them to generalize well on the unseen data.

An open-source SVM implementation called LIBSVM [35] was used for classification. It provides various kernel types: radial basis function (RBF), linear, polynomial and sigmoid. Experiments were conducted using different kernels; however the RBF was selected because of its superior performance for the current work. Further, for finding the optimum values of parameters for RBF kernel, LIBSVM provides an automatic grid search technique using cross-validation. Basically various pairs of are tried and the one that provides best cross-validation accuracy is selected.

3. Experimental Results

To evaluate the performance of our approach two datasets of protein sequences constructed by Zhou [15] are used. The first dataset consists of 277 domains, of which 70 are domains, 61 domains, 81 are domains, and 65 are domains. The second dataset consists of 498 domains, of which 107 are domains, 126 domains, 136 are domains, and 129 are domains. The datasets were preprocessed before using for the experiment. The protein sequences having length less than 32 amino acids (as , where J is the maximum level of decomposition for wavelet transform) were removed from the dataset. The number of protein sequences obtained after preprocessing both datasets is provided in Table 1.
Table 1

Dataset for the current study.















The performance of the SVM classifier is measured using leave-one-out cross-validation (LOOCV) technique. LOOCV is n-fold cross-validation, where "n" is the number of instances in the datatset. Each instance in turn is left out, and the learning method is trained on all the remaining instances. It is judged by its correctness on the remaining instances-one or zero success or failure, respectively. The results of all "n" judgments, one for each member of the dataset, are averaged, and that average represents the final error estimate.

The classification of a protein sequence into one of the four structural classes is a multi-class classification problem. For identifying four different structural classes one-versus-others approach was followed. Four different SVMs were constructed, each specific to one class. The k th SVM was trained with all the samples of the k th class with positive labels and samples of remaining classes with negative labels. For example (Table 2, column 1 and Table 3, column 1), the SVMs for domains protein sequences are positive labeled where as domains, domains, and domains protein sequences are negative labeled. The experimental results obtained from the four SVMs for dataset1 and dataset2 are presented in Tables 2 and 3, respectively. The optimal SVM parameters obtained for the experiments are also provided in Tables 2 and 3. The accuracies for the current problem were calculated by applying the standard definition provided by previous work for multiclass protein sequence classification problem using SVM [3638]. The prediction accuracy of the structural classes and overall prediction accuracy are given by
Table 2

Experimental result of one-versus-others test on dataset1 evaluated using LOOCV.


True positive (TP)





False negative (FN)





True negative (TN)





False positive (FP)





in %





Area under curve (AUC)





Optimal SVM parameters


Table 3

Experimental result of one-versus-others test on dataset2 evaluated using LOOCV.


True positive (TP)





False negative (FN)





True negative (TN)





False positive (FP)





in %





Area under curve (AUC)





Optimal SVM parameters


where M is the total number of protein sequences, is the number of protein sequences of class "k," is the number of correctly predicted protein sequences of class "k." The accuracy of each class and overall accuracy for datset1 and dataset2 calculated using (9) are shown in Table 4. The overall accuracy obtained by our approach for dataset1 and dataset2 is 82.97% and 93.94% respectively. The overall performance of our approach is better than existing techniques. Further, the receiver operating characteristic (ROC) curve and area under curve (AUC) for the proposed protein structural classification task were also calculated. An ROC curve is a plot of true positive rate as the ordinate versus the false positive rate as the abscissa; for a classifier, it is obtained by continuously varying the threshold associated with the decision function [39]. The ROC and AUC obtained for the one-versus-other experiment of dataset1 and dataset2 are presented in Figures 1 and 2, respectively. The ROC curve shown in Figure 1(a) is obtained when domains protein sequences in dataset1 are positive labeled, where as domains, domains, and domains protein sequences in dataset1 are negative labeled. Similarly, ROC curve for other classifications is also obtained.
Table 4

Comparison of Leave-one-out cross-validation accuracy obtained for protein structural classification problem on the two datasets by our approach and existing approaches.



Prediction accuracy for each structural class (%)

Overall accuracy (%)




Our approach







Component coupled [6]







Neural network [7]







SVM [10]







Rough sets [13]







Our approach







Component coupled [6]







Neural network [7]







SVM [10]







Rough sets [13]






Figure 1

The ROC curve for identification of four structural classes of dataset1, domains (a), domains (b), domains (c), and domains (d).

Figure 2

The ROC curve for identification of four structural classes of dataset2, domains (a), domains (b), domains (c), and domains (d).

4. Conclusion

In this work, we have presented a novel wavelet variance based feature vector for prediction of protein structural class. The aim of this research is to provide a new and complementary set of features for the current problem. Based on pattern recognition framework, the proposed approach is divided into three different tasks: amino acid mapping, feature construction, and classification. The feature vector summarizes the variation of ten different physicochemical properties of amino acids. The feature extraction technique is based on wavelet based time series analysis. Experiments were performed on two standard datasets (constructed by Zhou [15]). The result of LOOCV test shows that the proposed method achieves accuracy better than existing methods. The proposed approach can also be applied for identification of membrane protein type, enzyme family classification, and many others.

Authors’ Affiliations

Department of Electronics and Computer Engineering, Indian Institute of Technology Roorkee
Information Science Division, AU-KBC Research Centre, Anna University


  1. Levitt M, Chothia C: Structural patterns in globular proteins. Nature 1976,261(5561):552-558. 10.1038/261552a0View ArticleGoogle Scholar
  2. Murzin AG, Brenner SE, Hubbard T, Chothia C: SCOP: a structural classification of protein database for the investigation of sequence and structures. Journal of Molecular Biology 1992,225(4):713-727.Google Scholar
  3. Klein JP, Delisi C: Prediction of protein structural class from the amino acid sequence. Biopolymers 1986,25(9):1659-1672. 10.1002/bip.360250909View ArticleGoogle Scholar
  4. Klein P: Prediction of protein structural class by discriminant analysis. Biochimica et Biophysica Acta 1986,874(2):205-215. 10.1016/0167-4838(86)90119-6View ArticleGoogle Scholar
  5. Zhou G, Xu X, Zhang C-T: A weighting method for predicting protein structural class from amino acid composition. European Journal of Biochemistry 1992,210(3):747-749. 10.1111/j.1432-1033.1992.tb17476.xView ArticleGoogle Scholar
  6. Zhang C-T, Chou K-C: An optimization approach to predicting protein structural class from amino acid composition. Protein Science 1992,1(3):401-408.View ArticleGoogle Scholar
  7. Metfessel BA, Saurugger PN, Connelly DP, Rich SS: Cross-validation of protein structural class prediction using statistical clustering and neural networks. Protein Science 1993,2(7):1171-1182. 10.1002/pro.5560020712View ArticleGoogle Scholar
  8. Chou K-C: A novel approach to predicting protein structural classes in a (20-1)-D amino acid composition space. Proteins: Structure, Function and Genetics 1995,21(4):319-344. 10.1002/prot.340210406View ArticleGoogle Scholar
  9. Chou K-C, Zhang C-T: Predicting protein folding types by distance functions that make allowances for amino acid interactions. Journal of Biological Chemistry 1994,269(35):22014-22020.Google Scholar
  10. Cai Y-D, Liu X-J, Xu X-B, Zhou G-P: Support vector machines for predicting protein structural class. BMC Bioinformatics 2001, 2, article 3: 1-5.Google Scholar
  11. Shen H-B, Yang J, Liu X-J, Chou K-C: Using supervised fuzzy clustering to predict protein structural classes. Biochemical and Biophysical Research Communications 2005,334(2):577-581. 10.1016/j.bbrc.2005.06.128View ArticleGoogle Scholar
  12. Feng K-Y, Cai Y-D, Chou K-C: Boosting classifier for predicting protein domain structural class. Biochemical and Biophysical Research Communications 2005,334(1):213-217. 10.1016/j.bbrc.2005.06.075View ArticleGoogle Scholar
  13. Cao Y, Liu S, Zhang L, Qin J, Wang J, Tang K: Prediction of protein structural class with rough sets. BMC Bioinformatics 2006, 7, article 20: 1-6.Google Scholar
  14. Vannucci M, Lio P: Non-decimated wavelet analysis of biological sequences: applications to protein structure and genomics. Sankhya B 2001,63(2):218-233.MathSciNetMATHGoogle Scholar
  15. Zhou G-P: An intriguing controversy over protein structural class prediction. Journal of Protein Chemistry 1998,17(8):729-738. 10.1023/A:1020713915365View ArticleGoogle Scholar
  16. Percival DB: On estimation of wavelet variance. Biometrika 1995,82(3):619-631. 10.1093/biomet/82.3.619MathSciNetView ArticleMATHGoogle Scholar
  17. Bhaskaran R, Ponnuswamy PK: Positional flexibilities of amino acid residues in globular proteins. International Journal of Peptide and Protein Research 1988, 32: 241-255.View ArticleGoogle Scholar
  18. Cid H, Bunster M, Canales M, Gazitúa F: Hydrophobicity and structural classes in proteins. Protein Engineering 1992,5(5):373-375. 10.1093/protein/5.5.373View ArticleGoogle Scholar
  19. Charton M, Charton BI: The structural dependence of amino acid hydrophobicity parameters. Journal of Theoretical Biology 1982,99(4):629-644. 10.1016/0022-5193(82)90191-6View ArticleGoogle Scholar
  20. Simon Z: Quantum Biochemistry and Specific Interactions. Abacus Press, Tunbridge Wells, Kent, UK; 1976.Google Scholar
  21. Chothia C: The nature of the accessible and buried surfaces in proteins. Journal of Molecular Biology 1976,105(1):1-12. 10.1016/0022-2836(76)90191-1View ArticleGoogle Scholar
  22. Dayhoff MO, Schwartz RM, Orcutt BC: A model of evolutionary change in proteins. In Atlas of Protein Sequence and Structure. Volume 5. Edited by: Dayhoff MO. National Biomedical Research Foundation, Washington, DC, USA; 1978:345-352.Google Scholar
  23. Zimmerman JM, Eliezer N, Simha R: The characterization of amino acid sequences in proteins by statistical methods. Journal of Theoretical Biology 1968,21(2):170-201. 10.1016/0022-5193(68)90069-6View ArticleGoogle Scholar
  24. Grantham R: Amino acid difference formula to help explain protein evolution. Science 1974,185(4154):862-864. 10.1126/science.185.4154.862View ArticleGoogle Scholar
  25. Fauchere J-L, Charton M, Kier LB, Verloop A, Pliska V: Amino acid side chain parameters for correlation studies in biology and pharmacology. International Journal of Peptide and Protein Research 1988,32(4):269-278.View ArticleGoogle Scholar
  26. Fasman GD: Practical Handbook of Biochemistry and Molecular Biology. CRC Press, Boca Raton, Fla, USA; 1989.Google Scholar
  27. Daubechies I: Ten Lectures on Wavelets. SIAM, Philadelphia, Pa, USA; 1992.View ArticleMATHGoogle Scholar
  28. Mallat SG: Theory for multiresolution signal decomposition: the wavelet representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 1989,11(7):674-693. 10.1109/34.192463View ArticleMATHGoogle Scholar
  29. Percival DB, Walden AT: Wavelet Methods for Time Series Analysis. Cambridge Press, Cambridge, UK; 2002.MATHGoogle Scholar
  30. Whitcher B, Guttorp P, Percival DB: Wavelet analysis of covariance with application to atmospheric time series. Journal of Geophysical Research 2000,105(D11):941-962.View ArticleGoogle Scholar
  31. Gallegati M, Gallegati M: Wavelet variance and correlation analyses of output in G7 countries. Macroeconomics 2005, 0512017: 1-19.MATHGoogle Scholar
  32. Xiong X, Zhang X-T, Zhang W, Li C-Y: Wavelet-based beta estimation of China stock market. Proceedings of the 4th International Conference on Machine Learning and Cybernetics (ICMLC '05), vol. 6 Guangzhou, China, August 2005 3501-3505.Google Scholar
  33. Percival DB, Mofjeld HO: Analysis of subtidal coastal sea level fluctuations using wavelets. Journal of the American Statistical Association 1997,92(439):868-880. 10.2307/2965551View ArticleMATHGoogle Scholar
  34. Cortes C, Vapnik V: Support vector networks. Machine Learning 1995,20(3):273-297.MATHGoogle Scholar
  35. Chang CC, Lin CJ: LIBSVM: a library for support vector machines.National Taiwan University, Taipei, Taiwan; 2004. []Google Scholar
  36. Baldi P, Brunak S, Chauvin Y, Andersen CAF, Nielsen H: Assessing the accuracy of prediction algorithms for classification: an overview. Bioinformatics 2000,16(5):412-424. 10.1093/bioinformatics/16.5.412View ArticleGoogle Scholar
  37. Ding CHQ, Dubchak I: Multi-class protein fold recognition using support vector machines and neural networks. Bioinformatics 2001,17(4):349-358. 10.1093/bioinformatics/17.4.349View ArticleGoogle Scholar
  38. Hua S, Sun Z: Support vector machine approach for protein subcellular localization prediction. Bioinformatics 2001,17(8):721-728. 10.1093/bioinformatics/17.8.721View ArticleGoogle Scholar
  39. Fawcett T: An introduction to ROC analysis. Pattern Recognition Letters 2006,27(8):861-874. 10.1016/j.patrec.2005.10.010MathSciNetView ArticleGoogle Scholar


© Ravi Gupta et al. 2008

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.