A new two-stage genetic programming classification algorithm and its applications
Abstract
This work aims to find a better solution from an improved genetic programming (GP) algorithm for classification problems without increasing computation costs as far as possible. Firstly, the standard GP algorithm is difficult to succeed in finding better individuals since too large search landscape and it is easy to run into local optimum when evolution reaches a certain stage, while, by enlarging the evolutionary generation or the size of population might increase computation complexity. So, a two-stage GP may be a good solution for these. In the first stage, GP is used to induce a relatively simple classifier and construct features; in the second stage, GP is executed on these features to evolve a better classifier. Secondly, in order to improve the convergence, a new initialization (NI) strategy and a new function operator selection method are designed. In this paper, a NI strategy based two-stage GP algorithm (NITGP) is proposed, and compares with the standard GP on a set of artificial, real-world datasets and image edge detection tasks. The experimental results show that our approach can evolve classifiers with better performance.
Get full access to this article
View all access and purchase options for this article.
References
Abdulhamid F, Song A, Neshatian K, Zhang MJ (2012) Evolving genetic programming classifiers with loop structures. In: CEC’12 The Proceedings of WCCI 2012 IEEE World Congress on Computational Intelligence, Brisbane, QLD, 2012, pp. 1–8.
Al-Sahaf H, Mengjie Zhang, Johnston M (2015) Image descriptor: A genetic programming approach to multiclass texture classification. In: 2015 IEEE Congress on Evolutionary Computation (CEC’12), Sendai, Japan, 2015, pp. 1–8.
Al-Sahaf H, Song A, Neshatian K, Zhang MJ (2012) Extracting image features for classification by two-tier genetic programming. In: 2012 IEEE Congress on Evolutionary Computation (CEC’12), Brisbane, QLD, 2012, pp. 25–28.
Aslam MW, Zhu Z, Nandi AK (2012) Automatic modulation classification using combination of genetic and KNN. IEEE Transactions on Wireless Communication 11(8): 2741–2750.
Atkins D, Neshatian K, Zhang M (2011) A domain independent genetic programming approach to automatic feature extraction for image classification. In: IEEE Congress on Evolutionary Computation (CEC’11), New Orleans, LA, 2011, pp. 238–245.
Basturk A, Gunay E (2009) Efficient edge detection in digital images using a cellular neural network optimized by differential evolution algorithm. Expert Systems with Applications Part 2 36(2): 2645–2650.
Basu M (2002) Gaussian-based edge-detection methods: a survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 32(3): 252–260.
Bhowan U, Johnston M, Zhang MJ (2012) Developing new fitness functions in genetic programming for classification with unbalanced data. IEEE Transactions on Systems, Man, and Cybernetics-Part B 42(2): 406–421.
Davis RA, Charlton AJ, Oehlschlager S, Wilson JC (2006) Novel feature selection method for genetic programming using metabolomic H NMR data. Chemometrics and Intelligent Laboratory Systems 81(1): 50–59.
Espejo PG, Ventura S, Herrera F (2009) A survey on the application of genetic programming to classification. IEEE Systems, Man, and Cybernetics Society. C 40(2): 121–144.
Frank A, Asuncion A (2010) UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science.
Fu WL, Johnston M, Zhang MJ (2011) Genetic programming for edge detection: A global approach. In: 2011 IEEE Congress on Evolutionary Computation (CEC), New Orleans, LA, 2011, pp. 254–261.
Fu WL, Johnston M, Zhang MJ (2014) Low-level feature extraction for edge detection using genetic programming. IEEE Transactions on Cybernetics 44(8): 1459–1472.
Fu WL, Johnston M, Zhang MJ (2015) Distribution-based invariant feature construction using genetic programming for edge detection. Soft Computing 19(8): 2371–2389.
Harvey NR, Brumby SP, Perkins S, et al. (2002) Image feature extraction: GENIE vs conventional supervised classification techniques. IEEE Geoscience and Remote Sensing Society. 40 (2): 393–404.
Huang JJ, Tzeng GH, Ong CS (2006) Two-stage genetic programming (2SGP) for the credit scoring model. Applied Mathematics and Computation. 174(2): 1093–1053.
Koza JR (1994) Genetic programming as a means for programming computers by natural selection. Statistics and Computing 4(2): 87–112.
Krawiec K (2002) Genetic programming-based construction of features for machine learning and knowledge discovery tasks, Genetic Programming and Evolvable Machines. 3(4): 329–343.
Lam BT, Ciesielski V (2004) Discovery of human competitive image texture feature extraction programs using genetic programming. In: GECCO’04: Proceedings of the Conference on Genetic and Evolutionary Computation, 2004, pp. 1114–1125. Berlin, Heidelberg: Springer.
Loveard T, Ciesielski V (2001) Representing classification problems in genetic programming. In: Proceedings of the 2001 IEEE Congress on Evolutionary Computation (CEC’01), Seoul, South Korea, 2001, Vol. 2, pp. 1070–1077.
Luke S, Spector L (1997) A comparison of crossover and mutation in genetic programming. In: Genetic Programming 1997: Proceedings of the Second Annual Conference (GP97) (eds Koza J, et al.), 1997 pp. 240–248. San Francisco: Morgan Kaufmann.
Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: ICCV’01: Proceedings of the 8th IEEE International Conference on Computer Vision, Vancouver, Canada, 2001, pp. 416–423.
Martin D, Fowlkes C, Malik J (2004) Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence. 26(5): 530–549.
Michael SW, Affenzeller M, Wagner S (2009) Using enhanced genetic programming techniques for evolving classifiers in the context of medical diagnosis. Genetic Programming and Evolvable Machines. 10(2): 111–140.
Neshatian K, Zhang MJ (2009) Unsupervised elimination of redundant features using genetic programming. In: Australasian Joint Conference on Artificial Intelligence, Springer-Verlag, Melbourne, pp. 432–442.
Neshatian K, Zhang MJ, Andreae P (2012) A filter approach to multiple feature construction for symbolic learning classifiers using genetic programming. IEEE Trans. on Evolutionary Computation 16(5): 645–661.
Papari G, Petkov N (2011) Edge and line oriented contour detection: state of the art. Image and Vision Computing 29(2–3): 79–103.
Poli R, Langdon WB, McPhee NF (2008) A Field Guide to Genetic Programming 2008. Available at: http://www.gp-fieldguide.org.uk
Richard A, Davis A, Charlton J, et al. (2006) Novel feature selection method for genetic programming using metabolomic H NMR data. Chemometrics and Intelligent Laboratory Systems 81(1): 50–59.
Riekert M, Malan KM, Engelbrect AP (2009) Adaptive genetic programming for dynamic classification problems. In: CEC’09: Proceedings of the Eleventh conference on Congress on Evolutionary Computation, New York, USA, 2009, pp. 674–681.
Sandin I, Andrade G, Salles T, et al. (2012) Aggressive and effective feature selection using genetic programming. In: The Proceedings of WCCI 2012 IEEE World Congress on Computational Intelligence CEC’12, Brisbane, Australia, 2012, pp. 1–8.
Smart W, Zhang MJ (2003) Classification strategies for image classification in genetic programming. In: Proceeding of Image and Vision Computing Conference, Palmerston North, 2003, pp. 402–407.
Tamboli AS, Shah MA (2011) A generic structure of object classification using genetic programming. In: International Conference on Communication Systems and Network Technologies (CSNT), Katra, Jammu, India, 2011, pp. 723–728.
Wang P, Tang K, Tsang PKE, Yao X (2011) A memetic genetic programming with decision tree-based local search for classification problems. In: IEEE Congress on Evolutionary Computation (CEC), New Orleans, 2011, pp. 917–924.
Zhang MJ, Ciesielski V (1999) Genetic programming for multiple class object detection. In: Proceedings of the 12th Australian Joint Conference on Artificial Intelligence (AI’99), 1999, Vol. 1747, pp. 180–192. Berlin, Heidelberg: Springer, LNCS.
Zhang MJ, Ciesielski VB, Andreae P (2003) A domain-independent window approach to multiclass object detection using genetic programming. EURASIP Journal on Applied Signal Processing 2003(8): 841–459.
Zhang MJ, Gao XY, Lou WJ (2007) A new crossover operator in genetic programming for object classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics). 37(5): 1332–1343.
Zhang Y, Rockett P (2005) Evolving optimal feature extraction using multi-objective genetic programming: A methodology and preliminary study on edge detection. In: GECCO’05: Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation, New York, 2005, pp. 795–802. ACM.
Zhang Y, Rockett PI (2009) A generic multi-dimensional feature extraction method using multiobjective genetic programming. Evolutionary Computation. 17(1): 89–115.
Zhang Y, Zhang MJ (2004) A multiple-output program tree structure in genetic programming. In: Proceedings of the 7th Asia-Pacific Conference on Complex Systems Cairns Convention Centre, Cairns, Australia, 2004. Available at: http://homepages.mcs.vuw.ac.nz/∼mengjie/papers/will-meng-apwgp04.pdf
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: July 6, 2017
Issue published: May 2018
Keywords
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Transactions of the Institute of Measurement and Control.
View All Journal MetricsArticle usage*
Total views and downloads: 79
*Article usage tracking started in December 2016
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 1 view articles Opens in new tab
Crossref: 2
- Big Data and Internet of Things
- Multi-objective robust design approach usage in integration of bond graph and genetic programming
Figures and tables
Figures & Media
Tables
View Options
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
I am signed in as:
View my profileSign out
I can access personal subscriptions, purchases, paired institutional access and free tools such as favourite journals, email alerts and saved searches.
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
