In this paper we discuss the problem of model selection in Genetic Programming. We present empirical comparisons between classical statistical methods (AIC, BIC) adapted to Genetic Programming and the Structural Risk Minimization method (SRM) based on Vapnik-Chervonenkis theory (VC), for symbolic regression problems with added noise. We also introduce a new model complexity measure for the SRM method that tries to measure the non-linearity of the model. The experimentation suggests practical advantages of using VC-based model selection with the new complexity measure, when using genetic training.
Paper
Full text
Model selection in genetic programming
Semantic Scholar · Computer Science · 2010
Abstract
In this paper we discuss the problem of model selection in Genetic Programming. We present empirical comparisons between classical statistical methods (AIC, BIC) adapted to Genetic Programming and the Structural Risk Minimization method (SRM) based on Vapnik-Chervonenkis theory (VC), for symbolic regression problems with added noise. We also introduce a new model complexity measure for the SRM method that tries to measure the non-linearity of the model. The experimentation suggests practical advantages of using VC-based model selection with the new complexity measure, when using genetic training.