Use of Statistical Outlier Detection Method in Adaptive Evolutionary Algorithms

Whitacre, Dr James M and Pham, Dr Tuan Q. and Sarker, Dr Ruhul A. (2006) Use of Statistical Outlier Detection Method in Adaptive Evolutionary Algorithms. [Conference Paper]

Full text available as:

PDF - Accepted Version


In this paper, the issue of adapting probabilities for Evolutionary Algorithm (EA) search operators is revisited. A framework is devised for distinguishing between measurements of performance and the interpretation of those measurements for purposes of adaptation. Several examples of measurements and statistical interpretations are provided. Probability value adaptation is tested using an EA with 10 search operators against 10 test problems with results indicating that both the type of measurement and its statistical interpretation play significant roles in EA performance. We also find that selecting operators based on the prevalence of outliers rather than on average performance is able to provide considerable improvements to adaptive methods and soundly outperforms the non-adaptive case.

Item Type:Conference Paper
Keywords:Evolutionary Algorithm, Genetic Algorithm, Feedback Adaptation
Subjects:Computer Science > Artificial Intelligence
ID Code:6579
Deposited By:Whitacre, Dr James M
Deposited On:06 Jul 2009 10:42
Last Modified:11 Mar 2011 08:57

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

[1] Barbosa, H. J. C. and e Sá, A. M. On Adaptive Operator

Probabilities in Real Coded Genetic Algorithms, In

Workshop on Advances and Trends in Artificial Intelligence

for Problem Solving (SCCC '00), (Santiago, Chile,

November 2000).

[2] Bedau, M. A. and Packard, N. H. Evolution of evolvability

via adaptation of mutation rates. BioSystems 69 (2003), 143-


[3] Boeringer D. W., Werner D. H., Machuga D. W. A

simultaneous parameter adaptation scheme for geneticalgorithms

with application to phased array synthesis, IEEE

Trans. on Antannas and Propagation 53, 1 (Jan. 2005),

356-371 Part 2.

[4] Chew, E. P., Ong, C. J., and Lim, K. H. Variable period

adaptive genetic algorithm. Comput. Ind. Eng. 42, 2-4 (Jun.

2002), 353-360.

[5] Davis, L. Handbook of Genetic Algorithms, van Nostrand

Reinhold, New York, 1991.

[6] De Jong, K. An analysis of the behaviour of a class of

genetic adaptive systems. Ph. D Thesis, University of

Michigan, Ann Arbor, Michigan, 1975.

[7] Eiben, Á. E., Hinterding R., and Michalewicz Z. Parameter

control in evolutionary algorithms, IEEE Trans. Evol.

Comput., 3 (Jul. 1999), 124–141.

[8] Espinoza, F. P. Minsker, B. S. and Goldberg, D. E.

Adaptive Hybrid Genetic Algorithm for Groundwater

Remediation Design. Journal of Water Resources Planning

and Management, 131, 1 (Jan. 2005), 14-24.

[9] Herrera, F. and Lozano, M. Adaptive genetic operators

based on coevolution with fuzzy behaviors. IEEE Trans.

Evolutionary Computation 5, 2 (2001), 149-165.

[10] Herrera, F. and Lozano, M. Tackling real-coded genetic

algorithms: Operators and tools for the behavioural analysis,

Artificial Intelligence Review 12, 4, (1998), 265-319.

[11] Herrera, F., Lozano, M., and Sánchez, A. M. 2005. Hybrid

crossover operators for real-coded genetic algorithms: an

experimental study. Soft Comput. 9, 4 (Apr. 2005), 280-298.

[12] Hong, T. P. Wang, H. S. Lin, W. Y. and Lee, W. Y.

Evolution of Appropriate Crossover and Mutation Operators

in a Genetic Process. Appl. Intell. 16, 1 (2002), 7-17.

[13] Igel, C. Friedrichs, F. and Wiegand, S. Evolutionary

Optimization of Neural Systems: The Use of Strategy

Adaptation. Trends and Applications in Constructive

Approximation. International Series of Numerical

Mathematics, 151, (2005), 103-123.

[14] Janka, E. Vergleich stochastischer Verfahren zur globalen

Optimierung, Diploma Thesis, University of Vienna,

Vienna, Austria, 1999.

[15] Julstrom, B. A. Adaptive operator probabilities in a genetic

algorithm that applies three operators. In Proceedings of the

1997 ACM Symposium on Applied Computing (SAC '97)

(San Jose, California, United States). ACM Press, New

York, NY, 233-238, 1997.

[16] Muhlenbein, H., Schomisch, M. and Born, J. The parallel

genetic algorithm as function optimizer. In Proc. of 4th

International Conference of Genetic Algorithms, 271-278,


[17] Pham, Q.T. Dynamic Optimization of Chemical Engineering

Processes by an Evolutionary Method. Comp. Chem. Eng.,

22 (1998), 1089-1097.

[18] Pham, Q. T. Competitive evolution: a natural approach to

operator selection. In: Progress in Evolutionary

Computation, Lecture Notes in Artificial Intelligence,

(Evolutionary Computation Workshop) (Armidale,

Australia, November 21-22, 1994). Springer-Verlag,

Heidelberg, 1995, 49-60.

[19] Smith, J. and Fogarty, T.C. Operator and parameter

adaptation in genetic algorithms. Soft Computing, 1, 2

(1997), 81-87.

[20] Storn, R. and Price, K. Differential Evolution - A Simple

and Efficient Adaptive Scheme for Global Optimization over

Continuous Spaces. Technical Report TR-95-012,

International Computer Science Institute, Berkeley, CA,


[21] Thierens, D. An adaptive pursuit strategy for allocating

operator probabilities. In Proceedings of the 2005

Conference on Genetic and Evolutionary Computation

(GECCO '05). ACM Press, New York, NY, 2005, 1539-


[22] Tuson, A. and Ross, P. Cost based operator rate adaptation:

An investigation. In Proceedings of the 4th Conference on

Parallel Problem Solving from Nature, number 1141 in

Lecture Notes in Computer Science, Springer, Berlin, 1996,


[23] Whitacre, J. M., Pham, Q. T., Sarker, R. A. Credit

Assignment in Adaptive Evolutionary Algorithms. In

Proceedings of the 2006 Conference on Genetic and

Evolutionary Computation (GECCO '06) (Seattle, USA, July

8-12, 2006). ACM Press, New York, NY, 2006.

[24] Wong Y. Y., Lee K. H., Leung K.S, C.-W. Ho: A novel

approach in parameter adaptation and diversity maintenance

for genetic algorithms. Soft Comput. 7, 8 (2003), 506-515.


Repository Staff Only: item control page