-
آرشیو :
نسخه زمستان 1397
-
موضوع :
هوش مصنوعی
-
نویسنده/گان :
شاپوررضا برنجیان، محمد باقر دستغیب
-
کلید واژه :
بهینه¬سازی، الگوریتم ژنتیک، محیط¬ پویا، حافظه، خوشه¬بندی، تخمین تراکم، جفت¬گزینی، جهش، خودسازمانده
-
Title :
Optimizing dynamic issues with critical self-organization and explicit memory
-
Abstract :
Since dynamic components, along with nonlinear constraints and multiple goals, are one of the features that appear frequently in real-world issues, and because it takes a long time for evolutionary calculations to enter the realm of industrial applications. (Especially because of their ability to deal with multifaceted and nonlinear environments) is expected to grow in the scientific community as soon as possible. Today, the use of evolutionary algorithms The basis of natural biological behaviors is of particular importance in solving these problems. Genetic algorithms can be mentioned among these algorithms. The purpose of this paper and its main claim is to enable the design of nature-inspired protocols in genetic algorithms that are effective in optimizing dynamic environments, while maintaining the complexity of the algorithm and changing the problem space. Periodic occurrences occur. In this paper, a memory-enhanced (self-organized critical) genetic algorithm is proposed to solve dynamic optimization problems. In the proposed algorithm, a new self-organizing mutation operator based on the sand dune model is used. The self-organizing mutation operator is a new mutation operator that can perform self-regulating mutation rates with a special distribution based on the sand dune model, which is suitable for dynamic optimization. If the changes occur periodically, the use of past information will normally allow the algorithm to adapt quickly to new environmental conditions as soon as the environment changes. The idea is to use a memory. One of the major challenges in using memory is diversity. To increase the level of diversity, a comparative spawning memory with Gaussian clustering was used. A solution has also been used to replace and restore memory. The proposed proposal first combines a new critical self-organized mutation with other genetic algorithms provided by other researchers, and the results show that this method has been able to repeatedly improve other genetic algorithms for dynamic environments. Finally, the proposed method of this paper, which is a combination of new critical self-organization with memory density, is presented. The results of this method will be compared with other similar methods that have been improved with the new self-organizing mutation solution. The results have been tested on various benchmarking problems as Royal Road, One Max and Deceptive functions. It has been shown that the proposed method has produced even better results than even competing methods that have been improved by the new self-organizing mutation method. The evaluation criterion in this paper is the criterion of offline efficiency and diversity criterion. The results of the experiments show that the proposed method is effective because it is compared with other methods in parameters of dynamic environments that have the best performance. As will be shown, the proposed method does not increase the set of parameters compared to other algorithms, so it meets the requirements for real-world applications.
-
مراجع :
[1] John, J. Grefenstette and Ramsey. Connie, L., "An approach to anytime learning". In International Conference on Machine Learning, pages 189–195, 1992.
[2] Branke, J. Kaußler, T. Schmidt, C. and Schmeck, H., "A multi population approach to dynamic optimization problems". In Adaptive Computing in Design and Manufacturing, pages 299–308, 2000.
[3] Branke, J. "Evolutionary Optimization in Dynamic Environment". Kluwer, 2002.
[4] Darwin, C. on the Origins of Species by means of natural selection, or the preservation of favoured race in the struggle for life. LONDON: JOHN MURRAY (1STEDITION), 1859.
[5] Jin, Y., and Branke, J. "Evolutionary Optimization In Uncertain environments: A Survey", IEEE Transactions On Evolutionary Computation, Vol. 9(3), 303-317, 2005.
[6] Whitley, d. Genitor: A Different Genetic Algorithm. In Proceedings of the Rocky Mountain Conference on Artificial Intelligence, 118-130, 1988.
[7] Cobb, H.G. An Investigation Into The Use Of Hyper-mutation As An Adaptive Operator In Genetic Algorithms Having Continuous, Time dependent Nonstationary Environments, Technical Report Aic-90- 001, 1990, Naval Research Laboratory, Washington, USA.
[8] Grefenstette, J.J. (1999). Evolvability in Dynamic Fitness Landscapes: A Genetic Algorithm Approach. In Proceedings of the 1999 IEEE Congress on Evolutionary Computation (Cec’1999), Vol. 3, IEEE Press, 2031-2038.
[9] Bak, p., and sneppen, k. (2003). Punctuated equilibrium and criticality in a simple model of evolution. Physical review of letters, vol. 71(24), 4083-4086.
[10] Stephens, C.R., Olmedo, I.G., Vargas, J.M., and Waelbroeck. H. (1998). Selfadaptation in Evolving Systems. Artificial life, vol. 4(2), 183-201.
[11] Goldberg, D.E., and Smith, R.E. (1987). Nonstationary Function Optimization Using Genetic Algorithms with Dominance and Diploidy. In J.J. Grefenstette (Ed.): Proceedings Of The 2nd International Conference On Genetic Algorithm, L. Erlbaum Associates, Hillsdale, Nj, USA, 59-68.
[12] Uyar, A.S., and Harmanci, A.E. (2005). A New Population Based Adaptive Domination Change Mechanism For Diploid Genetic Algorithms In 237dynamic Environments. Journal Of Soft Computing, Vol. 9(11), 803–815.
[13] Ryan, C. (1997). Diploidy without Dominance. In J.T. Alander (Ed.), Proceedings of the 3rd Nordic Workshop on Genetic Algorithms and Their Applications, 63-70.
[14] Lewis, J., Hart, E., and Ritchie, G. (1998). A Comparison of Dominance Mechanisms and Simple Mutation on Non Stationary Problems. In A.E. Eiben, T. Bäck, M. Schoenauer, H.-P. Schwefel (Eds.), Proceedings Of 5th International Conference On Parallel Problem Solving From Nature (PPSN-V), Lecture Notes In Computer Science, Vol. 1498, Springer-Verlag, London, UK, 139-148.
[15] Dasgupta, D., and Mcgregor, D.R. (1992). Nonstationary Function Optimization Using the Structured Genetic Algorithm. In R. Manner R And B. Manderick (Eds.), Proceedings Of The 2nd International Conference on Parallel Problem Solving From Nature (Ppsn-Ii), Elsevier Science, New York, 145-154.
[16] Klinkmeijer, L.Z., De Jong, E., and Wiering, M. (2006). A Serial Population Genetic Algorithm for Dynamic Optimization Problems. In Y. Saeys, E. Tsiporkova, B. De Baets And Y..Van De Peer (Eds.), Proceedings of the Annual Machine Learning Conference of Belgium and the Netherlands, 41-48.
[17] Hollstein, R.B. (1971). Artificial Genetic Adaptation in Computer Control Systems. Doctoral Thesis. University of Michigan.
[18] Ramsey, C.L., and Grefenstette, J.J. (1993). Case-Based Initialization of Genetic Algorithms. In S. Forrest (Ed.), Proceedings of the 5th International Conference Genetic Algorithms (Icga’1993), Morgan Kaufmann, San Francisco, 84–91.
[19] Trojanowski, K., and Michalewicz, Z. (2000). Evolutionary Optimization in Non-Stationary Environments. Journal of Computer Science and Technology, Vol. 1(2), 93-124.
[20] Yang, S. (2008). Genetic Algorithms with Memory- And Elitism-Based Immigrants in Dynamic Environments. Evolutionary Computation, Vol. 16(3), 385-416.
[21] مجید محمدپور و حمید پروین."الگوریتم ژنتیک آشوب¬گونه مبتنی بر حافظه و خوشه¬بندی برای حل مسائل بهینه¬سازی پویا". مجله مهندسی برق دانشگاه تبریز. جلد 46. شماره 3. پاییز 1396.
[22] Mohammadpour M, Parvin H, Sina M (2018) Chaotic genetic algorithm based on explicit memory with a new strategy for updating and retrieval of memory in dynamic environments. J AI Data Min 6:191–205 (in press).
[23] M. Mohammadpour, H. Parvin. “Genetic Algorithm Based on Explicit Memory for Solving Dynamic Problems”. In Journal of Advances in Computer Research Sari Branch Islamic Azad University, vol. 7, no. 2, pp. 53-68, 2016.
[24] H. Parvin., S. Nejatian., M. Mohammadpour, “Explicit memory based ABC with a clustering strategy for updating and retrieval of memory in dynamic environments”. In Applied Intelligence Springer Nature, 2018. doi: 10.1007/s10489-018-1197-z.
[25] Ursem. R. K. (2000). Multinational Ga Optimization Techniques in Dynamic Environments. In Proceedings of the 2000 Genetic and Evolutionary Computation Conference (Gecco’2000), Morgan Kaufmann, San Francisco, 19-26.
[26] Park, T., and Ryu, K.R. (2007a). A Dual Population Genetic Algorithm with Evolving Diversity. In Proceedings of the 2007 IEEE Congress on Evolutionary Computation (Cec’2007), IEEE Press, 3516-3522.
[27] Park, T., Choe, R., And Ryu, K.R. (2007b). Adjusting Population Distance for the Dual-Population Genetic Algorithm. In Proceedings of The Australian Conference On Artificial Intelligence (Ai’2007), Lecture Notes On Computer Science, Vol. 4830, Springer Verlag, Berlin171-180.
[28] Park, T., Choe, R., And Ryu, K.R. (2008). Dual Population Genetic Algorithm for Nonstationary Optimization. In In Proceedings of the 2008 234 Genetic and Evolutionary Computation Conference (Gecco’2008), Acm, New York, Ny, 1025-1032.
[29] Yang, S. (2004). Constructing Test Environments For Genetic Algorithms Based On Problem Difficulty. In Proceedings of the 2004 IEEE Congress On Evolutionary Computation, Vol. 2, IEEE Press, 2004, 1262 1269.238.
[30] Martello, S., and Toth, P. (1990). Knapsack Problems: Algorithms and Computer Implementations. John Wiley & Sons, New York.
[31] Angeline, R.G. Reynolds, J.R. Mcdonell, and R.C. Eberhart (Eds.), Proceedings of the 6th International Conference on Evolutionary Programming, Springer-Verlag, London, UK, 335-345.
[32] Tomassini, M. (2005). Spatially Structured Evolutionary Algorithms: Artificial Evolution In Space And Time. Natural Computing Series, Springer-Verlag New York. Inc., Secaucus, Nj, Usa, 2005.
[33] Laredo, J.L.J., Castillo, P.A., Mora, A.M., Merelo, J.J., Rosa, A.C., and Fernandes, C.M. (2008b). Evolvable Agents in Static and Dynamic Optimization Problems. In G. Rudolph, T. Jansen, S. Lucas, C. Poloni And N. Beume (Eds.), Proceedings Of 10th International Conference On Parallel Problem Solving From Nature, Lecture Notes In Computer Science, Vol. 5199, Springer-Verlag, Berlin, 489-497.
[34] Laredo, J.L.J., Eiben, A.E., Van Steen, M., Castillo, P.A., Mora, A.M., and Merelo, J.J. (2008a). P2p Evolutionary Algorithms: A Suitable Approach for Tackling Large Instances in Hard Optimization Problems. In E. Luque, T. Margalef And D. Benítez (Eds.), Proceedings Of The 14th International Euro-Par Conference, Lecture Notes In Computer Science, Vol. 5168, Springer Verlag, Berlin, 622–631.
[35] Bäck, T. (1996). Evolutionary Algorithms in Theory and Practice. Oxford University Press, New York.
[36] Goldberg, D.E. (2002). The Design of Innovation Lessons from and for Competent Genetic Algorithms. Kluwer Academic Publishers, Norwell, Ma, 2002.
[37] Baluja, S. (1994). Population-Based Incremental Learning: A Method For Integrating Genetic Search Based Function Optimization and Competitive Learning, Technical Report CMU-Cs 94-163, Carnegie Mellon University, USA.
[38] Harik, G.R., Lobo, F., and Sastry, K. (2006). Linkage Learning Via Probabilistic Modeling in the Ecga. In M. Pelikan, K. Sastry, E. Cantú-Paz (Eds.), Scalable Optimization Via Probabilistic Modeling: From Algorithms To Applications, Springer-Verlag New York Inc., Secaucus Inc., Nj, Usa,39-61.
[39] Bak, P., Tang, C., and Wiesenfeld, K. (1987). Self Organized Criticality: An Explanation Of 1/F Noise. Physical Review of Letters, Vol. 59(4), 381-384.
[40] Bak, P., and Sneppen, K. (2003). Punctuated Equilibrium and Criticality in a Simple Model of Evolution. Physical Review of Letters, Vol. 71(24), 4083-4086.
[41] Fernandes, C.M. (2009). Pherographia: Drawing By Ants. Leonardo–Journal of the International Society for the Arts, Sciences and Technology, Mit Press, In Press.
[42] Fernandes CM, Merelo JJ, Ramos V, Rosa AC (2008) A selforganized criticality mutation operator for dynamic optimization problems. In: Proceedings of the 2008 genetic and evolutionary computation conference. ACM, New York, pp 937–944.
[43] Fernandes CM, Laredo JLJ, Rosa AC, Merelo JJ (2013). The sandpile mutation Genetic Algorithm: an investigation on the working mechanisms of a diversity-oriented and self-organized mutation operator for non-stationary functions. Applied Intelligence 39: 279–306.
[44] Tinós R, Yang S (2007) A self-organizing RIGA for dynamic optimization problems. Genet Program Evol Mach 8:255–286.
[45] Yang S (2008) Genetic algorithms with memory- and elitismbased immigrants in dynamic environments. Evol Comput 6(3):385–416.
[46] Fernandes CM, Merelo JJ, Rosa AC (2011). A comparative study on the performance of dissortative mating and immigrants’ strategies for evolutionary dynamic optimization. Inf Sci 181(20):4428–4459.
[47] Martello, S., and Toth, P. (1990). Knapsack Problems: Algorithms and Computer Implementations. John Wiley & Sons, New York.
- صفحات : 25-38
-
دانلود فایل
( 1.08 KB )