Academia.eduAcademia.edu

Outline

From approximative to descriptive fuzzy models

2003

Abstract

AI knowledge based systems have proven a very valuable tool to understand and model complex real-world problems. Unfortunately, human experts are often required to provide the knowledge or rules. Due to limited availability and sometimes experts' reluctance, or even inability, to give such expertise, knowledge acquisition has become the bottleneck in the development of knowledge based systems. However, there may well be a sensible amount of data that represents typical description of the domain problems. Therefore, data-driven techniques for automated generation of rules have been developed over the years to assist knowledge acquisition. While there have been efforts to make the automatically generated models transparent and readable, in most cases complexity ends up taking over. Fuzzy sets offers a way to deal with vague, imprecise or inaccurate information while reducing the complexity of knowledge representation. However, most of fuzzy rule generation methods, while fast, accurate and easily scalable to high dimensional problems, follow the so-called approximative approach, which works by creating and tuning the fuzzy rule bases and the fuzzy sets to best fit the data. Opposing this stands the descriptive approach, where semantics are as important as accuracy and the definition of the fuzzy sets is human given, thereby representing human interpretable concepts. Unfortunately, the methods to obtain descriptive models are generally rather slow, inaccurate and poorly scalable. It would be desirable to create a method to use the benefits of fast and efficient generation of the approximative approaches with the clarity and comprehensibility of descriptive approaches. The purpose of this thesis is the development of such a method. The thesis presents an effective and efficient approach for translating fuzzy rules that use approximative sets (accurate but unreadable) to rules that use descriptive sets and linguistic hedges of predefined meaning. It works by first generating rules that use approximative sets from training data, using a fast and accurate approximative algorithm that already exists. Then the resulting approximative rules are translated into descriptive ones. First, a heuristic conversion is performed to obtain a crude descriptive translation. Such a heuristically generated descriptive fuzzy model is then used to initialize a multi-objective GA. The GA, guided by the novel functional equivalence objectives, will fine-tune the heuristic translation into the final descriptive fuzzy rule set. Hedges that are useful for supporting such translations are provided. This thesis presents an improved version of more effective hedges specifically devised for trapezoidal fuzzy sets, to be applied to dilate or concentrate a given set by expanding or shrinking its constituent parts. It also introduces three new hedges not existing in the literature. Considerable experimental studies have been carried out, on the issues of the accuracy and transparency of the descriptive rules generated by the proposed approach. These include comparative analysis between alternative modelling approaches, v vi Declaration I hereby declare that I composed this thesis entirely myself and that it describes my own research.

References (187)

  1. Heuristic / Functional Equivalence Breast Cancer 1.10% ±0.02
  2. Table 8.12: Mean results, with 99% confidence intervals, of the best translation out of 5 GA runs (Group Strategy)
  3. Conference on Fuzzy Systems, pages 1314-1319, 1998. Th. Back and H.-P. Schwefel. An Overview of Evolutionary Algorithms for Parameter Optimization. Evolutionary Computation, 1(1): 1-23, 1993.
  4. A. G. Barto, R. S. Sutton, and C. W. Anderson. Neuronlike adaptative elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man and Cybernetics, SMC-13:834-846, September 1983.
  5. P. J. Bentley and J. P. Wakefield. An Analysis of Multiobjective optimization within Genetic Algorithms. Technical Report ENGPJB96, University of Huddersfield, UK, 1996.
  6. P. J. Bentley. Evolutionary Design by Computers. Academic Press Ltd, London, 1999.
  7. Hamid R. Berenji and P. Khedkar. Learning and tuning fuzzy controllers through reinforcements. IEEE Transactions on Neural Networks, 3(5):724-740, 1992.
  8. Hamid R. Berenji. Luzzy q-learning for generalization of reinforecement learning. In Proceedings of the Fifth IEEE International Conference on Fuzzy Systems, volume 3, pages 2208-2214, 1996.
  9. James C. Bezdek and Sankar K. Pal, editors. Fuzzy Models for Pattern Recognition: Methods that Search for Structures in Data. IEEE, Pascataway, 1992. Eric Bonabeau, Marco Dorigo, and Guy Theraulaz. Swarm Intelligence: From Natural to Artificial Systems. Oxford University Press, New York, 1999.
  10. L. B. Booker, D. E. Goldberg, and J. H. Holland. Classifier systems and genetic algorithms. Artificial Intelligence, 40:235-282, September 1989. [Breiman et al. 84] [Burke et al. 95] [Cavicchio 70] [Chen et al. 98] [Chiu 94] [Coello 03] [Cordon & Herrera 99] L. Breiman, J. H. Friedman, R. A. Olsen, and C. J. Stone. Classification and Regresion Trees.
  11. Wadsworth, Belmont, CA, 1984.
  12. E. K. Burke, J. P. Newall, and R. F. Weare. A memetic algorithm for university exam timetabling. In 1st International Conference on the Practice and Theory ofAutomated Timetabling (ICPTAT'95, Napier University, Edinburgh, UK, 30th Aug -1st Sept 1995), pages 496-503, 1995.
  13. D. J. Cavicchio. Adaptive Search using Simulated Evolution. Unpublished PhD thesis, The University of Michigan, 1970. Adaptive evolution in a population of devices (pattern recognition programs) is discussed and criteria for effective reproductive plans are presented.
  14. C. L. Chen, S. H. Hsu, C. T. Hsieh, and W. K. Lin. Generating crisp-type fuzzy models from operating data. In Proceedings of the 7th IEEE International Conference on Fuzzy Systems, pages 686-691, 1998.
  15. S. L. Chiu. Fuzzy model identification based on cluster estimation. Journal of Intelligent and Fuzzy Systems, 2(3), 1994.
  16. Carlos A. Coello. List of references on evolutionary multiobjective optimization, 2003. Available on web: http://www.lania.mx/~ccoello/EM00/ EM00bib.html. Oscar Cordon and Francisco Herrera. A two-stage evolutionary process for designing tsk rule-based systems. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics, 29(6):703-715, December 199. [Cordon et al. 01] Oscar Cordon, Francisco Herrera, Frank Hoffmann, and Luis Magdalena. Genetic Fuzzy Systems. World Scientific, 2001. [Cox 94] Earl Cox. The Fuzzy Systems Handbook. AP Professional, Cambridge, MA, 1994. [Darwin 59] Charles Darwin. On the Origin of Species. John Murray, London, 1859.
  17. Dasgupta & McGregor 92] Dipankar Dasgupta and Douglas R. McGregor. Nonstationary function optimization using the structured genetic algorithm. In R. Manner and B. Manderick, editors, Parallel Problem Solving from Nature 2 (Proc. 2nd Int. Conf on Parallel Problem Solving from Nature, Brussels 1992), pages 145-154, Amsterdam, 1992. Elsevier.
  18. Lawrence Davis. Handbook of Genetic Algorithms.
  19. Van Nostrand Reinhold, New York, 1991.
  20. De Jong 75] K. A. De Jong. Analysis of behavior of a class of genetic adaptive systems. Unpublished PhD thesis, University of Michigan, Dept. Computer and Communication Sciences, 1975. Diss. Abstr. Int 36(10), 5140B.
  21. Deb & Goldberg 89] Kalyanmoy Deb and David E. Goldberg. An investigation of niche and species formation in genetic function optimization. In J. David Schaffer, editor, Proceedings of the 3rd International Conference on Genetic Algorithms, pages 42-50, George Mason University, June 1989. Morgan Kaufmann. [Deb 89] Kalyanmoy Deb. Genetic algorithms in multimodal function optimization. Unpublished M.Sc. thesis, University of Alabama, The Clearinghouse for Genetic Algorithms, Tuscaloosa, AL, 1989. TCGA Report No 88002. [Deb 91] Kalyanmoy Deb. Binary andfloating-pointfunction optimization using messy genetic algorithms. Thesis (ph.d.), Dept. of Engineering Mechanics, University of Alabama, 1991. [Delgado et al. 98a] M. Delgado, A. F. Gomez Skarmeta, J. Gomez Marfn-Blazquez, and H. Martinez Barbera. Fuzzy [Delgado et al. 98b] [Dick et al. 99] [Dickerson & Kosko 96] [Dombi 82] [Dorigo et al. 96] [Dubois & Prade 80] [Emami et al. 98] [Fang et al. 94] 191 hybrid techniques in modeling. Lecture Notes in Computer Science, 1415:180-189, 1998.
  22. M. Delgado, A. F. Gomez Skarmeta, and F. Martin. A methodology to model fuzzy systems using fuzzy clustering in a rapid-prototyping approch. Fuzzy Sets and Systems, 1998.
  23. S. Dick, A. Kandel, and W.E. Combs. Comment on 'combinatorial rule explosion eliminated by a fuzzy rule configuration' [and reply]. IEEE Transactions on Fuzzy Systems, 7(4):475-478, August 1999.
  24. Julie A. Dickerson and Bart Kosko. Fuzzy function approximation with ellipsoidal rules. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics, 26(4):542-550, August 1996.
  25. J. Dombi. A general class of fuzzy operators, the De Morgan class of fuzzy operators and fuzziness measures induced by fuzzy operators. Fuzzy Sets and Systems, 8:149-163, 1982.
  26. Marco Dorigo, Vittorio Maniezzo, and Alberto Colorni. The Ant System: Optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics Part B: Cybernetics, 26( 1 ):29-41, 1996.
  27. D. Dubois and H. Prade. Fuzzy Sets and Systems: Theory and Applications. Academic Press, New York, NY, 1980.
  28. M. R. Emami, I. B. Tiirksen, and A. A. Goldenberg. Development of a systematic methodology of fuzzy logic modeling. IEEE Transactions on Fuzzy Systems, 6(3):346-361, August 1998.
  29. Hsiao-Fan Fang, Peter Ross, and Dave Corne. A promising hybrid GA/heuristic approach for open-shop scheduling problems. In A. Cohn, editor, 11th European Conf. on Artificial Intelligence, pages 590-594, Chichester, 1994. John Wiley & Sons, Ftd. [Fisher 36] [Fogarty 96] [Fogel 92] [Fogel et al. 66]
  30. Fonseca & Fleming 95]
  31. Forina ] [Frank 79]
  32. Fukuda & Shibata 94] R.A. Fisher. The use of multiple measurements in taxonomic problems. Annual Eugenics, 7, Part 11:179-188, 1936.
  33. Terence C. Fogarty, editor. Inoculation to Initialise Evolutionary Search, volume 1143 of Lecture Notes in Computer Science. Springer, 1996.
  34. David B. Fogel. Evolving Artificial Intelligence. Unpublished PhD thesis, University of California, San Diego, CA, 1992.
  35. L. J. Fogel, A. J. Owens, and M. J. Walsh. Artificial Intelligence through Simulated Evolution. John Wiley & Sons, New York, 1966. This work has been criticized as involving overly simple evolution of finite automata, but it was of pioneering significance at the time. For a review see citeLindsay68.
  36. Carlos M. Fonseca and Peter J. Fleming. An Overview of Evolutionary Algorithms in Multiobjective Optimization. Evolutionary
  37. Computation, 3(1): 1-16, Spring 1995.
  38. M. Forina. Parvus -an extendible package for data exploration, classification and correlation. Technical report, Institute of Pharmaceutical and Food Analysis and Technologies, Via Brigata Salerno, 16147
  39. M. J. Frank. On the simultaneous associativity of F(x,y) and x + y -F(x,y). Aequationes
  40. Mathematicae, 19:194-226, 1979.
  41. Toshio Fukuda and Takanori Shibata. Fuzzy-neuro-GA based intelligent robotics.
  42. In J. M. Zurada, R. J. Marks, and C. J. Robinson, editors, Computational Intelligence: Imitating Life, pages 352-363, New York, 1994. IEEE Press.
  43. Fullmer & Miikkulainen 92] B. Fullmer and R. Miikkulainen. Using marker-based genetic encoding of neural networks to evolve finite-state behaviour. In F. J. Varela [Gathercole & Ross 94] [George 96] [Goldberg & Richardson 87] [Goldberg 89] [Goldberg 90] [Goldberg et al. 91] [Goldberg et al. 92a] [Goldberg et al. 92b] 193 and R Bourgine, editors, Toward a Practice of Autonomous Systems. Proceedings of the First European Conference on Artificial Life, Cambridge, MA, USA, 1992. MIT Press.
  44. C. Gathercole and P. Ross. Dynamic training subset selection for supervised learning in genetic programming. Lecture Notes in Computer Science, 866:312-321, 1994.
  45. Felicity A. W. George. Hybrid genetic algorithms with immunisation to optimise networks of car dealerships. Edinburgh Parallel Computer Centre, 1996. submitted to Studies in Locational Analysis.
  46. D E Goldberg and J Richardson. Genetic algorithms with sharing for multi-modal function optimisation. In Proc of the 2nd Int. Conf. on Genetic Algorithms and Their Applications, pages
  47. -, 1987. GOLDBERG87a.
  48. David E. Goldberg. Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley", Massachusetts, 1989.
  49. David E. Goldberg. A note on Boltzmann tournament selection for genetic algorithms and population-oriented simulated annealing. Complex Systems, 4(4):445-460, 1990.
  50. David E. Goldberg, Kalyanmoy Deb, and Bradley Korb. Don't worry, be messy. In Lashon B. Belew, Richard K.; Booker, editor, Proceedings of the 4th International Conference on Genetic Algorithms, pages 24-30, San Diego, CA, July 1991. Morgan Kaufmann.
  51. David E. Goldberg, Kalyanmoy Deb, and James H. Clark. Accounting for noise in the sizing of populations. In Darrell Whitley, editor, Foundations of Genetic Algorithms Workshop (FOGA-92), Vail, Colorado, July 1992.
  52. David E. Goldberg, Kalyanmoy Deb, and James H. Clark. Genetic algorithms, noise, and the sizing of populations. Complex Systems, 6(4):333-362, August 1992. [Gomez Skarmeta & Jimenez 97] A. F. Gomez Skarmeta and F. Jimenez. Generating and tuning fuzzy rules using hybrid systems. In Proceedings of the 6th IEEE International Conference on Fuzzy Systems, volume 1, pages 247-252, 1997.
  53. Gomez Skarmeta & Jimenez 99] A. F. Gomez Skarmeta and F. Jimenez. Fuzzy modeling with hybrid systems. Fuzzy Sets and Systems, 104(2): 199-208, 1999.
  54. Gomez Skarmeta et al. 99] A. F. Gomez Skarmeta, F. Jimenez, and J. Iba nez. Pareto-optimality in scheduling problems. Lecture Notes in Computer Science, 1625:177-185, 1999.
  55. Gomez Skarmeta et al. 01] A. F. Gomez Skarmeta, Mercedes Valdes, Fernando Jimenez, and J. Gomez Marfn-Blazquez. Approximative fuzzy rules approaches for classification with hybrid-ga. Information Sciences, 136 (1-4) (2001) pp. 193-214, 136(1-4): 193-214, August 2001.
  56. H. Hamacher. fiber logische verknupfungen unscharfer aussagen und deren zugehorige bewertungs funktionen. In R. Trappl, G. J. Klir, and L. Ricciardi, editors, Progress in cybernetics and systems research, volume III, pages 276-288.
  57. Hemisphere, New York, 1975.
  58. Emma Hart and Peter Ross. A heuristic combination method for solving job-shop scheduling problems. In Agoston E. Eiben, Thomas Back, Marc Schoenauer, and Hans-Paul Schwefel, editors, Parallel Problem Solving from Nature -PPSN V, pages 845-854, Berlin, 1998. Springer. Lecture Notes in Computer Science 1498. Emma Hart, Peter Ross, and Jeremy Nelson. Solving a real-world problem using an evolving heuristically driven schedule builder. Evolutionary Computation, 6( 1 ):61-80, 1998. [Hamacher 75] [Hart & Ross 98] [Hart et al. 98] [Hayashi et al. 92] [Haykin 94] [Hecht-Nielsen 90] [Heitkotter & Beasley 97] [Ho & Lee 00] [Holland 75] [Horn & Nafpliotis 93] [Horn 93] Isao Hayashi, Hiroyoshi Nomura, Hisayo Yamasaki, and Noboru Wakami. Construction of fuzzy inference rules by neural network driven fuzzy reasoning with learning functions. International Journal of Approximate Reasoning, 6:241-266, February 1992.
  59. Simon Haykin. Neural Networks. Macmillan College Publishing Company, New York, 1994.
  60. R. Hecht-Nielsen. Neurocomputing.
  61. Addison-Wesley, Readin, MA, 1990.
  62. Jorg Heitkotter and David Beasley. The hitch-hiker's guide to evolutionary computation, 97. Available on web: http:// research.de.uu.net:8080/encore/www/.
  63. Shinn-Ying Ho and Kual-Zhen Lee. A simple and fast GA-SA hybrid image segmentation algorithm. In Darrell Whitley, David Goldberg, Erick Cantu-Paz, Lee Spector, Ian Parmee, and Hans-Georg Beyer, editors, Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2000), pages 718-725, Las Vegas, Nevada, USA, 10-12 July 2000. Morgan Kaufmann. J. H. Holland. Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor, 1975. Jeffrey Horn and Nicholas Nafpliotis. Multiobjective Optimization using the Niched Pareto Genetic Algorithm. Technical Report IlliGAl Report 93005, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA, 1993.
  64. Jeffrey Horn. Finite Markov Chain Analysis of Genetic Algorithms with Niching. In S. Forrest, editor, Proceedings of the Fifth International Conference on Genetic Algorithms, pages 110-117, San Mateo, California, 1993. Morgan Kaufmann Publishers. [Horn et cil. 94a] [Horn et al. 94b]
  65. Howard & D'Angelo 95] [Ichihashi et al. 96] [Ishibuchi et al. 97] [Ishibuchi et al. 99] [Jang 94] 196
  66. Jeffrey Horn, David E. Goldberg, and Kalyanmoy Deb. Implicit Niching in a Learning Classifier System: Nature's Way. Evolutionary Computation, 2(1):37-66, 1994. Also IIliGAL Report No 94001, 1994. Jeffrey Horn, Nicholas Nafpliotis, and David E. Goldberg. A Niched Pareto Genetic Algorithm for Multiobjective Optimization. In Proceedings of the First IEEE Conference on Evolutionary Computation, IEEE World Congress on Computational Intelligence, volume 1, pages 82-87, Piscataway, New Jersey, 1994. IEEE Service Center.
  67. Les M. Howard and Donna J. D'Angelo.
  68. The GA-P: A genetic algorithm and genetic programming hybrid. IEEE Expert, 10(3): 11-15, June 1995.
  69. H. Ichihashi, T. Shirai, K. Nagasaka, and Miyoshi T. Neuro-fuzzy id3: A method of inducing fuzzy decision trees with linear programing for maximizing entropy and an algebraic method for incremental learning. Fuzzy Sets and Systems, 81:157-167, 1996.
  70. H. Ishibuchi, T. Nakashima, and T. Morisawa. Simple fuzzy rule-based classification systems perform well on commonly used real-world data sets. In NAFIPS '97., pages 251-256, 1997.
  71. H. Ishibuchi, T. Nakashima, and T. Murata. Performance evaluation on fuzzy classifier systems for multidimensional pattern classification problems. IEEE Transactions on Systems, Man and Cybernetics, B(29):601-618, October 1999.
  72. J. Jang. Structure determination in fuzzy modeling: A fuzzy cart approach. In Proceedings IEEE Conference on Fuzzy Systems, pages 480-485, 1994. [Jang et al. 93] [Jang et al. 97] [Janikow 98] [Jelonek et al. 95] [Jin et al. 98] [Jin et al. 99] [Jones 95] [Joo et al. 97]
  73. J.-S. R. Jang, Y. C. Lee, and C.-T. Sun. Functional equivalence between radial basis function networks and fuzzy inference systems. IEEE Transactions on Neural Networks, 4(1): 156-159, January 1993.
  74. J.-S. R. Jang, C.-T. Sun, and E. Mizutani. Neuro-Fuzzy and Soft Computing. Matlab Curriculum. Prentice Hall, 1997.
  75. Cezary Z. Janikow. Fuzzy decision trees: Issues and methods. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics, 28(1): 1-14, February 1998.
  76. J. Jelonek, K. Krawiec, and R. Slowinski. Rough set reduction of attributes and their domains for neural networks. Computational Intelligence, 11(2):339-347, 1995.
  77. Y. Jin, W. von Seelen, and B. Sendhoff. An approach to rule-based knowledge extraction. In Proceedings of the 7th IEEE International Conference on Fuzzy Systems, pages 1188-1193, 1998. Yaochu Jin, Werner von Seelen, and Bernhard Sendhoff. On generating FC3 fuzzy rule systems from data using evolution strategies. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics, 29(6):829-845, December 1999. Terry Jones. Evolutionary Algorithms, Fitness Landscapes and Search. Dissertation, The University of New Mexico, Albuquerque NM, May 1995. Y. H. Joo, H. S. Hwang, K. B. Kim, and K. B. Woo. Fuzzy system modeling by fuzzy partition and GA hybrid schemes. Fuzzy Sets and Systems, 86(3):279-288, 1997.
  78. Systems, Man and Cybernetics, 28(3):338-355, August 1998. Leila Kallel and Marc Schoenauer. Alternative random initialization in Genetic Algorithms. In Thomas Back, editor, Proceedings of the Seventh International Conference on Genetic Algorithms, pages 268-275, San Francisco, CA, 1997. Morgan Kaufmann.
  79. L. Kallel, B. Naudts, and C. R. Reeves. Properties of fitness functions and search landscapes. In Leila Kallel, Bart Naudts, and Alex Rogers, editors, Theoretical Aspects of Evolutionary Computing, pages 175-206.
  80. Springer, Berlin, 2001.
  81. C. J. Kim. An algorithmic approach for fuzzy inference. IEEE Transactions on Fuzzy Systems, 5(4):585-598, November 1997.
  82. Min-Soeng Kim, Sun-Gi Hong, and Ju-Jang Lee. Self-organizing fuzzy inference system by q-learning. In Procceedings of the Conference in Fuzzy Systems, volume 1, pages 372-377, 1999.
  83. H. Kitano. Designing neural networks using genetic algorithms with graph generation system. Complex Systems, 4(4):461-476, August 1990.
  84. T. Kohonen. Self-Organization adn Associative Memory. Springer-Verlag, Berlin, 1989.
  85. B. Kosko. Fuzzy systems as universal approximator. IEEE Transacions on Computers, 43:1329-1333, 1994.
  86. B Kosko. Fuzzy Engineer. Prentice Hall, 1997. J. Koza. Genetic programming: A paradigm for genetically breeding populations of computer programs to solve problems. Technical Report STAN-CS-90-1314, Dept. of Computer Science, Stanford University, June 1990. [Koza 92] [Koza 98] [Koza et al. 99] [Lee et al. 96] [Leich 95] [Levine 94] [Liu et al. 01] [Lomborg 94]
  87. J. Koza. Genetic Programming: On the Programming of Computers by Natural Selection. MIT Press, Cambridge Massachusetts, 1992.
  88. John R. Koza. Genetic programming. In James G. Williams and Allen Kent, editors, Encyclopedia of Computer Science and Technology, volume 39, pages 29-43.
  89. Marcel-Dekker, 1998.
  90. J. Koza, F.H. Bennet III, W. Mydlowec, M.A. Kleane, J. Yu, and O. Stiffelman. Searching for the imposible using genetic programming. In Morgan Kaufmann, editor, GECCO-99, pages 1083-1091, Los Altos, CA, 1999.
  91. Wei-Po Lee, John Hallam, and Henrik Hautop Lund. A hybrid GP/GA approach for co-evolving controllers and robot bodies to achieve fitness-specified tasks. In Proceedings of the 1996 IEEE International Conference on Evolutionary Computation, Nagoya, Japan, 20-22 1996. IEEE Press.
  92. D. D. Leich. A New Genetic Algorithm for the Evolution of Fuzzy Systems. Unpublished PhD thesis, Dept. of Egineering Science, University of Oxford, 1995.
  93. David Levine. A Parallel Genetic Algorithm for the Set Partitioning Problem. Unpublished PhD thesis, Mathematics and Computer Science Division, Argonne National Laboratory, 9700
  94. South Cass Avenue, Argonne, IL 60439, USA, May 1994. Bin-Da Liu, Chuen-Yau Chen, and Ju-Ying Tsao. Desing of adaptive fuzzy logic controller based on linguistic-hedge concepts and genetic algorithms. Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 31 (1 ):32-53, February 2001. Bjprn Lomborg. Game theory versus multiple agents: The iterated prisoner's dilemma. In Cristiano Castefranchi and Eric Werner, editors, Proceedings of the 4th European Workshop on Modelling Autonomous Agents in a Multi-Agent World : Artificial Social Systems, volume 830 of LNAI, pages 69-93, Berlin, July 1994. Springer. [Lozowski et al. 96] A. Lozowski, T. J. Cholewo, and J. M. Zurada. Crisp rule extraction from perceptron network classifiers. In Proceedings of International Conference on Neural Networks, volume Plenary, Panel and Special Sessions, pages 94-99, Washington, D.C., 1996. [Luger & Stubblefield 97]
  95. George F. Luger and William A. Stubblefield. Artificial Intelligence: Structures and Strategies for Complex Problem Solving. Addison-Wesley, One Jacob Way, Reading, MA 01867-3999, USA, third edition, 1997. [Lukasiewicz 70] [Mahfoud 91] [Mahfoud 92] Jan Lukasiewicz. Philosophical remarks on many-valued systems of propositional logic. In Borkowski, editor, Selected Works, Studies in Logic and the Foundations of Mathematics, pages 153-179. North Holland, 1970.
  96. Samir W. Mahfoud. An analysis of Boltzmann tournament selection. Technical Report IlliGAL Report No 91007, University of Illinois, Department of General Engineering, 117 Transportation Building, 104 South Mathews Avenue, Urbana, IL 61801-2996, 1991.
  97. S. W. Mahfoud. Crowding and preselection revisited. In Reinhard Manner and Bernard Manderick, editors, Parallel problem solving from nature 2, pages 27-36, Amsterdam, 1992. North-Holland.
  98. Samir W. Mahfoud. Simple analytical models of genetic algorithms for multimodal function optimization. Technical Report IlliGAL Report No 93001, University of Illinois, Department of General Engineering, 117 Transportation Building, 104 South Mathews Avenue, Urbana, IL 61801-2996, 1993. [Mamdani & Assilian 75] [Marin-Blazquez & Shen 01] [Marin-Blazquez & Shen 02a] [Marin-Blazquez & Shen 02b] [Marin-Blazquez & Shen 02c] [Marin-Blazquez et cil. 99] [Marin-Blazquez et al. 00] [Mendel 01]
  99. E.H Mamdani and S. Assilian. An experiment in linguistic synthesis with a fuzzy logic controller. International Journal of Man-Machine Studies, 7:1-13, 1975.
  100. J. Gomez Marin-Blazquez and Q. Shen. Linguistic hedges on trapezoidal fuzzy sets: A revisit. In Proceedings of the 10th IEEE International Conference on Fuzzy Systems, volume 1, pages 412-415, December 2001.
  101. J. G. Marin-Blazquez and Qiang Shen. From approximative to descriptive fuzzy classifiers. IEEE Transactions on Fuzzy Systems, 10:484-497, August 2002.
  102. J. G. Marfn-Blazquez and Qiang Shen. Microtuning of membership functions: Accuracy vs. interpretability. In Proceedings of the 11th IEEE International Conference on Fuzzy Systems, Fuzz-IEEE 2002, pages 412-415, Honolulu, USA, May 2002. 2002 World Congress on Computational Intelligence. J. Gomez Marin-Blazquez and Q. Shen. Trade-off between Accuracy and Interpretability in Fuzzy Rule-based Modelling, chapter Regaining comprehensibility of approximative fuzzy models via the use of linguistic hedges. To appear, 2002.
  103. J. Gomez Marin-Blazquez, M. Delgado, A. F. Gomez Skarmeta, and H. Martinez Barbera. A multiagent architecture for fuzzy modeling. Journal of Intelligent Systems, 14:305-329, March 1999.
  104. J. Gomez Marin-Blazquez, Q. Shen, and A. F. Gomez Skarmeta. From approximative to descriptive models. In Proceedings of the 9th IEEE International Conference on Fuzzy Systems, pages 829-834, May 2000.
  105. J. M. Mendel. Personal Communucation, Dec 2001. [Miller et al. 60] t [Miller et al. 89] [Mitchell 97]
  106. G. A. Miller, E. Galanter, and K.H. Pribam. Plans and Structure of Behaviour. Holt, Rinehart and Winston, New York, 1960.
  107. G. F. Miller, P. M. Todd, and S. U. Hedge. Designing neural networks using genetic algorithms. In D. J. Schaffer, editor, Proceedings of the Third International Conference on Genetic Algorithms, George Mason University, June 4-7, 1989, Arlington, VA, pages 379-384, San Mateo, CA, 1989. Morgan Kaufmanm.
  108. Tom M. Mitchell. Machine Learning.
  109. McGraw-Hill, 1997.
  110. Sushmita Mitra and Sankar K. Pal. Fuzzy self-organization, inferencing and rule generation. IEEE Transactions on Systems, Man and Cybernetics-Part A: Systems and Humans, 26(5):608-619, September 1996.
  111. Sushmita Mitra, Rajat K. De, and Sankar K. Pal. Knowledge-based fuzzy mlp for classification and rule generation. IEEE Transactions on Neural Networks, 8(6): 1338-1350, November 1997.
  112. David Moriarty and Risto Miikkulainen. Evolving complex othello strategies using marker-based genetic encoding of neural networks. Technical Report AI93-206, Department of Computer Sciences, University of Texas, Austin, TX, 1993.
  113. P. Moscato. On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts: Towards Memetic Algorithms. Technical Report Caltech Concurrent Computation Program, Report. 826, California Institute of Technology, Pasadena, California, USA, 1989.
  114. H. Miihlenbein. Parallel Genetic Algorithms in Combinatorial Optimization. In R. Sharda O. Balci and S. Zenios, editors, Computer Science and Operations Research, pages 441-456. Pergamon Press, New York, 1992. [Muhlenbein et ol. 91] [Nauck & Kruse 98] [Nauck et al. 97] [Nomura et al. 92] [Parmee 99] [Pawlak 91] [Peirce 31] [Poloni 95] [Prechelt 96]
  115. H. Muhlenbein, M. Schomisch, and J. Born. The parallel genetic algorithm as function optimizer. Parallel Computing, 17(6-7):619-632, September 1991. D. Nauck and R. Kruse. NEFCLASS-X-a soft computing tool to build readable fuzzy classifiers. Technical Report 3, BT, July 1998.
  116. D. Nauck, F. Klawonn, and R. Kruse. Foundations of Neuro-Fuzzy Systems. John Wiley & sons, 1997.
  117. H. Nomura, I. Hayashi, and W. Noboru. A Learning Method of Fuzzy Inference Rules by Descent Method. Proceedings of the 1st IEEE International Conference on Fuzzy Systems, pages 203-210, 1992.
  118. Ian C. Parmee. A review of evolutionary/adaptive search in engineering design. Evolutionary Optimization, 1(1): 13-39, 1999.
  119. Zdzislaw Pawlak. Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer Academic Publishers, Dordrecht, 1991.
  120. C. S. Peirce. Collected Papers of Charles Sanders Peirce. Harvard University Press, 1931.
  121. Carlo Poloni. Hybrid GA for Multi-Objective Aerodynamic Shape Optimization. In G. Winter, J. Periaux, M. Galan, and P. Cuesta, editors, Genetic Algorithms in Engineering and Computer Science, pages 397-416. Wiley & Sons, Chichester, 1995.
  122. L. Prechelt. A quantitative study of experimental evaluations of neural network learning algorithms. Neural Networks, 9:457-462, 1996. Lutz Pretzel. Some notes on neural learning algortihm benchmarking. Neurocomputing, 1995.
  123. J. R. Quinlan. Induction of decision trees. Machine Learning, 1:81-106, 1986.
  124. J. R. Quinlan. C4.5: Programs for machine learning. Morgan Kaufmann, San Mateo, CA, 1993. N. J. Radcliffe and R D. Surry. Formal Memetic Algorithms. In T. Fogarty, editor, Evolutionary Computing: AISB Workshop, volume 865 of Lecture Notes in Computer Science, pages 1-16.
  125. Soraya Rana, Adele E. Howe, L. Darrell Whitley, and Keith Mathias. Comparing heuristic, evolutionary and local search approaches to scheduling. In B. Drabble, editor, Proceedings of the 3rd International Conference on Artificial Intelligence Planning Systems (AIPS-96), pages 174-181. AAAI Press, 1996.
  126. T. Rauma. Knowledge acquisition with fuzzy modeling. In Proceedings of the 5th IEEE International Conference on Fuzzy Systems, volume 3, pages 1631-1636, 1996.
  127. C. Reeves. Hybrid genetic algorithms for bin-packing and related problems. Annals of Operations Research, 63:371-396, 1996.
  128. Peter Ross and John Hallam. Connectionist computing. DAI Teaching Paper 21, Department of Artificial Intelligence, University of Edinburgh, Edinburgh, 1996.
  129. Peter Ross. Genetic Algorithms and Genetic Programming. Department of Artificial Intelligence, The University of Edinburgh, 1998.
  130. Peter Ross, Sonia Schulenburg, Javier Marfn-Blazquez, and Emma Hart. Hyper-heuristics: Learning to combine simple heuristics in bin-packing problems. In GECCO 2002: Proceedings of the Genetic and Evolutionary Computation Conference (Best Paper Award), pages 942-948, New York, 9-13 July 2002. Morgan Kaufmann Publishers. [Roubos & Setnes 01] [Rumelhart et al. 86a] [Rumelhart et al. 86b] [Russell 23] [Samuel 59] [Schaffer & Grefenstette 85] [Schaffer 85] [Schaffer et al. 92] H. Roubos and M. Setnes. Compact and transparent fuzzy models and classifiers through iterative complexity reduction. IEEE Transactions on Fuzzy Systems, 9(4):516-524, August 2001.
  131. D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning internal representation by error propagation. In D. E. Rumelhart and J. L. McClelland, editors, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, volume 1, pages 318-362. Cambridge, MA: MIT Press, 1986.
  132. D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning representations by back-propagation.
  133. Nature, 323(99):533-536, 1986.
  134. Bertrand Russell. Vagueness. Australian Journal of Philosophy, 1, 1923.
  135. A. L. Samuel. Some studies in machine learning using the game of checkers. Technical report, IBM J. Res. Develop., 1959.
  136. J. David Schaffer and John J. Grefenstette.
  137. Multi-objective learning via genetic algorithms. In Aravind Joshi, editor, Proceedings of the 9th International Joint Conference on Artificial Intelligence, pages 593-595, Los Angeles, CA, August 1985. Morgan Kaufmann.
  138. J. David Schaffer. Multiple Objective Optimization with Vector Evaluated Genetic Algorithms. In Genetic Algorithms and their Applications: Proceedings of the First International Conference on Genetic Algorithms, pages 93-100. Lawrence Erlbaum, 1985.
  139. J. David Schaffer, Darrell Whitley, and Larry J. Eshelman. Combinations of genetic algorithms and neural networks: A survey of the state of the art. In Proceedings of the Conference on Combinations of Genetic Algorithms and Neural Networks, pages 1-37, 1992. [Schwefel 65] [Schwefel 81] [Schweizer & Sklar 63] [Setnes & Roubos 00] [Setnes et al. 98a] [Setnes et al. 98b]
  140. Shen & Chouchoulas 99]
  141. Shen & Chouchoulas 00]
  142. Shen & Leitch 93] [Simpson 92]
  143. H. P. Schwefel. Kybernetische evolution als strategic der experimentelen forschung in der stromungstechnik. Unpublished M.Sc. thesis, Technical University of Berlin, March 1965.
  144. H. P. Schwefel. Numerical Optimization of Computer Models. John Wiley and Sons, New York, New York, 1981.
  145. B. Schweizer and A. Sklar. Associative functions and abstract semigroups. Publ. Math. Debrecen, 10:69-81, 1963.
  146. M. Setnes and H. Roubos. Ga-fuzzy modeling and classification: Complexity and performance. IEEE Transactions ofFuzzy Systems, 8(5):509-522, October 2000.
  147. M. Setnes, R. Babuska, and H. B. Verbruggen. Rule-based modeling: Precision and transparency.
  148. IEEE Transactions on Systems, Man and Cybernetics -Part c: Applications and Reviews, 28(l):165-169, Feb. 1998.
  149. M. Setnes, R. Babuska, and H. B. Verbruggen. Transparent fuzzy modelling. International Journal ofHuman-Computer Studies, 49(2): 159-179, 1998.
  150. Q. Shen and A. Chouchoulas. Combining rough sets and data-driven fuzzy learning for generation of classification rules. Pattern Recognition, 32(12):2073-2076, October 1999.
  151. Q. Shen and A. Chouchoulas. A modular approach to generating fuzzy rules with reduced attributes for the monitoring of complex systems. Engineering Applications ofArtificial Intelligence, 13:263-278, 2000. Q. Shen and R. Leitch. Fuzzy qualitative simulation. IEEE Transactions on Systems, Man and Cybernetics, 23(4): 1038-1061, 1993.
  152. Patrick K. Simpson. Fuzzy min-max neural networks-part 1: Classification. IEEE Transactions on Neural Networks, 3(5):776-786, September 1992. [Smith 80]
  153. S. F. Smith. A learning system based on genetic algorithms. Unpublished PhD thesis, University of Pittsburgh, 1980.
  154. N. Srinivas and Kalyanmoy Deb. Multiobjective Optimization Using Nondominated Sorting in Genetic Algorithms. Evolutionary Computation, 2(3):221-248, Fall 1994.
  155. N. Srinivas and Kalyanmoy Deb. Multiobjective optimization using nondominated sorting in genetic algorithms. Evolutionary Computation, 2(3):221-248, 1995.
  156. R. Storn and K. Price. Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. Global OptimizGomez Skarmeta, A. F. and F. Jimenezation, 11:314-359, 1997.
  157. M. Sugeno and G. T. Kang. Structure identification of fuzzy model. Fuzzy Sets and Systems, 28(1): 15-33, 1988.
  158. Michio Sugeno and Tomohiro Takagi. Multi-dimensional fuzzy reasoning. Fuzzy Sets and Systems, 9(3):313-325, 1983.
  159. M. Sugeno and T. Yasukawa. A fuzzy logic based approach to qualitative modeling. IEEE Transactions on Fuzzy Systems, 1 (1):7-31, August 1993. M. Sugeno. Fuzzy measures and fuzzy integrals: A survey. In Madan M. Gupta, George N. Saridis, and Brian R. Gaines, editors, Fuzzy Automata and Decision Processes, pages 89-102, New York, 1977. North-Holland.
  160. Takagi & Sugeno 85] Y. Takagi and M. Sugeno. Fuzzy Identification of Systems and Its Applications to Modeling and [Tanaka 96] [Tsang et al. 00] [Tunstel et al. 96] [Tuson 98]
  161. Umanol et al. 94] [Valente deOliveira 99] Control. IEEE Transactions on Systems, Man and Cybernetics, SMC-15:116-132, 1985.
  162. Kazuo Tanaka. An Introduction to Fuzzy Logic for Practical Applications. Springer, 1996.
  163. E. C. C. Tsang, X. Z. Wang, and D. S. Yeung. Improving learning accuracy of fuzzy decision trees by hybrid neural networks. IEEE Transactions on Fuzzy Systems, 8(5):601-614, October 2000.
  164. E. Tunstel, M. R. Akbarzadeh-T, K. Kumbla, and M. Jamshidi. Soft computing paradigms for learning fuzzy controllers with applications to robotics. In Proceedings on Biennial Conference of the North American Fuzzy Information Procesing Society, NAFIPS, pages 255-359, 1996. Andrew Tuson. Optimisation with hillclimbing on steroids: an overview of neighbourhood search techniques. Technical Report 883, Department of Artificial Intelligence, The University of Edinburgh, January 1998. Uci machine learning databases. Available on web: http://ftp.ics.uci.edu/pub/ machine-learning-databases/.
  165. M. Umanol, H. Okamoto, I. Hatono, H. Tamur, F. Kawachi, S. Umedzu, and J. Kinoshita. Fuzzy decision trees by fuzzy id3 algorithm and its application to diagnosis systems. In IEEE World Congress on Computational Intelligence. Proceedings of the Third IEEE Conference on, volume 3 of Fuzzy Systems, pages 2113-2118, 1994. J. Valente de Oliveira. Semantic constrains for membership function optimization. IEEE Transactions on Systems, Man and Cybernetics - Part A: Systems and Humans, 29(1): 128-138, Jan.
  166. Whitley & Starkweather 90]
  167. Juan R. Velasco. Genetic-based on-line learning for fuzzy process control. International Journal on Intelligent Systems, 13:891-903, 1998.
  168. X. Z. Wang and J. R. Hong. On the handling of fuzziness for continuous-valued attributes in fuzzy decision trees. Fuzzy Sets and Systems, 99(3):283-290, 1998.
  169. L. X. Wang and J. M. Mendel. Generating fuzzy rules by learning from examples. IEEE Transactions on Systems, Man, and Cybernetics, 22(6): 1414-1427, November-December 1992.
  170. L.-X. Wang. Fuzzy systems as universal approximators. In Proceedings of the 1st IEEE International Conference on Fuzzy Systems, pages 1153-1162, San Diego, CA, March 1992.
  171. X. Z. Wang, B. Chen, Qian G. L., and F. Ye. On the optimization of fuzzy decision trees. Fuzzy Sets and Systems, 112:117-125, 2000.
  172. X. Z. Wang, D. S. Yeung, and E. C. C. Tsang. A comparative study on heuristic algorithms for generating fuzzy decision trees. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics, 31(2):215-226, April 2001.
  173. J. C. H. Watkins, C. Learning from delayed rewards. Unpublished PhD thesis, University of Cambridge, Cambridge, UK, 1989.
  174. D. Whitley and T. Starkweather. GENITOR II: A distributed genetic algorithm. Journal of Experimental and Theoretical Artificial Intelligence, 2(3): 189-214, July-September
  175. Darrell Whitley. The GENITOR algorithm and selection pressure: Why rank-based allocation of reproductive trials is best. In J. D. Schaffer, editor, Proceedings of the Third International Conference on Genetic Algorithms, San Mateo, CA, 1989.
  176. Morgan Kaufman.
  177. Wolberg & Mangasarian 90] [Yager & Filev 94] [Yager 79] [Yager 80] [Yeung & Tsang 97]
  178. Yuan & Shaw 95] [Zadeh 65] [Zadeh 73] [Zadeh 75] Darrell Whitley. An overview of evolutionary algorithms: practical issues and common pitfalls. Information and Software Technology, 43(14):817-831, 2001.
  179. W. H. Wolberg and O. L. Mangasarian. Multisurface method of pattern separation for medical diagnosis applied to breast cytology. In Proceedings of the National Academy of Sciences, volume 87, pages 9193-9196, U.S.A., December 1990. R. R. Yager and D. R Filev. Essentials of Fuzzy Modeling and Control. Wiley, 1994.
  180. Ronald Yager. On the measure of fuzziness and negation, part I: membership in the unit interval. International Journal of Man-Machine Studies, 5:221-229, 1979.
  181. Ronald R. Yager. On a general class of fuzzy connectives. Fuzzy Sets and Systems, 4(3):235-242, 1980. D. S. Yeung and C. C. Tsang. A comparative study on similarity-based fuzzy reasoning methods. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 27(2):216-227, April 1997.
  182. Y. Yuan and M. J. Shaw. Induction of fuzzy decision trees. Fuzzy Sets and Systems, 69:125-139, 1995.
  183. Loth A. Zadeh. Fuzzy sets.
  184. Control, 8:338-353, 1965. Information and Loth A. Zadeh. Outline of a new approach to the analysis of complex systems and decision processes. IEEE Transactions of Systems, Man and Cybernetics, SMC-3:28-44, 1973.
  185. Lofti A. Zadeh. The concept of a linguistic variable and its application to approximate reasoning i. Information Sciences, 8:199-249, 1975. [Zadeh 87] [Zadeh 96] [Zwick et al. 87] Lotfi A. Zadeh. Similarity relations and fuzzy orderings. In R. R. Yager, S. Ovchinnikov, R. M. Tong, and H. T. Nguyen, editors, Fuzzy Sets and Applications: Selected Papers by L.A. Zadeh, pages 81-104, New York, 1987. John Wiley & Sons, Inc.
  186. Lofti A. Zadeh. Fuzzy logic = computing with words. IEEE Transactions on Fuzzy Systems, 4(2): 103-111, May 1996.
  187. R. Zwick, E. Carlstein, and D. V. Budescu. Measures of similarity among fuzzy concepts: A comparative analysis. International Journal of Approximate Reasoning, 1:221-242, 1987.