Abstract
This paper presents a new version of an existing hybrid model for the development of knowledge-based systems, where case-based reasoning is used as a problem solver. Numeric predictive attributes are modeled in terms of fuzzy sets to define neurons in an associative Artificial Neural Network (ANN). After the Fuzzy-ANN is trained, its weights and the membership degrees in the training examples are used to automatically generate a local distance function and an attribute weighting scheme. Using this distance function and following the Nearest Neighbor rule, a new hybrid Connectionist Fuzzy Case-Based Reasoning model is defined. Experimental results show that the model proposed allows to develop knowledge-based systems with a higher accuracy than when using the original model. The model takes the advantages of the approaches used, providing a more natural framework to include expert knowledge by using linguistic terms.
FAQs
AI
What are the advantages of using fuzzy sets in CBR models?
Fuzzy sets allow for a more natural representation of numeric attributes, using linguistic terms while addressing uncertainty. This enables better handling of cases with continuous data compared to traditional crisp set approaches.
How does the ConFuCiuS model perform against traditional classifiers?
ConFuCiuS attained higher accuracy than the C4.5 algorithm on 10 out of 15 datasets tested. The performance difference was statistically significant, achieving a significance level of 0.015.
What was the impact of linguistic terms on the model's accuracy?
Using linguistic terms to represent numeric attributes improved the model's accuracy by providing a more intuitive framework. The results indicated that the model performed better across datasets with symbolic attributes.
How does the new model define its dissimilarity function?
The dissimilarity function in the ConFuCiuS model is automatically defined based on the weights and membership degrees derived from the trained Fuzzy-SIAC. This approach personalizes the attribute weighting and distance functions for better performance.
What methodology was used to evaluate the performance of ConFuCiuS?
The performance evaluation used 10-fold cross-validation on datasets from UCI ML and compared results with traditional models. Statistical significance was measured using the Wilcoxon signed-rank test combined with Monte Carlo simulations.
References (18)
- Kolodner, J.: An introduction to case-based reasoning. Artificial Intelligence Review 6 (1992) 3-34
- García, M.M., Bello, P.R.: A model and its different applications to case-based reasoning. Knowledge-based systems 9 (1996) 465-473
- Stanfill, C., Waltz, D.: Toward memory-based reasoning. Comm. of ACM, 29 (1986) 1213-1228
- McClelland, D., Rumelhart, E.: Explorations in parallel distributed processing. MIT Press (1989)
- Kurgan, L, Krzysztof, C.: CAIM Discretization Algorithm. IEEE Transactions on Knowl- edge and Data Engineering. Vol 16. No. 2. (2004)
- Zadeh, L.A.: The concept of a lingüistic variable and Its Application to Approximate Rea- soning. Information Sciences Vol. 8 (1975) 199-249
- Zadeh, L.A.: From Computing with Numbers to Computing with Words -From Manipula- tion of Measurements to Manipulation of Perceptions. Intelligent Systems and Soft Com- puting (2000) 3-40
- Włodzisław, D. : Similarity-based methods: a general framework for classification, ap- proximation and association Control and Cybernetics vol.29 No. 4 (2000)
- Aha, D.W. : Feature weighting for lazy learning algorithms. In: H. Liu and H. Motoda (Eds.) Feature Extraction, Construction and Selection: A Data Mining Perspective. Nor- well MA: Kluwer (1998)
- Morell, C., Bello, R., Grau, R. "Improving k-NN by Using Fuzzy Similarity Functions. Lectures Notes on Artificial Intelligence 3315, Nov 2004, Springer Verlag Berlin Heidel- berg (2004) 708-716
- Wettschereck, D., Aha, D.W., Mohri , T.: A Review And Empirical Evaluation Of Feature Weighting Methods For A Class Of Lazy Learning Algorithms. Artificial Intelligence Re- view 11, (1997) 273-314
- Casillas, O., Cordón, F., Herrera, L., Magdalena: Interpretability improvements to find the balance interpretability-accuracy in fuzzy modeling: an overview. Interpretability issues in fuzzy modeling. Vol. 128. Springer (2003)
- García, MM., Rodriguez, Y., Bello, R.: Usando conjuntos borrosos para implementar un modelo para sistemas basados en casos interpretativos. In Proceedings of IBERAMIA- SBIA. Eds por M. C. Monard y J.S. Sichman, Sao Paulo, Brasil, (2000)
- Murphy, P.M., Aha, D.W.: UCI Repository of Machine-Learning Databases, http:\\ www.ics.uci.edu/~mlearn\mlrepository.htm
- Wilson, D.R., Martinez, T.R..: Improved Heterogeneous Distance Functions. Journal of Artificial Intelligence Research, vol. 6, no. 1, (1997) 1-34.
- Mitchell, T.M.: The Need for Biases in Learning Generalizations. in J. W. Shavlik & T. G. Dietterich (Eds.), Readings in Machine Learning. San Mateo, CA: Morgan Kaufmann, (1990) 184-191
- Quinlan, R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo, CA. (1993)
- Michie, D., Spiegelhalter, D.J, Taylor C.C.: Machine Learning, Neural and Statistical Classification (1994)