Academia.eduAcademia.edu

Outline

On case-based learnability of languages

1997, New Generation Computing

https://doi.org/10.1007/BF03037560

Abstract

Case-based reasoning is deemed an important technology to alleviate the bottleneck of knowledge acquisition in Artificial Intelligence (AI). In case-based reasoning, knowledge is represented in the form of particular cases with an appropriate similarity measure rather than any form of rules. The case-based reasoning paradigm adopts the view that an A1 system is dynamically changing during its life-cycle which immediately leads to learning considerations. Within the present paper, we investigate the problem of case-based learning of indexable classes of formal languages. Prior to learning considerations, we study the problem of case-based representability and show that every indexable class is case-based representable with respect to a fixed similarity measure. Next, we investigate several models of case-based learning and systematically analyze their strengths as well as their limitations. Finally, the general approach to case-based learnability of indexable classes of formal languages is prototypically applied to so-called containmet decision lists, since they seem particularly tailored to case-based knowledge processing.

References (21)

  1. Aha, D. W., Kibler, D., and Albert, M. C., "Instance-Based Learning Algorithms," Machine Learning, 6, pp. 37-66, 1991.
  2. Angluin, D., "Inductive Inference of Formal Languages from Positive Data," Informa- tion and Control, 45, pp. 117-135, 1980.
  3. Angluin, D. and Smith, C. H., "Inductive Inference: Theory and Methods," A CM Computing Surveys, 15, pp. 237-269, 1983.
  4. Blum, L. and Blum, M., "Toward a Mathematical Theory of Inductive Inference," Information and Control, 28, pp. 122-155, 1975.
  5. Bakhtari, S., B6rner, K., Bartsch-Sp6rl, B., Coulon, C.-H., Janetzko. D., Knauff, M., Hovestadt, L., and Schlieder, C., "EWCBR 93: Contributions of FABEL," FABEL- Report, 17, Gesellschaft ffir Mathematik und Datenverarbeitung, 1993.
  6. Burghardt, U., DOtsch, V., and Frind, S., "TIC--Ein Testrahmen ffir IND-CBL," CALG 01/96, HTWK Leipzig, Fachbereich IMN, Forschungsgruppe Algorithmisches Lernen, 1996.
  7. Coulon, C.-H., Gebhardt, F., "Evaluation of Retrieval Methods in Case-Based Design," FABEL-Report, 24, Gesellshaft ffir Mathematik und Datenverarbeitung, 1994.
  8. Cost, S. and Salzberg, S., "A Weighted Nearest Neighbor Algorithm for Learning with Symbolic Features," Machine Learning, 10, pp. 57-78, 1993.
  9. Globig, C. and Lange, S., "Case-Based Representability of Classes of Boolean Func- tions," in Proceedings of 12th European Conference on Artificial Intelligence (ECA1 96), John Wiley & Sons, 1996, to appear.
  10. Gold, E. M., "Language Identification in the Limit," Information and Control, 10, pp. 447-474, 1967.
  11. Hopcroft, J. E. and Ullman, J. D., Introduction to Automata Theory, Languages, and Computation, Addison-Wesley, 1979.
  12. Jantke, K. P., "Case-Based Learning in Inductive Inference," in Proceedings of 5th Workshop on Computational Learning Theory (COLT'92), ACM Press, pp. 218-223, 1992.
  13. Jantke., K. P., "Types of Incremental Learning," in Working Notes, AAAI Spring Symposium on Training Issues in Incremental Learning, Stanford University, pp. 26-32, 1993.
  14. Jantke K. P. and Lange, S., "Case-Based Representation and Learning of Pattern Languages," in Proceedings of 4th Workshop on Algorithmic Learning Theory (ALT' 93), Lecture Notes in Artificial Intelligence 744, Springer-Verlag, pp. 87-100, 1993.
  15. Jantke, K. P. and Lange, S., "Case-Based Representation and Learning of Pattern Languages," Theoretical Computer Science, 137, pp. 25-51, 1995.
  16. Kolodner, J. L., "An Introduction to Case-Based Reasoning," Artificial Intelligence Review, 6, pp. 3-34, 1992.
  17. Kolodner, J. L., Case-Based Reasoning, Morgan Kaufmann, 1993.
  18. Riesbeck, C. K. and Schank, R. C., Inside Case-Based Reasoning, Lawrence Erlbaum Assoc., 1989.
  19. Rivest, R. L., "Learning Decision Lists," Machine Learning, 2, pp. 229-246, 1987.
  20. Sakakibara, Y. and Siromoney, R., "A Noise Model on Learning Sets of Strings," in Proceedings of 5th Workshop on Computational Learning Theory (COLT'92), ACM Press, pp. 295-302, 1992.
  21. Zeugmann, T. and Lange, S., "A Guided Tour Across the Boundaries of Learning Recursive Languages," in Algorithmic Learning for Knowledge-Based Systems (Klaus P. Jantke and Steffen Lange, eds.), Springer-Verlag, pp. 190-258, 1995. Christoph Globig: He has studied Computer Science at the University of Kaiserslautern and graduated in 1993 with a Master Thesis on a comparison of inductive and case-based learning. Since 1993, he is member of the research group of Prof. Richter at the University of Kaiserslautern. His main research interest is in Machine Learning especially the foundations of case-based reasoning and Machine Learn- ing.