Rules for syntax, vectors for semantics
Abstract
Latent Semantic Analysis (LSA) has been shown to perform many linguistic tasks as well as humans do, and has been put forward as a model of human linguistic competence. But LSA pays no attention to word order, much less sentence structure. Researchers in Natural Language Processing have made significant progress in quickly and accurately deriving the syntactic structure of texts. But there is little agreement on how best to represent meaning, and the representations are brittle and difficult to build. This paper evaluates a model of language understanding that combines information from rule-based syntactic processing with a vector-based semantic representation which is learned from a corpus. The model is evaluated as a cognitive model, and as a potential technique for natural language understanding.
References (21)
- Abney, S. (1996). Partial parsing via finite-state cascades. In Proceedings of the ESSLLI '96 Robust Parsing Workshop.
- Brill, E. (1994). Some advances in rule-based part of speech tagging. In Proceedings of the Twelfth Na- tional Conference on Artificial Intelligence. AAAI Press.
- Charniak, E. (1997). Statistical Parsing with a Context-free Grammar and Word Statistics. In Proceedings of the 14th National Conference of the American Associa- tion for Artificial Intelligence, Providence, RI., July, pp. 598-603.
- Collins, M. (1996). A New Statistical Parser Based on Bi- gram Lexical Dependencies. In Proceedings of the 34th Annual Meeting of the Association for Compu- tational Linguistics, Santa Cruz, CA, pp. 184-191
- Collins, M. (1998). Head-Driven Statistical Models for Natural Language Parsing. Ph.D. thesis, University of Pennsylvania.
- Daelemans, W., Buchholz, S., & Veenstra, J. (1999). Memory-Based Shallow Parsing. In Proceedings of CoNLL-99.
- Daelemans, W., Zavrel, J., van der Sloot, K., & van den Bosch, A. (2000). TiMBL: Tilburg Memory Based Learner, version 3.0, Reference Guide. Tech. rep. Technical Report 00-01, 2000, ILK, University of Tilburg. available at http://ilk.kub.nl/.
- Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990). Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science, 41, 391-407.
- Forbus, K., Ferguson, R., & Gentner, D. (1994). Incre- mental structure mapping. In Proceedings of the 16th Annual Conference of the Cognitive Science Society Mahwah, NJ. Erlbaum.
- Gentner, D. (1983). Structure-mapping: A theoretical framework for analogy. Cognitive Science, 7, 155- 170.
- Goldstone, R., Medin, D., & Halberstadt, J. (1997). Simi- larity in context. Memory and Cognition, 25(2), 237- 255.
- Landauer, T. K., Laham, D., Rehder, R., & Schreiner, M. E. (1997). How well can passage meaning be derived without using word order? A comparison of Latent Semantic Analysis and humans. In Proceedings of the 19th Annual Conference of the Cognitive Science Society, pp. 412-417 Mahwah, NJ. Erlbaum.
- Landauer, T., & Dumais, S. (1997). A solution to Plato's problem: The latent semantic analysis theory of ac- quisition, induction, and representation of knowl- edge. Psychological Review, 104, 211-240.
- Rehder, B., Schreiner, M., Laham, D., Wolfe, M., Lan- dauer, T., & Kintsch, W. (1998). Using Latent Se- mantic Analysis to assess knowledge: Some techni- cal considerations. Discourse Processes, 25, 337- 354.
- Resnik, P., & Diab, M. (2000). Measuring Verb Similarity. In Proceedings of the 22 nd Annual Conference of the Cognitive Science Society Mahwah, NJ. Erlbaum.
- Tversky, A. (1977). Features of similarity. Psychological Review, 84(4), 327-352.
- Wiemer-Hastings, P. (2000). Adding syntactic information to LSA. In Proceedings of the 22 nd Annual Confer- ence of the Cognitive Science Society, pp. 989-993 Mahwah, NJ. Erlbaum.
- Wiemer-Hastings, P., Graesser, A., Harter, D., & the Tu- toring Research Group (1998). The foundations and architecture of AutoTutor. In Goettl, B., Halff, H., Redfield, C., & Shute, V. (Eds.), Intelligent Tutoring Systems, Proceedings of the 4th International Con- ference, pp. 334-343 Berlin. Springer.
- Wiemer-Hastings, P., Wiemer-Hastings, K., & Graesser, A. (1999a). How Latent is Latent Semantic Analysis?. In Proceedings of the Sixteenth International Joint Congress on Artificial Intelligence, pp. 932-937 San Francisco. Morgan Kaufmann.
- Wiemer-Hastings, P., Wiemer-Hastings, K., & Graesser, A. (1999b). Improving an intelligent tutor's comprehen- sion of students with Latent Semantic Analysis. In Lajoie, S., & Vivet, M. (Eds.), Artificial Intelligence in Education, pp. 535-542 Amsterdam. IOS Press.
- Yarlett, D., & Ramscar, M. (2000). Structure-Mapping Theory and Lexico-Semantic Information. In Pro- ceedings of the 22nd Annual Conference of the Cog- nitive Science Society, pp. 571-576 Mahwah, NJ. Erlbaum.