Academia.eduAcademia.edu

Outline

Chinese Term Extraction Based on Delimiters

Abstract

Existing techniques extract term candidates by looking for internal and contextual information associated with domain specific terms. The algorithms always face the dilemma that fewer features are not enough to distinguish terms from non-terms whereas more features lead to more conflicts among selected features. This paper presents a novel approach for term extraction based on delimiters which are much more stable and domain independent. The proposed approach is not as sensitive to term frequency as that of previous works. This approach has no strict limit or hard rules and thus they can deal with all kinds of terms. It also requires no prior domain knowledge and no additional training to adapt to new domains. Consequently, the proposed approach can be applied to different domains easily and it is especially useful for resource-limited domains. Evaluations conducted on two different domains for Chinese term extraction show significant improvements over existing techniques which veri...

References (15)

  1. References
  2. Chen, Y.R., Lu, Q., Li. W.J., Sui, Z.F., Ji, L.N. (2006). A Study on Term Extraction Based on Classified Corpora. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC2006), Italy, 2006.
  3. Chien, L.F. (1999). Pat-tree-based adaptive keyphrase extraction for intelligent Chinese information retrieval. Information Processing and Management, 35, pp.501--521.
  4. Frank, E., Paynter, G.W., Witten, I.H., Gutwin, C., Nevill-Manning, C.G. (1999). Nevill-Manning.
  5. Domain-specific keyphrase Extraction. In Proceedings of 16th International Joint Conference on Artificial Intelligence IJCAI-99, pp. 668--673.
  6. Feng, H.D., Chen, K., Deng, X.T., Zheng, W.M. (2004). Accessor variety criteria for Chinese word extraction. Computational Linguistics. 30(1), pp.75--93.
  7. Frantzi, K., Ananiadou, S., Mima, H. (2000) Automatic recognition of multi-word terms. International Journal of Digital Libraries, 3(2), pp.117--132.
  8. Huang, C.R., Simon, P., Hsieh, S.K., Pr´evot, L. (2007). Rethinking Chinese Word Segmentation: Tokenization, Character Classification, or Wordbreak Identification. In Proceedings of the ACL 2007 Demo and Poster Sessions, pp. 69-72.
  9. Ji, L.N., Lu, Q. (2007). Chinese Term Extraction Using Window-Based Contextual Information. CICLing 2007, LNCS 4394, pp. 62--74.
  10. Kageura, K., Umino, B. (1996). Methods of automatic term recognition: a review. Term, 3(2), pp. 259--289.
  11. Kleinberg, J. (1997). Authoritative sources in a hyperlinked environment. In Proceedings of the 9th ACM-SIAM Symposium on Discrete Algorithms, pp. 668--677.
  12. Luo, S.F., Sun, M.S. (2003). Two-Character Chinese Word Extraction Based on Hybrid of Internal and Contextual Measures. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, July, 2003, pp. 24--30.
  13. Salton, G., McGill, M.J. (1983). Introduction to Modern Information Retrieval. McGraw-Hill.
  14. Schone, P., Jurafsky, D. (2001). Is knowledge-free induction of multiword unit dictionary headwords a solved problem? In Proceedings of the 6th Conference on Empirical Methods in Natural Language Processing (EMNLP 2001), pp. 100--108.
  15. Sornlertlamvanich, V., Potipiti, T., Charoenporn, T. (2000). Automatic corpus-based Thai word extraction with the C4.5 learning algorithm. In Proceedings of the 18 th International Conference on Computational Linguistics (COLING 2000) Vol. 2, Jul 2000, pp. 802--807.