URBANA: Revista Eletrônica do Centro Interdisciplinar de Estudos sobre a Cidade, Apr 3, 2013
Olhai, peixes, lá do mar para a terra. Não, não: não é isso que vos digo. Vós virais os olhos par... more Olhai, peixes, lá do mar para a terra. Não, não: não é isso que vos digo. Vós virais os olhos para os matos e para o Sertão? Para cá, para cá; para a Cidade é, que haveis de olhar." (Antonio Vieira,
Proceedings of the Thirteenth ACM conference on Information and knowledge management - CIKM '04, 2004
Automatic text classification methods come with various calibration parameters such as thresholds... more Automatic text classification methods come with various calibration parameters such as thresholds for probabilities in Bayesian classifiers or for hyperplane distances in SVM classifiers. In a given application context these parameters should be set so as to meet the relative importance of various result quality metrics such as precision versus recall. In this paper we consider classifiers that can accept a document for a topic, reject it, or abstain. We aim to meet the application's goals in terms of accuracy (i.e., avoid false acceptances or rejections) and loss (i.e., limit the fraction of documents for which no decision is made). To this end we investigate restrictive forms of Support Vector Machine classifiers and we develop meta methods that split the training data into subsets for independently trained classifiers and then combine the results of these classifiers. These techniques tend to improve accuracy at the expense of document loss. We develop estimators that help to predict the accuracy and loss for a given setting of the methods' tuning parameters, and a methodology for efficiently deriving a setting that meets the application's goals. Our experiments confirm the practical viability of the approach.
Uploads
Papers by Luciana Gama