Access to the Document
Improving imbalanced scientific text classification using sampling strategies and dictionaries
Borrajo, Lourdes ; Romero, Rubén ; Lorenzo Iglesias, Eva ; Redondo Marey, Carmen María
Journal of Integrative Bioinformatics - JIB (ISSN 1613-4516)
Many real applications have the imbalanced class distribution problem, where one of the classes is represented by a very small number of cases compared to the other classes. One of the systems affected are those related to the recovery and classification of scientific documentation. Sampling strategies such as Oversampling and Subsampling are popular in tackling the problem of class imbalance. In this work, we study their effects on three types of classifiers (Knn, SVM and Naive-Bayes) when they are applied to search on the PubMed scientific database. Another purpose of this paper is to study the use of dictionaries in the classification of biomedical texts. Experiments are conducted with three different dictionaries (BioCreative, NLPBA, and an ad-hoc subset of the UniProt database named Protein) using the mentioned classifiers and sampling strategies. Best results were obtained with NLPBA and Protein dictionaries and the SVM classifier using the Subsampling balancing technique. These results were compared with those obtained by other authors using the TREC Genomics 2005 public corpus.
||Faculty of Technology, Research Groups in Informatics
||Data processing, computer science, computer systems
Improving imbalanced scientific text classification using sampling strategies and dictionaries.
Journal of Integrative Bioinformatics - JIB (ISSN 1613-4516), 8(3), 2011