Hierarchical Amharic News Text Classification
No Thumbnail Available
Date
2010-07
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Addis Ababa University
Abstract
The advancement of the present day technology enables the production of huge amount of
information. Retrieving useful information out of these huge collections necessitates proper
organization and structuring. Automatic text classification is an inevitable solution in this regard.
However, the present approach focuses on the flat classification, where each topic is treated as a
separate class, which is inadequate in text classification where there are a large number of classes
and a huge number of relevant features needed to distinguish between them.
This paper explores the use of hierarchical structure for classifying a large, heterogeneous
collection of Amharic News Text. The approach utilizes the hierarchical topic structure to
decompose the classification task into a set of simpler problems, one at each node in the
classification tree.
An experiment had been conducted using a categorical data collected from Ethiopian News
Agency (ENA) using SVM to see the performances of the hierarchical classifiers on Amharic
News Text. The findings of the experiment show the accuracy of flat classification decreases as
the number of classes and documents (features) increases. Moreover, the accuracy of the flat
classifier decreases at an increasing number of top feature set. The peak accuracy of the flat
classifier was 68.84 % when the top 3 features were used.
The findings of the experiment done using hierarchical classification show an increasing
performance of the classifiers as we move down the hierarchy. The maximum accuracy achieved
was 90.37% at level-3(last level) of the category tree. Moreover, the accuracy of the hierarchical
classifiers increases at an increasing number of top feature set compared to the flat classifier. The
peak accuracy was 89.06% using level three classifier when the top 15 features were used.
Furthermore, the performance between flat classifier and hierarchical classifiers are compared
using the same test data. Thus, it shows that use of the hierarchical structure during classification
has resulted in a significant improvement of 29.42 % in exact match precision when compared
with a flat classifier.
Keywords: Automatic Text Classification, Flat Classification, Hierarchical Classification,
Support Vector Machine
Description
Keywords
Automatic Text Classification, Flat Classification, Hierarchical Classification, Support Vector Machine