Browsing by Author "Mamo, Getachew"

Now showing 1 - 2 of 2
  • No Thumbnail Available
    Item
    Part-Of-Speech Tagging For Afaan Oromo Language
    (Addis Ababa University, 2009-01) Mamo, Getachew; Meshesha, Million (PhD)
    Most natural language processing systems use part-of-speech (POS) tagger as a separate module in their architecture. Specially, it is very significant for developing parser, machine translator, speech recognizer and search engines. Tagging is a process of labeling part-of-speech tags to words of a text such that contextual information can be obtained from word labels. The main aim of this study is to develop part-of-speech tagger for Afaan Oromo language. After reviewing literatures on Afaan Oromo grammars and identify tagset and word categories, the study adopts Hidden Markov Model (HMM) approach and has implemented unigram and bigram models of Viterbi algorithm. HMM is a statistical approach which is used in this study for part-of–speech tagging for Afaan Oromo words in a given corpus. Unigram model is used to understand word ambiguity in the language, while bigram model is used to undertake contextual analysis of words. For training and testing purpose 159 sentences (with a total of 1621 words) that are manually annotated sample corpus are used. The corpus is collected from different public Afaan Oromo newspapers and bulletins to make the sample corpus balanced. A database of lexical probabilities (LexProb) and transitional probabilities (TransProb) are developed from this annotated corpus. These two probabilities are from which the tagger learn and tag sequence of words in a sentence.Java programming language is used to develop the tagger prototype based on the Viterbi algorithm with unigram and bigram models. It is also used to compute both lexical probabilities and transitional probabilities. The performance of the prototype, Afaan Oromo tagger is tested using ten fold cross validation mechanism. The result shows that in both unigram and bigram models 87.58% and 91.97% accuracy is obtained, respectively. Based on experimental analysis, concluding remarks and recommendations are forwarded.
  • No Thumbnail Available
    Item
    Part-of-Speech Tagging for Afaan Oromo Language
    (Addis Ababa University, 2009-01) Mamo, Getachew; Meshesha, Million (PhD)
    Most natural language processing systems use part-of-speech (POS) tagger as a separate module in their architecture. Specially, it is very significant for developing parser, machine translator, speech recognizer and search engines. Tagging is a process of labeling part-of speech tags to words of a text such that contextual information can be obtained from word labels. The main aim of this study is to develop part-of-speech tagger for Afaan Oromo language. After reviewing literature on Afaan Oromo grammars and identifying tag set and word categories, the study adopted Hidden Markov Model (HMM) approach and has implemented uni gram and bi gram models of vertebra algorithm. Uni gram model is used to understand word ambiguity in the language, while bi gram model is used to undertake contextual analysis of words. For training and testing purpose 159 sentences (with a total of 162 1 words) that are manually annotated sample corpus are used. The corpus is collected from different public Afaan Oromo newspapers and bulletins to make the sample corpus balanced. A database of lexical probabilities (LexProb) and transitional probabilities (Trans Prob) are developed from thi s annotated corpus. These two probabilities are from which the tagger learn and tag sequence of words in a sentence The performance of the prototype, Afaan Oromo tagger is tested using ten fold cross validation mechanism. The result shows that in both uni gram and bi gram models 87.58% and 91.97% accuracy is obtained, respectively. Based on experimental analysis, concluding remarks and recommendations are forwarded. Keywords: Natural Language processing, parts of speech tagging, Hidden Markov Model, N - Gram.