AAU Institutional Repository

Amharic Sign Language Recognition based on Amharic Alphabet Signs

Show simple item record

dc.contributor.advisor Menore, Tekeba (Mr.)
dc.contributor.author Nigus, Kefyalew
dc.date.accessioned 2019-05-31T04:10:10Z
dc.date.available 2019-05-31T04:10:10Z
dc.date.issued 2018-03-16
dc.identifier.uri http://etd.aau.edu.et/handle/123456789/18349
dc.description.abstract Sign language is a natural language mostly used by hearing impaired persons to communicate with each other. At present day, sign language explainers are used to eliminate the language obstacles between people who are hearing impaired and non-impaired one. However, they are very limited in number. So, automatic sign language recognition system is better to narrow the communication gap between hearing impaired and normal people. This thesis work dealts with development of automatic Amharic sign language translator, translates Amharic alphabet signs into their corresponding text using digital image processing and machine learning approach. The input for the system is video frames of Amharic alphabet signs and the output of the system is Amharic alphabets. The proposed system has four major components: preprocessing, segmentation, feature extraction and classification. The preprocessing starts with the cropping and enhancement of frames. Segmentation was done to segment hand gestures. A total of thirty-four features are extracted from shape, motion and color of hand gestures to represent both the base and derived class of Amharic sign characters. Finally, classification models are built using Neural Network and Multi-Class Support Vector Machine. The performance of each models, Neural Network (NN) and Support Vector Machine (SVM) classifiers, are compared on the combination of shape, motion and color feature descriptors using ten-fold cross validation. The system is trained and tested using a dataset prepared for this purpose only for all base characters and some derived characters of Amharic. Consequently, the recognition system is capable of recognizing these Amharic alphabet signs with 57.82% and 74.06% by NN and SVM classifiers respectively. Therefore, the classification performance of Multi-Class SVM classifier was found to be better than NN classifier. en_US
dc.language.iso en_US en_US
dc.publisher Addis Ababa University en_US
dc.subject Amharic Sign Language en_US
dc.subject Fourier descriptor en_US
dc.subject Neural Network en_US
dc.subject Support Vector machine en_US
dc.title Amharic Sign Language Recognition based on Amharic Alphabet Signs en_US
dc.type Thesis en_US


Files in this item

This item appears in the following Collection(s)

Show simple item record

Search AAU-ETD


Browse

My Account