Amharic Sign Language Recognition based on Amharic Alphabet Signs

dc.contributor.advisorMenore, Tekeba (Mr.)
dc.contributor.authorNigus, Kefyalew
dc.date.accessioned2019-05-31T04:10:10Z
dc.date.accessioned2023-11-04T15:14:41Z
dc.date.available2019-05-31T04:10:10Z
dc.date.available2023-11-04T15:14:41Z
dc.date.issued2018-03-16
dc.description.abstractSign language is a natural language mostly used by hearing impaired persons to communicate with each other. At present day, sign language explainers are used to eliminate the language obstacles between people who are hearing impaired and non-impaired one. However, they are very limited in number. So, automatic sign language recognition system is better to narrow the communication gap between hearing impaired and normal people. This thesis work dealts with development of automatic Amharic sign language translator, translates Amharic alphabet signs into their corresponding text using digital image processing and machine learning approach. The input for the system is video frames of Amharic alphabet signs and the output of the system is Amharic alphabets. The proposed system has four major components: preprocessing, segmentation, feature extraction and classification. The preprocessing starts with the cropping and enhancement of frames. Segmentation was done to segment hand gestures. A total of thirty-four features are extracted from shape, motion and color of hand gestures to represent both the base and derived class of Amharic sign characters. Finally, classification models are built using Neural Network and Multi-Class Support Vector Machine. The performance of each models, Neural Network (NN) and Support Vector Machine (SVM) classifiers, are compared on the combination of shape, motion and color feature descriptors using ten-fold cross validation. The system is trained and tested using a dataset prepared for this purpose only for all base characters and some derived characters of Amharic. Consequently, the recognition system is capable of recognizing these Amharic alphabet signs with 57.82% and 74.06% by NN and SVM classifiers respectively. Therefore, the classification performance of Multi-Class SVM classifier was found to be better than NN classifier.en_US
dc.identifier.urihttp://etd.aau.edu.et/handle/123456789/18349
dc.language.isoen_USen_US
dc.publisherAddis Ababa Universityen_US
dc.subjectAmharic Sign Languageen_US
dc.subjectFourier descriptoren_US
dc.subjectNeural Networken_US
dc.subjectSupport Vector machineen_US
dc.titleAmharic Sign Language Recognition based on Amharic Alphabet Signsen_US
dc.typeThesisen_US

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
Nigus Kefyalew.pdf
Size:
1.9 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Plain Text
Description: