Word Level Amharic Sign Language Recognition using Deep Learning Algorithms

dc.contributor.advisorGetachew, Alemu (PhD)
dc.contributor.authorBiruk, Mengiste
dc.date.accessioned2022-03-03T10:05:07Z
dc.date.accessioned2023-11-04T15:14:44Z
dc.date.available2022-03-03T10:05:07Z
dc.date.available2023-11-04T15:14:44Z
dc.date.issued2022-02
dc.description.abstractIn Ethiopia, Deaf peoples are vastly increase in number. Sign language is a natural language mostly used by Deaf persons to communicate with each other. However, during communication there is a big challenge between Deaf and normal person. Deaf use sign for communication whereas normal person use speech/text for communication. We need efficient system to exchange sign to speech/text or speech/text to sign. This thesis work focus on development of word level Amharic sign language recognition, translates Amharic word sign into their corresponding Amharic text using deep learning approach. The input for the system is video frames of Amharic sign words and the final output of the system is Amharic text. The proposed system has three major components: preprocessing, feature extraction and classification. Two preprocessing steeps were used, cropping and RGB to Grayscale conversion. Feature extraction was done by using deep residual network (ResNet-34) and store in .csv format. Finally, classification was done by the same deep learning algorithms ResNet-34. The system is trained and tested using a dataset prepared for this thesis purpose only for all Amharic sign words. The performance of the model measured by four different matrices (precision, recall, F1 score and accuracy). The system classify 60 sign words and score overall accuracy of 95%. Therefore, the classification performance of ResNet-34 is very good.en_US
dc.identifier.urihttp://etd.aau.edu.et/handle/123456789/30421
dc.language.isoen_USen_US
dc.publisherAddis Ababa Universityen_US
dc.subjectAmharic sign wordsen_US
dc.subjectdeep learning algorithmsen_US
dc.subjectResNet-34en_US
dc.titleWord Level Amharic Sign Language Recognition using Deep Learning Algorithmsen_US
dc.typeThesisen_US

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
Biruk Mengiste.pdf
Size:
4.6 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Plain Text
Description: