Addis Ababa University Libraries Electronic Thesis and Dissertations: AAU-ETD! >
Institute of Technology >
Thesis - Computer Engineering  >

Please use this identifier to cite or link to this item: http://hdl.handle.net/123456789/2732

Authors: Abadi, Tsegay
Advisors: Dr. Kumudha Raimond
Keywords: EMA, candidate gesture selection,
CGS, trajectory determination,
HMTD, Modified Hausdorff distance
MHD, Speed profile, search window.
Copyright: Oct-2011
Date Added: 6-May-2012
Abstract: ABSTRACT There is a clear communication gap between the deaf and hearing community. To bridge this gap, one possible solution is to teach the hearing community to use sign languages. However, a better solution is to develop a translation system that converts a continuous sign language gestures to text or speech. A lot of effort has been invested in developing alphabet recognition and continuous sign language translation systems for many sign languages around the world. In this regard, little attention has been given to Ethiopian sign language (EthSL). However, an Ethiopian Manual Alphabet (EMA) recognition system has been developed recently. For a recognition system that can recognize continuous gestures from video which can be used as a translation, a methodology that extracts candidate gestures from sequence of video frames and determines hand movement trajectories is required. In this thesis, a system that extracts candidate gestures for EMA and determines hand movement trajectories is proposed. The system has two separate parts namely Candidate Gesture Selection (CGS) and Hand Movement Trajectory Determination (HMTD). The CGS combines two metrics namely speed profile of continuous gestures and Modified Hausdorff Distance (MHD) measure and has an accuracy of 80.72%. The HMTD is done by considering each hand gesture centroid from frame to frame and using angle, x- and y-directions. A qualitative evaluation of the CGS in a correctly divided video clip is found to be 94.81%. The HMTD has an accuracy of 88.31%. The overall system performance is 71.88%
URI: http://hdl.handle.net/123456789/2732
Appears in:Thesis - Computer Engineering

Files in This Item:

File Description SizeFormat
Abadi Tsegay.pdf3.67 MBAdobe PDFView/Open

Items in the AAUL Digital Library are protected by copyright, with all rights reserved, unless otherwise indicated.


  Last updated: May 2010. Copyright © Addis Ababa University Libraries - Feedback