Universität Bielefeld Electronic Collections animiertes Foto Universität Bielefeld

Access to the Document



Subunit Boundary Detection for Sign Language Recognition Using Spatio-temporal Modelling

Han, Junwei ; Awad, George ; Sutherland, Alistair

The 5th International Conference on Computer Vision Systems, 2007
Bielefeld, 21. - 24. März 2007

Download file

Abstract:
The use of subunits offers a feasible way to recognize sign language with large vocabulary. The initial step is to partition signs into elementary units. In this paper, we firstly define a subunit as one continuous hand action in time and space, which comprises a series of interrelated consecutive frames. Then, we propose a solution to detect the subunit boundary according to spatio-temporal features using a three-stage hierarchy: in the first stage, we apply hand segmentation and tracking algorithm to capture motion speeds and trajectories; in the second stage, the obtained speed and trajectory information are combined to locate subunit boundaries; finally, temporal clustering by dynamic time warping (DTW) is adopted to merge similar segments and refine the results. The presented work does not need prior knowledge of the types of signs and is robust to signer behaviour variation. Moreover, it can provide a base for high-level sign language understanding. Experiments on many real-world signing videos show the effectiveness of the proposed work.


Keywords: Sign language recognition, hand gesture, subunit, hand motion, trajectory
Institution: Faculty of Technology, Research Groups in Informatics
DDC classification: Data processing, computer science, computer systems

Suggested Citation:
Han, Junwei ; Awad, George ; Sutherland, Alistair  (2007)  Subunit Boundary Detection for Sign Language Recognition Using Spatio-temporal Modelling. The 5th International Conference on Computer Vision Systems, 2007


URL: http://biecoll.ub.uni-bielefeld.de/volltexte/2007/59



 Questions or comments: publikationsdienste.ub@uni-bielefeld.de
 Latest update: 15 Feb 2011
 Legal Notice
OPUS-Logo     OAI compliant      BU Logo
OAI-Logo