Detection of major ASL sign types in continuous signing for ASL recognition
Files
Published version
Date
2016
DOI
Authors
Yanovich, Polina
Neidle, Carol
Metaxas, Dimitris
Version
OA Version
Citation
Polina Yanovich, Carol Neidle, Dimitris Metaxas. 2016. "Detection of Major ASL Sign Types in Continuous Signing for ASL Recognition." Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016). Language Resources and Evaluation Conference 2016. Portorož, Slovenia, 2016-05-23 - 2016-05-28
Abstract
In American Sign Language (ASL) as well as other signed languages, different classes of signs (e.g., lexical signs, fingerspelled signs, and classifier constructions) have different internal structural properties. Continuous sign recognition accuracy can be improved through use of distinct recognition strategies, as well as different training datasets, for each class of signs. For these strategies to be applied, continuous signing video needs to be segmented into parts corresponding to particular classes of signs. In this paper we present a multiple instance learning-based segmentation system that accurately labels 91.27% of the video frames of 500 continuous utterances (including 7 different subjects) from the publicly accessible NCSLGR corpus <http://secrets.rutgers.edu/dai/queryPages/> (Neidle and Vogler, 2012). The system uses novel feature descriptors derived from both motion and shape statistics of the regions of high local motion. The system does not require a hand tracker.
Description
License
This open access article is licensed under the Attribution-NonCommercial-NoDerivatives 4.0 International license.
Copyright 2016 by the European Language Resources Association.