This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Vaidyanathan, R. Articles by Lin, D. Search for Related Content Social Bookmarking                         What's this?

A Dual Mode Human-Robot Teleoperation Interface Based on Airflow in the Aural Cavity

University of Southampton, Southampton, UK Naval Postgraduate School, Monterey, CA, USA Case Western Reserve University, OH, USA rvaidyan{at}nps.edu

Monique P. Fargues

Naval Postgraduate School, Monterey, CA, USA

R. Serdar Kurcan

Naval Postgraduate School, Monterey, CA, USA

Lalit Gupta

Southern Illinois University, Carbondale, IL, USA

Srinivas Kota

Southern Illinois University, Carbondale, IL, USA

Roger D. Quinn

Case Western Reserve University, OH, USA

Dong Lin

Think-A-Move, Ltd, Beachwood, OH, USA

Robot teleoperation systems have been limited in their utility due to the need for operator motion, lack of portability and limitation to singular input modalities. In this article, the design and construction of a dual-mode human—machine interface system for robot teleoperation addressing all these issues is presented. The interface is capable of directing robotic devices in response to tongue movement and/or speech without insertion of any device in the vicinity of the oral cavity. The interface is centered on the unique properties of the human ear as an acoustic output device. Specifically, we present: (1) an analysis of the sensitivity of human ear canals as acoustic output device; (2) the design of a new sensor for monitoring airflow in the aural canal; (3) pattern recognition procedures for recognition of both speech and tongue movement by monitoring aural flow across several human test subjects; and (4) a conceptual design and simulation of the machine interface system. We believe this work will lay the foundation for a new generation of human machine interface systems for all manner of robotic applications.

Key Words: robot teleoperation • human—machine interface • decision fusion • multi-modal control • physiological signal recognition

The International Journal of Robotics Research, Vol. 26, No. 11-12, 1205-1223 (2007)
DOI: 10.1177/0278364907082612


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?