Spoken Multimodal Human-Computer Dialogue in Mobile Environments [electronic resource] / edited by W. Minker, Dirk Bühler, Laila Dybkjær.

Issues in Multimodal Spoken Dialogue Systems and Components -- Multimodal Dialogue Systems -- Speech Recognition Technology in Multimodal/Ubiquitous Computing Environments -- A Robust Multimodal Speech Recognition Method using Optical Flow Analysis -- Feature Functions for Tree-Based Dialogue Course Management -- A Reasoning Component for Information-Seeking and Planning Dialogues -- A Model for Multimodal Dialogue System Output Applied to an Animated Talking Head -- System Architecture and Example Implemesntations -- Overview of System Architecture -- XISL: A Modality-Independent MMI Description Language -- A Path to Multimodal Data Services for Telecommunications -- Multimodal Spoken Dialogue with Wireless Devices -- The Smartkom Mobile Car Prototype System for Flexible Human-Machine Communication -- LARRI: A Language-Based Maintenance and Repair Assistant -- Evaluation and Usability -- Overview of Evaluation and Usability -- Evaluating Dialogue Strategies in Multimodal Dialogue Systems -- Enhancing the Usability of Multimodal Virtual Co-drivers -- Design, Implementation and Evaluation of the SENECA Spoken Language Dialogue System -- Segmenting Route Descriptions for Mobile Devices -- Effects of Prolonged Use on the Usability of a Multimodal Form-Filling Interface -- User Multitasking with Mobile Multimodal Systems -- Speech Convergence with Animated Personas.

The ongoing migration of computing and information access from stationary environments to mobile computing devices for eventual use in mobile environments, such as Personal Digital Assistants (PDAs), tablet PCs, next generation mobile phones, and in-car driver assistance systems, poses critical challenges for natural human-computer interaction. Spoken dialogue is a key factor in ensuring natural and user-friendly interaction with such devices which are meant not only for computer specialists, but also for everyday users. Speech supports hands-free and eyes-free operation, and becomes a key alternative interaction mode in mobile environments, e.g. in cars where driver distraction by manually operated devices may be a significant problem. On the other hand, the use of mobile devices in public places, may make the possibility of using alternative modalities possibly in combination with speech, such as graphics output and gesture input, preferable due to e.g. privacy issues. Researchers' interest is progressively turning to the integration of speech with other modalities such as gesture input and graphics output, partly to accommodate more efficient interaction and partly to accommodate different user preferences. This book: combines overview chapters of key areas in spoken multimodal dialogue (systems and components, architectures, and evaluation) with chapters focussed on particular applications or problems in the field. focusses on the influence of the environment when building and evaluating an application. Audience: Computer scientists, engineers, and others who work in the area of spoken multimodal dialogue systems in academia and in the industry. Graduate students and Ph.D. students specialising in spoken multimodal dialogue systems in general, or focusing on issues in these systems in mobile environments in particular