Multimodal user interfaces (Computer systems)
Enlarge text Shrink text-
Topic
- Work cat.: Harelick, M. Multimodal dialogue for a fax application, 1995:p. 1 (Multimodal dialogue is the merging of the ideas of a multimodal user interface and human-computer dialogue. A multimodal user interface allows users to communicate with computers using multiple modalities, such as mouse, pen, voice in various combinations)
- Handbook of research on user interface design and evaluation for mobile technology, 2008:v. 1, p. 477 (multimodal user interface: A user interface with which users can choose to interact with a system through one of the supported modalities, or multiple modalities simultaneously, based on the usage environment or preference. Multimodal user interface can increase the usability because the strength of one modality often compensates for the weaknesses of another)
- Raisamo, R. Multimodal human-computer interaction, 1999:p. 2 (Multimodal user interfaces are a strong candidate for being the next breakthrough in building better user interfaces. Multimodal interfaces combine many simultaneous input modalities and may present the information using synergistic representation of many different output modalities)
- Australasian Computer Human Interaction Conference (2007 : Adelaide (S. Aust.)). Proceedings of the 2007 Conference on Computer-Human Interaction Special Interest Group (CHISIG) of Australia on Computer-Human Interaction, 2007:PDF p. 215 (A Multimodal User Interface (MMUI) allows a user to interact with a computer in a way similar to human-to-human communication, for example, through speech and gesture)
- Virtual reality, 1995:p. 247 (Multimodal user interfaces are simply human-machine interfaces that actively or purposefully use interaction and display techniques in multiple sensory modalities (e.g., visual, haptic, and auditory))
Multimodal interaction provides the user with multiple modes of interacting with a system. A multimodal interface provides several distinct tools for input and output of data. Multimodal human-computer interaction involves natural communication with virtual and physical environments. It facilitates free and natural communication between users and automated systems, allowing flexible input (speech, handwriting, gestures) and output (speech synthesis, graphics). Multimodal fusion combines inputs from different modalities, addressing ambiguities. Two major groups of multimodal interfaces focus on alternate input methods and combined input/output. Multiple input modalities enhance usability, benefiting users with impairments. Mobile devices often employ XHTML+Voice for input. Multimodal biometric systems use multiple biometrics to overcome limitations. Multimodal sentiment analysis involves analyzing text, audio, and visual data for sentiment classification. GPT-4, a multimodal language model, integrates various modalities for improved language understanding. Multimodal output systems present information through visual and auditory cues, using touch and olfaction. Multimodal fusion integrates information from different modalities, employing recognition-based, decision-based, and hybrid multi-level fusion. Ambiguities in multimodal input are addressed through prevention, a-posterior resolution, and approximation resolution methods.
Read more on Wikipedia >