Vocabularies for description of accessibility issues in multimodal user interfaces

Z. Obrenovic, R. Troncy, H.L. Hardman

Research output: Book/ReportReportAcademic

32 Downloads (Pure)


In previous work, we proposed a unified approach for describing multimodal human-computer interaction and interaction constraints in terms of sensual, motor, perceptual and cognitive functions of users. In this paper, we extend this work by providing formalised vocabularies that express human functionalities and anatomical structures required by specific modalities. The central theme of our approach is to connect these modality representations with descriptions of user, device and environmental constraints that influence the interaction. These descriptions can then be used in a reasoning framework that will exploit formal connections among interaction modalities and constraints. The focus of this paper is on specifying a comprehensive vocabulary of necessary concepts. Within the context of an interaction framework, we describe a number of examples that use this formalised knowledge.
Original languageEnglish
Place of PublicationAmsterdam
PublisherCentrum voor Wiskunde en Informatica
Number of pages12
Publication statusPublished - 2007

Publication series

NameCWI report. INS-E
ISSN (Print)1386-3681

Fingerprint Dive into the research topics of 'Vocabularies for description of accessibility issues in multimodal user interfaces'. Together they form a unique fingerprint.

Cite this