Vocabularies for description of accessibility issues in multimodal user interfaces

Z. Obrenovic, R. Troncy, H.L. Hardman

Research output: Book/ReportReportAcademic

26 Downloads (Pure)

Abstract

In previous work, we proposed a unified approach for describing multimodal human-computer interaction and interaction constraints in terms of sensual, motor, perceptual and cognitive functions of users. In this paper, we extend this work by providing formalised vocabularies that express human functionalities and anatomical structures required by specific modalities. The central theme of our approach is to connect these modality representations with descriptions of user, device and environmental constraints that influence the interaction. These descriptions can then be used in a reasoning framework that will exploit formal connections among interaction modalities and constraints. The focus of this paper is on specifying a comprehensive vocabulary of necessary concepts. Within the context of an interaction framework, we describe a number of examples that use this formalised knowledge.
Original languageEnglish
Place of PublicationAmsterdam
PublisherCentrum voor Wiskunde en Informatica
Number of pages12
Publication statusPublished - 2007

Publication series

NameCWI report. INS-E
Volume0702
ISSN (Print)1386-3681

Fingerprint

Human computer interaction
User interfaces

Cite this

Obrenovic, Z., Troncy, R., & Hardman, H. L. (2007). Vocabularies for description of accessibility issues in multimodal user interfaces. (CWI report. INS-E; Vol. 0702). Amsterdam: Centrum voor Wiskunde en Informatica.
Obrenovic, Z. ; Troncy, R. ; Hardman, H.L. / Vocabularies for description of accessibility issues in multimodal user interfaces. Amsterdam : Centrum voor Wiskunde en Informatica, 2007. 12 p. (CWI report. INS-E).
@book{4196b55cdf9f4d85ae1028e114b7a18e,
title = "Vocabularies for description of accessibility issues in multimodal user interfaces",
abstract = "In previous work, we proposed a unified approach for describing multimodal human-computer interaction and interaction constraints in terms of sensual, motor, perceptual and cognitive functions of users. In this paper, we extend this work by providing formalised vocabularies that express human functionalities and anatomical structures required by specific modalities. The central theme of our approach is to connect these modality representations with descriptions of user, device and environmental constraints that influence the interaction. These descriptions can then be used in a reasoning framework that will exploit formal connections among interaction modalities and constraints. The focus of this paper is on specifying a comprehensive vocabulary of necessary concepts. Within the context of an interaction framework, we describe a number of examples that use this formalised knowledge.",
author = "Z. Obrenovic and R. Troncy and H.L. Hardman",
year = "2007",
language = "English",
series = "CWI report. INS-E",
publisher = "Centrum voor Wiskunde en Informatica",

}

Obrenovic, Z, Troncy, R & Hardman, HL 2007, Vocabularies for description of accessibility issues in multimodal user interfaces. CWI report. INS-E, vol. 0702, Centrum voor Wiskunde en Informatica, Amsterdam.

Vocabularies for description of accessibility issues in multimodal user interfaces. / Obrenovic, Z.; Troncy, R.; Hardman, H.L.

Amsterdam : Centrum voor Wiskunde en Informatica, 2007. 12 p. (CWI report. INS-E; Vol. 0702).

Research output: Book/ReportReportAcademic

TY - BOOK

T1 - Vocabularies for description of accessibility issues in multimodal user interfaces

AU - Obrenovic, Z.

AU - Troncy, R.

AU - Hardman, H.L.

PY - 2007

Y1 - 2007

N2 - In previous work, we proposed a unified approach for describing multimodal human-computer interaction and interaction constraints in terms of sensual, motor, perceptual and cognitive functions of users. In this paper, we extend this work by providing formalised vocabularies that express human functionalities and anatomical structures required by specific modalities. The central theme of our approach is to connect these modality representations with descriptions of user, device and environmental constraints that influence the interaction. These descriptions can then be used in a reasoning framework that will exploit formal connections among interaction modalities and constraints. The focus of this paper is on specifying a comprehensive vocabulary of necessary concepts. Within the context of an interaction framework, we describe a number of examples that use this formalised knowledge.

AB - In previous work, we proposed a unified approach for describing multimodal human-computer interaction and interaction constraints in terms of sensual, motor, perceptual and cognitive functions of users. In this paper, we extend this work by providing formalised vocabularies that express human functionalities and anatomical structures required by specific modalities. The central theme of our approach is to connect these modality representations with descriptions of user, device and environmental constraints that influence the interaction. These descriptions can then be used in a reasoning framework that will exploit formal connections among interaction modalities and constraints. The focus of this paper is on specifying a comprehensive vocabulary of necessary concepts. Within the context of an interaction framework, we describe a number of examples that use this formalised knowledge.

M3 - Report

T3 - CWI report. INS-E

BT - Vocabularies for description of accessibility issues in multimodal user interfaces

PB - Centrum voor Wiskunde en Informatica

CY - Amsterdam

ER -

Obrenovic Z, Troncy R, Hardman HL. Vocabularies for description of accessibility issues in multimodal user interfaces. Amsterdam: Centrum voor Wiskunde en Informatica, 2007. 12 p. (CWI report. INS-E).