Ontology and rule based retrieval of sound objects in augmented audio reality system for museum visitors

ec(h)o is an "augmented reality interface" utilizing spatialized soundscapes and a semantic web approach to information. The initial prototype is designed for a natural history and science museum. The platform is designed to create a museum experience that consists of a physical installation and an interactive virtual layer of three-dimensional soundscapes that are physically mapped to the museum displays. The source for the audio data is digital sound objects. The digital objects originate in a network of object repositories that connect digital content from one museum with other museums collections. The interface enables people to interact with the system by movement and object manipulation-based gestures without the direct use of a computer device. The focus of this paper is the retrieval mechanism for the sound objects for the museum visitor. The retrieval mechanism is built on the user model and conceptual descriptions of the sound object and museum artifacts in the form of ontologies for sound and psychoacoustics, topic ontology and Conceptual Reference Model for museum information. The retrieval criteria are represented as inference rules that represent knowledge from psychoacoustics, cognitive domain and composition aspects of interaction. The system will be demonstrated in exhibition space in Nature Museum in Ottawa in January 2003.