Applying semantic reasoning in image retrieval

M. de Boer, L. Daniele, P. Brandt, M. Sappelli

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

21 Citations (Scopus)

Abstract

With the growth of open sensor networks, multiple applications in different domains make use of a large amount of sensor data, resulting in an emerging need to search semantically over heterogeneous datasets. In semantic search, an important challenge consists of bridging the semantic gap between the high-level natural language query posed by the user s and the low-level sensor data. In this paper, we show that state-of-the-art techniques in Semantic Modelling, Computer Vision and Human Media Interaction can be combined to apply semantic reasoning in the field of image retrieval. We propose a system, GOOSE, which is a general-purpose search engine that allows users to pose natural language queries to retrieve corresponding images. User queries are interpreted using the Stanford Parser, semantic rules and the Linked Open Data source ConceptNet. Interpreted queries are presented to the user as an intuitive and insightful graph in order to collect feedback that is used for further reasoning and system learning. A smart results ranking and retrieval algorithm allows for fast and effective retrieval of images.
Original languageEnglish
Title of host publicationALLDATA 2015 : The First International Conference on Big Data, Small Data, Linked Data and Open Data
Pages69-74
Number of pages6
Publication statusPublished - 2015
EventALLDATA 2015 : The First International Conference on Big Data, Small Data, Linked Data and Open Data - Barcelona, Spain
Duration: 19 Apr 201524 Apr 2015

Conference

ConferenceALLDATA 2015 : The First International Conference on Big Data, Small Data, Linked Data and Open Data
CountrySpain
CityBarcelona
Period19/04/1524/04/15

Keywords

  • semantics
  • natural language queries
  • semantic reasoning
  • image retrieval
  • ranking

Fingerprint Dive into the research topics of 'Applying semantic reasoning in image retrieval'. Together they form a unique fingerprint.

Cite this