DHP19: Dynamic Vision Sensor 3D Human Pose Dataset

Enrico Calabrese, Gemma Taverni, Christopher Awai Easthope, Sophie Skriabine, Federico Corradi, Luca Longinotti, Kynan Eng, Tobi Delbruck

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

43 Citations (Scopus)

Abstract

Human pose estimation has dramatically improved thanks to the continuous developments in deep learning. However, marker-free human pose estimation based on standard frame-based cameras is still slow and power hungry for real-time feedback interaction because of the huge number of operations necessary for large Convolutional Neural Network (CNN) inference. Event-based cameras such as the Dynamic Vision Sensor (DVS) quickly output sparse moving-edge information. Their sparse and rapid output is ideal for driving low-latency CNNs, thus potentially allowing real-time interaction for human pose estimators. Although the application of CNNs to standard frame-based cameras for human pose estimation is well established, their application to event-based cameras is still under study. This paper proposes a novel benchmark dataset of human body movements, the Dynamic Vision Sensor Human Pose dataset (DHP19). It consists of recordings from 4 synchronized 346x260 pixel DVS cameras, for a set of 33 movements with 17 subjects. DHP19 also includes a 3D pose estimation model that achieves an average 3D pose estimation error of about 8 cm, despite the sparse and reduced input data from the DVS.
Original languageEnglish
Title of host publicationProceedings - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2019
PublisherInstitute of Electrical and Electronics Engineers
Pages1695-1704
Number of pages10
ISBN (Electronic)978-1-7281-2506-0
ISBN (Print)978-1-7281-2507-7
DOIs
Publication statusPublished - 9 Apr 2020
Externally publishedYes
Event2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2019 - Long Beach, United States
Duration: 16 Jun 201917 Jun 2019

Conference

Conference2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2019
Country/TerritoryUnited States
CityLong Beach
Period16/06/1917/06/19

Keywords

  • Cameras
  • Three-dimensional displays
  • Voltage control
  • Pose estimation
  • Two dimensional displays
  • Vision sensors
  • Solid modeling

Fingerprint

Dive into the research topics of 'DHP19: Dynamic Vision Sensor 3D Human Pose Dataset'. Together they form a unique fingerprint.

Cite this