Hand pose recognition in First Person Vision through graph spectral analysis

Mohamad Baydoun; Alejandro Betancourt; Pietro Morerio; Lucio Marcenaro; Matthias Rauterberg; Carlo Regazzoni

doi:10.1109/ICASSP.2017.7952481

Hand pose recognition in First Person Vision through graph spectral analysis

Mohamad Baydoun, Alejandro Betancourt, Pietro Morerio, Lucio Marcenaro, Matthias Rauterberg, Carlo Regazzoni

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

5 Citations (Scopus)

1 Downloads (Pure)

Abstract

With the growing availability of wearable technology, video recording devices have become so intimately tied to individuals, that they are able to record the movements of users' hands, making hand-based applications one the most explored area in First Person Vision (FPV). In particular, hand pose recognition plays a fundamental role in tasks such as gesture and activity recognition, which in turn represent the base for developing human-machine interfaces or augmented reality applications. In this work we propose a graph-based representation of hands seen from the point of view of the user, obtained through the shape-fitting capability of a modified Instantaneous Topological Map. Spectral analysis of the graph Laplacian allows to arrange eigenvalues in vectors of features, which prove to be discriminative in classifying the considered hand poses.

Original language	English
Title of host publication	ICASSP 2017, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Place of Publication	Piscataway
Publisher	Institute of Electrical and Electronics Engineers
Pages	1872-1876
Number of pages	5
ISBN (Electronic)	978-1-5090-4117-6
ISBN (Print)	978-1-5090-4118-3
DOIs	https://doi.org/10.1109/ICASSP.2017.7952481
Publication status	Published - 16 Jun 2017
Event	2017 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2017) - New Orleans, United States Duration: 5 Mar 2017 → 9 Mar 2017 Conference number: 42 http://www.ieee-icassp2017.org/

Conference

Conference	2017 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2017)
Abbreviated title	ICASSP 2017
Country/Territory	United States
City	New Orleans
Period	5/03/17 → 9/03/17
Internet address	http://www.ieee-icassp2017.org/

Keywords

Egocentric Vision
First Person Vision
Graphs
Hand Pose
Spectral Analysis

Access to Document

10.1109/ICASSP.2017.7952481

Cite this

Baydoun, M., Betancourt, A., Morerio, P., Marcenaro, L., Rauterberg, M., & Regazzoni, C. (2017). Hand pose recognition in First Person Vision through graph spectral analysis. In ICASSP 2017, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (pp. 1872-1876). Article 7952481 Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICASSP.2017.7952481

@inproceedings{b8dd7b531ad949f69581d561d9f49a8a,

title = "Hand pose recognition in First Person Vision through graph spectral analysis",

abstract = "With the growing availability of wearable technology, video recording devices have become so intimately tied to individuals, that they are able to record the movements of users' hands, making hand-based applications one the most explored area in First Person Vision (FPV). In particular, hand pose recognition plays a fundamental role in tasks such as gesture and activity recognition, which in turn represent the base for developing human-machine interfaces or augmented reality applications. In this work we propose a graph-based representation of hands seen from the point of view of the user, obtained through the shape-fitting capability of a modified Instantaneous Topological Map. Spectral analysis of the graph Laplacian allows to arrange eigenvalues in vectors of features, which prove to be discriminative in classifying the considered hand poses.",

keywords = "Egocentric Vision, First Person Vision, Graphs, Hand Pose, Spectral Analysis",

author = "Mohamad Baydoun and Alejandro Betancourt and Pietro Morerio and Lucio Marcenaro and Matthias Rauterberg and Carlo Regazzoni",

year = "2017",

month = jun,

day = "16",

doi = "10.1109/ICASSP.2017.7952481",

language = "English",

isbn = "978-1-5090-4118-3 ",

pages = "1872--1876",

booktitle = "ICASSP 2017, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers",

address = "United States",

note = "2017 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2017), ICASSP 2017 ; Conference date: 05-03-2017 Through 09-03-2017",

url = "http://www.ieee-icassp2017.org/",

}

Baydoun, M, Betancourt, A, Morerio, P, Marcenaro, L, Rauterberg, M & Regazzoni, C 2017, Hand pose recognition in First Person Vision through graph spectral analysis. in ICASSP 2017, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings ., 7952481, Institute of Electrical and Electronics Engineers, Piscataway, pp. 1872-1876, 2017 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2017), New Orleans, Louisiana, United States, 5/03/17. https://doi.org/10.1109/ICASSP.2017.7952481

Hand pose recognition in First Person Vision through graph spectral analysis. / Baydoun, Mohamad; Betancourt, Alejandro; Morerio, Pietro et al.
ICASSP 2017, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings . Piscataway: Institute of Electrical and Electronics Engineers, 2017. p. 1872-1876 7952481.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Hand pose recognition in First Person Vision through graph spectral analysis

AU - Baydoun, Mohamad

AU - Betancourt, Alejandro

AU - Morerio, Pietro

AU - Marcenaro, Lucio

AU - Rauterberg, Matthias

AU - Regazzoni, Carlo

N1 - Conference code: 42

PY - 2017/6/16

Y1 - 2017/6/16

N2 - With the growing availability of wearable technology, video recording devices have become so intimately tied to individuals, that they are able to record the movements of users' hands, making hand-based applications one the most explored area in First Person Vision (FPV). In particular, hand pose recognition plays a fundamental role in tasks such as gesture and activity recognition, which in turn represent the base for developing human-machine interfaces or augmented reality applications. In this work we propose a graph-based representation of hands seen from the point of view of the user, obtained through the shape-fitting capability of a modified Instantaneous Topological Map. Spectral analysis of the graph Laplacian allows to arrange eigenvalues in vectors of features, which prove to be discriminative in classifying the considered hand poses.

AB - With the growing availability of wearable technology, video recording devices have become so intimately tied to individuals, that they are able to record the movements of users' hands, making hand-based applications one the most explored area in First Person Vision (FPV). In particular, hand pose recognition plays a fundamental role in tasks such as gesture and activity recognition, which in turn represent the base for developing human-machine interfaces or augmented reality applications. In this work we propose a graph-based representation of hands seen from the point of view of the user, obtained through the shape-fitting capability of a modified Instantaneous Topological Map. Spectral analysis of the graph Laplacian allows to arrange eigenvalues in vectors of features, which prove to be discriminative in classifying the considered hand poses.

KW - Egocentric Vision

KW - First Person Vision

KW - Graphs

KW - Hand Pose

KW - Spectral Analysis

UR - http://www.scopus.com/inward/record.url?scp=85023745965&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2017.7952481

DO - 10.1109/ICASSP.2017.7952481

M3 - Conference contribution

SN - 978-1-5090-4118-3

SP - 1872

EP - 1876

BT - ICASSP 2017, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

PB - Institute of Electrical and Electronics Engineers

CY - Piscataway

T2 - 2017 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2017)

Y2 - 5 March 2017 through 9 March 2017

ER -

Baydoun M, Betancourt A, Morerio P, Marcenaro L, Rauterberg M, Regazzoni C. Hand pose recognition in First Person Vision through graph spectral analysis. In ICASSP 2017, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings . Piscataway: Institute of Electrical and Electronics Engineers. 2017. p. 1872-1876. 7952481 doi: 10.1109/ICASSP.2017.7952481

Hand pose recognition in First Person Vision through graph spectral analysis

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this