IndexMo: exploring finger-worn RFID motion tracking for activity recognition on tagged objects

Rong Hao Liang, Shun Yao Yang, Bing Yu Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

This work explores and evaluates the designs of finger-worn radio-frequency identification (RFID) motion tracking for activity recognition on tagged objects. We propose an index-finger-worn device that consists of a short-range (∼2cm) RFID reader and a pair of two inertial measurement units (IMUs), which are mounted at the locations where an artificial nail and a ring are worn. The short-range RFID reader recognizes the tagged object on finger touch, and then the IMU data are used for activity recognition. Data collected from the user of this device allows for a post-hoc analysis, which informs the activity recognition performance in various RFID+IMU and IMU-only configurations on the same task. The results of a ten-participant user study show that when the objects have similar physical form factors, the hybrid RFID motion tracking significantly outperforms the IMU-only tracking, especially in a larger-number set of objects. In our test, three IMU configurations (i.e., NailOnly, RingOnly, and Nail+Ring) achieved comparable action recognition performances, i.e., ≥90% accuracy, with 500 ms recognition time, though the NailOnly RFID+IMU configuration provided the highest wearability. The practical challenges toward a real-world deployment of a finger-worn RFID motion tracking system are also discussed.

Original languageEnglish
Title of host publicationISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers
Place of PublicationNew York
PublisherAssociation for Computing Machinery, Inc
Pages129-134
Number of pages6
ISBN (Electronic)978-1-4503-6870-4
DOIs
Publication statusPublished - 9 Sep 2019
Event23rd International Symposium on Wearable Computers, ISWC 2019 - London, United Kingdom
Duration: 9 Sep 201913 Sep 2019

Conference

Conference23rd International Symposium on Wearable Computers, ISWC 2019
CountryUnited Kingdom
CityLondon
Period9/09/1913/09/19

Fingerprint

Units of measurement
Radio frequency identification (RFID)
Nails

Keywords

  • Activity recognition
  • Finger-worn device
  • Motion tracking
  • Nail-mounted device
  • RFID

Cite this

Liang, R. H., Yang, S. Y., & Chen, B. Y. (2019). IndexMo: exploring finger-worn RFID motion tracking for activity recognition on tagged objects. In ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers (pp. 129-134). New York: Association for Computing Machinery, Inc. https://doi.org/10.1145/3341163.3347724
Liang, Rong Hao ; Yang, Shun Yao ; Chen, Bing Yu. / IndexMo : exploring finger-worn RFID motion tracking for activity recognition on tagged objects. ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. New York : Association for Computing Machinery, Inc, 2019. pp. 129-134
@inproceedings{b07b201e6dbe4d128770e498dde7c8cb,
title = "IndexMo: exploring finger-worn RFID motion tracking for activity recognition on tagged objects",
abstract = "This work explores and evaluates the designs of finger-worn radio-frequency identification (RFID) motion tracking for activity recognition on tagged objects. We propose an index-finger-worn device that consists of a short-range (∼2cm) RFID reader and a pair of two inertial measurement units (IMUs), which are mounted at the locations where an artificial nail and a ring are worn. The short-range RFID reader recognizes the tagged object on finger touch, and then the IMU data are used for activity recognition. Data collected from the user of this device allows for a post-hoc analysis, which informs the activity recognition performance in various RFID+IMU and IMU-only configurations on the same task. The results of a ten-participant user study show that when the objects have similar physical form factors, the hybrid RFID motion tracking significantly outperforms the IMU-only tracking, especially in a larger-number set of objects. In our test, three IMU configurations (i.e., NailOnly, RingOnly, and Nail+Ring) achieved comparable action recognition performances, i.e., ≥90{\%} accuracy, with 500 ms recognition time, though the NailOnly RFID+IMU configuration provided the highest wearability. The practical challenges toward a real-world deployment of a finger-worn RFID motion tracking system are also discussed.",
keywords = "Activity recognition, Finger-worn device, Motion tracking, Nail-mounted device, RFID",
author = "Liang, {Rong Hao} and Yang, {Shun Yao} and Chen, {Bing Yu}",
year = "2019",
month = "9",
day = "9",
doi = "10.1145/3341163.3347724",
language = "English",
pages = "129--134",
booktitle = "ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers",
publisher = "Association for Computing Machinery, Inc",
address = "United States",

}

Liang, RH, Yang, SY & Chen, BY 2019, IndexMo: exploring finger-worn RFID motion tracking for activity recognition on tagged objects. in ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, New York, pp. 129-134, 23rd International Symposium on Wearable Computers, ISWC 2019, London, United Kingdom, 9/09/19. https://doi.org/10.1145/3341163.3347724

IndexMo : exploring finger-worn RFID motion tracking for activity recognition on tagged objects. / Liang, Rong Hao; Yang, Shun Yao; Chen, Bing Yu.

ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. New York : Association for Computing Machinery, Inc, 2019. p. 129-134.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - IndexMo

T2 - exploring finger-worn RFID motion tracking for activity recognition on tagged objects

AU - Liang, Rong Hao

AU - Yang, Shun Yao

AU - Chen, Bing Yu

PY - 2019/9/9

Y1 - 2019/9/9

N2 - This work explores and evaluates the designs of finger-worn radio-frequency identification (RFID) motion tracking for activity recognition on tagged objects. We propose an index-finger-worn device that consists of a short-range (∼2cm) RFID reader and a pair of two inertial measurement units (IMUs), which are mounted at the locations where an artificial nail and a ring are worn. The short-range RFID reader recognizes the tagged object on finger touch, and then the IMU data are used for activity recognition. Data collected from the user of this device allows for a post-hoc analysis, which informs the activity recognition performance in various RFID+IMU and IMU-only configurations on the same task. The results of a ten-participant user study show that when the objects have similar physical form factors, the hybrid RFID motion tracking significantly outperforms the IMU-only tracking, especially in a larger-number set of objects. In our test, three IMU configurations (i.e., NailOnly, RingOnly, and Nail+Ring) achieved comparable action recognition performances, i.e., ≥90% accuracy, with 500 ms recognition time, though the NailOnly RFID+IMU configuration provided the highest wearability. The practical challenges toward a real-world deployment of a finger-worn RFID motion tracking system are also discussed.

AB - This work explores and evaluates the designs of finger-worn radio-frequency identification (RFID) motion tracking for activity recognition on tagged objects. We propose an index-finger-worn device that consists of a short-range (∼2cm) RFID reader and a pair of two inertial measurement units (IMUs), which are mounted at the locations where an artificial nail and a ring are worn. The short-range RFID reader recognizes the tagged object on finger touch, and then the IMU data are used for activity recognition. Data collected from the user of this device allows for a post-hoc analysis, which informs the activity recognition performance in various RFID+IMU and IMU-only configurations on the same task. The results of a ten-participant user study show that when the objects have similar physical form factors, the hybrid RFID motion tracking significantly outperforms the IMU-only tracking, especially in a larger-number set of objects. In our test, three IMU configurations (i.e., NailOnly, RingOnly, and Nail+Ring) achieved comparable action recognition performances, i.e., ≥90% accuracy, with 500 ms recognition time, though the NailOnly RFID+IMU configuration provided the highest wearability. The practical challenges toward a real-world deployment of a finger-worn RFID motion tracking system are also discussed.

KW - Activity recognition

KW - Finger-worn device

KW - Motion tracking

KW - Nail-mounted device

KW - RFID

UR - http://www.scopus.com/inward/record.url?scp=85072803278&partnerID=8YFLogxK

U2 - 10.1145/3341163.3347724

DO - 10.1145/3341163.3347724

M3 - Conference contribution

AN - SCOPUS:85072803278

SP - 129

EP - 134

BT - ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers

PB - Association for Computing Machinery, Inc

CY - New York

ER -

Liang RH, Yang SY, Chen BY. IndexMo: exploring finger-worn RFID motion tracking for activity recognition on tagged objects. In ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. New York: Association for Computing Machinery, Inc. 2019. p. 129-134 https://doi.org/10.1145/3341163.3347724