Benchmarking Search and Annotation in Continuous Human Skeleton Sequences

Investor logo

Warning

This publication doesn't include Faculty of Economics and Administration. It includes Faculty of Informatics. Official publication website can be found on muni.cz.
Authors

SEDMIDUBSKÝ Jan ELIÁŠ Petr ZEZULA Pavel

Year of publication 2019
Type Article in Proceedings
Conference International Conference on Multimedia Retrieval (ICMR)
MU Faculty or unit

Faculty of Informatics

Citation
Doi http://dx.doi.org/10.1145/3323873.3325013
Keywords motion capture dataset;continuous 3D skeleton sequence;stream-based processing;benchmark;subsequence search;action detection;mining
Description Motion capture data are digital representations of human movements in form of 3D trajectories of multiple body joints. To understand the captured motions, similarity-based processing and deep learning have already proved to be effective, especially in classifying pre-segmented actions. However, in real-world scenarios motion data are typically captured as long continuous sequences, without explicit knowledge of semantic partitioning. To make such unsegmented data accessible and reusable as required by many applications, there is a strong requirement to analyze, search, annotate and mine them automatically. However, there is currently an absence of datasets and benchmarks to test and compare the capabilities of the developed techniques for continuous motion data processing. In this paper, we introduce a new large-scale LSMB19 dataset consisting of two 3D skeleton sequences of a total length of 54.5 hours. We also define a benchmark on two important multimedia retrieval operations: subsequence search and annotation. Additionally, we exemplify the usability of the benchmark by establishing baseline results for these operations.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.