Unsupervised Universal Attribute Modelling for Action Recognition

Roy, Debaditya and Kodukula, Sri Rama Murty and C, Krishna Mohan (2018) Unsupervised Universal Attribute Modelling for Action Recognition. IEEE Transactions on Multimedia. p. 1. ISSN 1520-9210

Full text not available from this repository. (Request a copy)


A fixed dimensional representation for action clips of varying lengths has been proposed in the literature using aggregation models like bag-of-words and Fisher vector. These representations are high-dimensional and require classification techniques for action recognition. In this paper, we propose a framework for unsupervised extraction of a discriminative low-dimensional representation called action-vector. To start with, local spatio-temporal features are utilized to capture the action attributes implicitly in a large Gaussian mixture model called universal attribute model (UAM). To enhance the contribution of the significant attributes in each action clip, a maximum \textit{aposteriori} adaptation of the UAM means is performed for each clip. This results in a concatenated mean vector called super action vector (SAV) for each action clip. However, the SAV is still high-dimensional because of the presence of redundant attributes. Hence, we employ factor analysis to represent every SAV only in terms of the few important attributes contributing to the action clip. This leads to a low-dimensional representation called action-vector. This entire procedure requires no class labels and produces action-vectors that are distinct representations of each action irrespective of inter-actor variability encountered in unconstrained videos. An evaluation on trimmed action datasets UCF101 and HMDB51 demonstrates the efficacy of action-vectors for action classification over state-of-the-art techniques. Moreover, we also show that action-vectors can adequately represent untrimmed videos from the THUMOS14 dataset and produce classification results comparable to existing techniques.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Kodukula, Sri Rama Murtyhttps://orcid.org/0000-0002-6355-5287
Item Type: Article
Subjects: Computer science
Divisions: Department of Computer Science & Engineering
Depositing User: Team Library
Date Deposited: 03 Jan 2019 07:04
Last Modified: 03 Jan 2019 07:04
URI: http://raiith.iith.ac.in/id/eprint/4649
Publisher URL: http://doi.org/10.1109/TMM.2018.2887021
OA policy: http://www.sherpa.ac.uk/romeo/issn/1520-9210/
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 4649 Statistics for this ePrint Item