The Library
Learning temporal information from spatial information using capsnets for human action recognition
Tools
Tools
Tools
Algamdi, Abdullah M., Sanchez Silva, Victor and Li, Chang-Tsun (2019) Learning temporal information from spatial information using capsnets for human action recognition. In: International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, 12-17 May 2019 (In Press)
|
PDF
WRAP-learning-temporal-information-spatial-information-capsnets-human-action-recognition-Algamdi-2019.pdf - Accepted Version - Requires a PDF viewer. Download (782Kb) | Preview |
Abstract
Capsule Networks (CapsNets) are recently introduced to overcome some of the shortcomings of traditional Convolutional Neural Networks (CNNs). CapsNets replace neurons in CNNs with vectors to retain spatial relationships among the features. In this paper, we propose a CapsNet architecture that employs individual video frames for human action recognition without explicitly extracting motion information. We also propose weight pooling to reduce the computational complexity and improve the classification accuracy by appropriately removing some of the extracted features. We show how the capsules of the proposed architecture can encode temporal information by using the spatial features extracted from several video frames. Compared with a traditional CNN of the same complexity, the proposed CapsNet improves action recognition performance by 12.11% and 22.29% on the KTH and UCF-sports datasets, respectively.
| Item Type: | Conference Item (Poster) | ||||||
|---|---|---|---|---|---|---|---|
| Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | ||||||
| Divisions: | Faculty of Science > Computer Science | ||||||
| Library of Congress Subject Headings (LCSH): | Computer science, Digital images | ||||||
| Publisher: | IEEE | ||||||
| Official Date: | 1 February 2019 | ||||||
| Dates: |
|
||||||
| Date of first compliant deposit: | 27 February 2019 | ||||||
| Status: | Peer Reviewed | ||||||
| Publication Status: | In Press | ||||||
| Publisher Statement: | © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. | ||||||
| Access rights to Published version: | Restricted or Subscription Access | ||||||
| Conference Paper Type: | Poster | ||||||
| Title of Event: | International Conference on Acoustics, Speech and Signal Processing (ICASSP) | ||||||
| Type of Event: | Conference | ||||||
| Location of Event: | Brighton | ||||||
| Date(s) of Event: | 12-17 May 2019 | ||||||
| Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
