The Library
Video memorability prediction via late fusion of deep multi-modal features
Tools
Leyva, Roberto and Sanchez Silva, Victor (2021) Video memorability prediction via late fusion of deep multi-modal features. In: 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA, 19-22 Sep 2021. Published in: 2021 IEEE International Conference on Image Processing (ICIP) ISBN 9781665431026. doi:10.1109/icip42928.2021.9506411 ISSN 2381-8549.
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: https://doi.org/10.1109/icip42928.2021.9506411
Abstract
Video memorability is a cornerstone in social media platform analysis, as a highly memorable video is more likely to be noticed and shared. This paper proposes a new framework to fuse multi-modal information to predict the likelihood of remembering a video. The proposed framework relies on late fusion of text, visual and motion features. Specifically, two neural networks extract features from the captions describing the video’ s content; two ResNet models extract visual features from specific frames, and two 3DResNet models, combined with Fisher Vectors, extract features from the video’ s motion information. The extracted features are used to compute several memorability scores via Bayesian Ridge regression, which are then fused based on a greedy search of the optimal fusion parameters. Experiments demonstrate the superiority of the proposed framework on the MediaEval2019 dataset, outperforming the state-of-the-art.
Item Type: | Conference Item (Paper) | ||||||
---|---|---|---|---|---|---|---|
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||||
SWORD Depositor: | Library Publications Router | ||||||
Journal or Publication Title: | 2021 IEEE International Conference on Image Processing (ICIP) | ||||||
Publisher: | IEEE | ||||||
ISBN: | 9781665431026 | ||||||
ISSN: | 2381-8549 | ||||||
Official Date: | 23 August 2021 | ||||||
Dates: |
|
||||||
DOI: | 10.1109/icip42928.2021.9506411 | ||||||
Status: | Peer Reviewed | ||||||
Publication Status: | Published | ||||||
Access rights to Published version: | Restricted or Subscription Access | ||||||
Conference Paper Type: | Paper | ||||||
Title of Event: | 2021 IEEE International Conference on Image Processing (ICIP) | ||||||
Type of Event: | Conference | ||||||
Location of Event: | Anchorage, AK, USA | ||||||
Date(s) of Event: | 19-22 Sep 2021 |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |