Zhou, C;
Lu, Z;
Li, L;
Yan, Q;
Xue, J-H;
(2021)
How Video Super-Resolution and Frame Interpolation Mutually Benefit.
In:
MM '21: Proceedings of the 29th ACM International Conference on Multimedia.
(pp. pp. 5445-5453).
ACM
Preview |
Text
ChengchengZhou-ACMMM2021-final.pdf - Accepted Version Download (1MB) | Preview |
Abstract
Video super-resolution (VSR) and video frame interpolation (VFI) are inter-dependent for enhancing videos of low resolution and low frame rate. However, most studies treat VSR and temporal VFI as independent tasks. In this work, we design a spatial-temporal super-resolution network based on exploring the interaction between VSR and VFI. The main idea is to improve the middle frame of VFI by the super-resolution (SR) frames and feature maps from VSR. In the meantime, VFI also provides extra information for VSR and thus, through interacting, the SR of consecutive frames of the original video can also be improved by the feedback from the generated middle frame. Drawing on this, our approach leverages a simple interaction of VSR and VFI and achieves state-of-the-art performance on various datasets. Due to such a simple strategy, our approach is universally applicable to any existing VSR or VFI networks for effectively improving their video enhancement performance.
| Type: | Proceedings paper |
|---|---|
| Title: | How Video Super-Resolution and Frame Interpolation Mutually Benefit |
| Event: | MM '21: ACM Multimedia Conference |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3474085.3475672 |
| Publisher version: | https://doi.org/10.1145/3474085.3475672 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10136963 |
Archive Staff Only
 |
View Item |
