HiRN: Hierarchical recurrent neural network for video super-resolution (VSR) using two-stage feature evolution
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Choi, Young-Ju | - |
dc.contributor.author | Kim, Byung-Gyu | - |
dc.date.accessioned | 2023-11-08T05:47:37Z | - |
dc.date.available | 2023-11-08T05:47:37Z | - |
dc.date.issued | 2023-08 | - |
dc.identifier.issn | 1568-4946 | - |
dc.identifier.issn | 1872-9681 | - |
dc.identifier.uri | https://scholarworks.sookmyung.ac.kr/handle/2020.sw.sookmyung/151690 | - |
dc.description.abstract | The aim of video super-resolution (VSR) is generate the high-resolution (HR) frames from their low-resolution (LR) counterparts. As one of the fundamental module of VSR, propagation process provides the path of feature map and specifies how the feature map is leveraged. In the recurrent propagation, the latent features can be propagated and aggregated. Therefore, adopting the recurrent strategy can resolve the limitation of sliding-window-based local propagation. Recently, bi-directional recurrent propagation-based latest methods have achieved powerful performance in VSR. However, existing bi-directional frameworks have structured by combining forward and backward branches. These structures cannot propagate and aggregate previous and future latent features of current branch. In this study, we suggest the hierarchical recurrent neural network (HiRN) based on feature evolution. The proposed HiRN is designed based on the hierarchical recurrent propagation and residual block-based backbone with temporal wavelet attention (TWA) module. The hierarchical recurrent propagation consists of two stages to combine advantages of low frame rate-based forward and backward schemes, and multi-frame rate-based bi-directional access structure. The proposed methods are compared with state-of-the-art (SOTA) methods on the benchmark datasets. Experiments show that the proposed scheme achieves superior performance compared with SOTA methods. In particular, the proposed HiRN achieves better performance than all compared methods in terms of SSIM on Vid4 benchmark. In addition, the proposed HiRN surpasses the existing GBR-WNN by a significant 3.03 dB in PSNR on REDS4 benchmark with fewer parameters. © 2023 Elsevier B.V. | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Elsevier Ltd | - |
dc.title | HiRN: Hierarchical recurrent neural network for video super-resolution (VSR) using two-stage feature evolution | - |
dc.type | Article | - |
dc.publisher.location | 네델란드 | - |
dc.identifier.doi | 10.1016/j.asoc.2023.110422 | - |
dc.identifier.scopusid | 2-s2.0-85160548673 | - |
dc.identifier.wosid | 001018343300001 | - |
dc.identifier.bibliographicCitation | Applied Soft Computing, v.143 | - |
dc.citation.title | Applied Soft Computing | - |
dc.citation.volume | 143 | - |
dc.type.docType | Article | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Interdisciplinary Applications | - |
dc.subject.keywordPlus | SUPER RESOLUTION | - |
dc.subject.keywordPlus | IMAGE | - |
dc.subject.keywordPlus | ACCURATE | - |
dc.subject.keywordAuthor | Attention mechanism | - |
dc.subject.keywordAuthor | Bi-directional propagation | - |
dc.subject.keywordAuthor | Recurrent neural network | - |
dc.subject.keywordAuthor | Video super-resolution | - |
dc.identifier.url | https://www.sciencedirect.com/science/article/pii/S1568494623004404?via%3Dihub | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
Sookmyung Women's University. Cheongpa-ro 47-gil 100 (Cheongpa-dong 2ga), Yongsan-gu, Seoul, 04310, Korea02-710-9127
Copyright©Sookmyung Women's University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.