동영상 대사 자막을 발화자 주변에 자동 배치하는 시스템의 개발Development of Automatic Video-Subtitle Placement System Near the Speaker
- Other Titles
- Development of Automatic Video-Subtitle Placement System Near the Speaker
- Authors
- 김효진; 박수현; 임순범
- Issue Date
- Jun-2023
- Publisher
- 한국멀티미디어학회
- Keywords
- Subtitle; Video; Automatic; Speaker Detection; Multiple Speaker
- Citation
- 멀티미디어학회논문지, v.26, no.6, pp 732 - 741
- Pages
- 10
- Journal Title
- 멀티미디어학회논문지
- Volume
- 26
- Number
- 6
- Start Page
- 732
- End Page
- 741
- URI
- https://scholarworks.sookmyung.ac.kr/handle/2020.sw.sookmyung/151785
- DOI
- 10.9717/kmms.2023.26.6.732
- ISSN
- 1229-7771
- Abstract
- Conventional unedited subtitles of the video are placed in a fixed location of screen, which may cause distraction and visual fatigue to viewers. According to previous studies, it has been proven that the subtitling system placing the subtitle near the speaker may improve viewer’s convenience and quality of visual understanding. We developed an automatic video-subtitle placement system which automatically detected the speaker on the screen and placed the active subtitles near the speaker without disturbing the main figures. Pre-existing speech-to-text, active speaker detection and face detection technology were used to extract the text from the speaker on the screen, and we developed a new algorithm to select the optimal space around the speaker to put the caption of the lines on the video screen. The developed program was tested for the accurate speaker detection and placement of subtitles using several types of video genre. The performance of program was satisfactory showing overall 98.25% of accurate subtitle placement rate. Our algorithm for the automatic subtitle placement system may be used to supplement the shortcomings of conventional subtitle system.
- Files in This Item
-
Go to Link
- Appears in
Collections - ETC > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.