Summarization of videos by analyzing affective state of the user through crowdsource
  • Singhal, Ashish
  • Kumar, Pradeep
  • Saini, Rajkumar
  • Roy, Partha Pratim
  • Dogra, Debi Prosad
  • ... Kim, Byung-Gyu
Citations

WEB OF SCIENCE

18
Citations

SCOPUS

22

초록

Video summarization is one of the key techniques to access and manage a huge chunk of videos. Video summarization is used to extract the effective contents of a video sequence to generate a concise representation of its content. The involvement of crowdsourcing models in recent years is effectively used by researchers in E-commerce domain to increase the quality of the data contents. In this paper, we present a video summarization framework based on users emotion while they watch videos by analyzing cerebral activities through Electroencephalogram (EEG) signals. Three emotions, namely happy, sad and neutral have been extracted from the EEG signals. Video frames have been synchronized with EEG signals and tagged with various emotions. Finally, a crowdsourcing model has been used for effective summarization of the videos. The qualitative assessment of video summarization has been conducted with the help of user ratings using online Google Forms application. EEG signals of 28 users have been recorded while video streams of different emotions. An average accuracy of 83.93% has been recorded in emotion classification using crowdsourcing. Output summarized videos include dynamic video skims and the corresponding audio stream for better understanding. (C) 2018 Elsevier B.V. All rights reserved.

키워드

Video summarizationElectroencephalogram (EEG)CrowdsourcingRandom ForestMULTIMODAL EMOTION RECOGNITIONIDENTIFICATIONEXTRACTIONFRAMEWORKEEG
제목
Summarization of videos by analyzing affective state of the user through crowdsource
저자
Singhal, AshishKumar, PradeepSaini, RajkumarRoy, Partha PratimDogra, Debi ProsadKim, Byung-Gyu
DOI
10.1016/j.cogsys.2018.09.019
발행일
2018-12
유형
Article
저널명
Cognitive Systems Research
52
페이지
917 ~ 930