Multi-scale contrast and relative motion-based key frame extraction

Citations

WEB OF SCIENCE

16
Citations

SCOPUS

22

초록

The huge amount of video data available these days requires effective management techniques for storage, indexing, and retrieval. Video summarization, a method to manage video data, provides concise versions of the videos for efficient browsing and retrieval. Key frame extraction is a form of video summarization which selects only the most salient frames from a given video. Since the automatic semantic understanding of the video contents is not possible so far, most of the existing works employ low level index features for extracting key frames. However, the usage of low level features results in loss of semantic details, thus leading to a semantic gap. In this context, the saliency-based user attention modeling technique can be used to bridge this semantic gap. In this paper, a key frame extraction scheme based on a visual attention mechanism is proposed. The proposed scheme builds static visual attention method based on multi-scale contrast instead of usual color contrast. The dynamic visual attention model is developed based on novel relative motion intensity and relative motion orientation. An efficient fusion scheme for combining three visual attention values is then proposed. A flexible technique is then used for key frame extraction. The experimental results demonstrate that the proposed mechanism provides excellent results as compared to the some of the other prominent techniques in the literature.

키워드

Key frame extraction; Video summarization; Visual saliency; Visual attention model; Fusion mechanism; Video summary evaluation; ATTENTION MODEL; VIDEO; SELECTION
제목
Multi-scale contrast and relative motion-based key frame extraction
저자
Ejaz, Naveed; Baik, Sung Wook; Majeed, Hammad; Chang, Hangbae; Mehmood, Irfan
DOI
10.1186/s13640-018-0280-z
발행일
2018-06
유형
Article
저널명
Eurasip Journal on Image and Video Processing
권
2018
호
1

파일 다운로드

Thumbnail