S&M2125 Research Paper of Special Issue
Published: February 20, 2020
Automatic Route Video Summarization based on Image Analysis for Intuitive Touristic Experience [PDF]
Yuki Kanaya, Shogo Kawanaka, Hirohiko Suwa, Yutaka Arakawa, and Keiichi Yasumoto
(Received September 11, 2019; Accepted January 20, 2020)
Keywords: automatic route video summarization, image analysis, intuitive touristic experience, decision support, tourist information application
Currently, many tourists search for and watch tourism videos on the Internet when planning a sightseeing tour. In order to quickly plan a sightseeing route, a shorter playback time of tourism videos is desirable. For this purpose, time-lapse playback would be effective. However, the faster the playback is, the lower the degree of comprehension of the viewers will be. In this paper, we propose a novel time-lapse-based video summarization method without the substantial loss of information important for viewers to plan a tour route. In the proposed method, we focus on scene changes in the video. We extract scenes with a certain level of change compared with previous scenes as important (slowly played back) in the summarized video, while other scenes are fast-forwarded. We investigated the appropriate playback speed of sightseeing videos. As a result of a questionnaire, we found that a playback speed between ×4 and ×8 was the most effective for viewers to understand the sightseeing information for tour route planning. In addition, to evaluate the effectiveness of our proposed method, we conducted experiments with 20 participants using a sightseeing video taken in Kyoto. Comparing the video summarized with our method and that summarized manually (by voting for necessary/ unnecessary scenes), our method identified the important scenes with an F-measure of 62.22%.Corresponding author: Hirohiko Suwa
This work is licensed under a Creative Commons Attribution 4.0 International License.
Cite this article
Yuki Kanaya, Shogo Kawanaka, Hirohiko Suwa, Yutaka Arakawa, and Keiichi Yasumoto, Automatic Route Video Summarization based on Image Analysis for Intuitive Touristic Experience, Sens. Mater., Vol. 32, No. 2, 2020, p. 599-610.