Load adaptive decoder control method for simultaneous video playback

Video access by utilizing a plurality of video thumbnails is useful as an intuitive user interface with which users can survey many of video contents at once. However, real-time generation of the video thumbnails corresponding to a lot of video contents incurs high processing costs. In this research, we propose a new method for decoding of multiple video streams that can deal with a temporary increase of processing load due to load unevenness among frame types. A pair of control schemes, i.e. stream input control and decoding resource control, are proposed for implementing a load adaptive decoder controller. The experimental result shows that our method can suppress the frame drop rate in multi stream decoding process as the number of streams increases.