Online Aggregated-Event Representation for Multiple Event Detection in Videos

Event detection is used to locate the frames corresponding to events of interest in given videos. Real-world videos contain multiple events of interest, and they are rarely segmented. Existing online methods can only detect segments containing single event instances, and this is not suitable for processing videos with several event instances. There are multiple event detection methods, but they are all relatively inefficient and offline methods. To handle the online detection of several events, we propose a novel framework with three modules that are: the event proposal generation, aggregated-event representation, and refined detection modules. The first module can locate time intervals that are likely to contain target events, termed as proposals. The second module can aggregate all events before the current time to form a temporal context that will be used to generate initial detection results of multiple events. The refined detection module finally refines the results based on event proposals and object detection. The proposed method achieves a detection accuracy of 24.88% on a multi-event dataset - Charades, which is higher than state-of-the-art methods.