Journal Paper

To offer more powerful video-enabled applications, it is increasingly more critical not only to visualize the decoded video but also to provide efficient searching capabilities for similar content. Video surveillance and personal communication are critical application examples asking for these dual visualization and searching functionalities. However, the current video coding solutions are strongly biased towards visualization needs. In this context, this paper introduces a novel dual-purpose video coding
framework targeting both visualization and searching needs by adopting a hybrid coding approach where
the usual pixel-based coding approach is combined with an innovative feature-based coding approach. In a
particular implementation of this dual-purpose video coding framework, some frames are coded using a
set of keypoint matches, which not only allow decoding for visualization, but also provide the decoder
valuable feature-related information, extracted at the encoder from the original frames, instrumental for
efcient searching. Experimental results for video surveillance and personal communications scenarios show
competitive performance regarding the state-of-the-art HEVC standard both in terms of visualization and
searching performances.