MediaBlender : Interactive Multimedia Segmentation

2006

Abstract The continuous growth of media databases necessitates development of novel visualization and interaction techniques to support management of these collections. We present Videotater, an experimental tool for a Tablet PC that supports the efficient and intuitive navigation, selection, segmentation, and tagging of video.

2005

Structuring video data is necessary for its effective retrieval and summarization. In particular, collecting similar scenes from semantic aspects highly contributes to the structuring. In this paper, we propose a method of clustering the scenes with relevance feedback, which may be able to bridge the gap between the video data and its semantics. First, spatio-temporal video segments of a fixed length are clustered according to image features of each segment. Then, a user performs feedback to the results of clustering, whether each segment is relevant to the cluster it belongs. The clustering accuracy can be improved through the interaction based on the feedback information. For diverse kinds of video streams, we investigated how the feedback should be given and demonstrated the effectiveness of the interactive clustering

2011

With recent advances in multimedia technologies, digital TV and information highways, more and more video data is being captured, produced and stored. However, without appropriate techniques that can make the video content more accessible, all these data are hardly usable. Content Based Video Retrieval (CBVR) becomes a proper solution to handling the video databases. The essential first step in CBVR is Video Segmentation. This paper is a critical survey of current trends/ methods for video segmentation. This work has been done with an aim to assist the upcoming researchers in the field of video retrieval to know about the technology and methods available for video segmentation. Keywords-video segmentation; content-based video retrieval; video indexing;key frame; histogram

2009

SAPIR is a peer-to-peer multimedia information retrieval system that can index structured and unstructured text, still and moving images, speech, and music. The system’s feature extraction component, which analyzes documents to prepare them for indexing, is implemented using UIMA. It handles compound documents using an architecture of (potentially nested) splitters and mergers within a UIMA aggregate. For example, the moving image from a video is split into a number of representative video frames, each of which is processed by the same analysis engine used for still images, and then merging the results to form a unified representation of the video. The output of the feature extraction module is a document description in a representation based on the MPEG-7

2005 IEEE International Conference on Multimedia and Expo, 2005

In this work we propose an intuitive graphic framework for the effective visualization of MPEG-7 low-level features, in the context of classification and annotation of audiovisual documents. This graphic tool is proposed to facilitate the access to the content, and to improve a quick understanding of the semantics associated to the considered document. The main visualization paradigm employed consists in representing a 2D feature space in which the shots of the audiovisual document are located. In another window, the same shots are drawn in a temporal bar that gives the users also the information related to the time domain. In the main window, shots with similar content fall near each other, and the proposed tool offers various functionalities for automatically and semi-automatically finding and annotating shot clusters in the feature space. The use of the proposed system to analyze the content of few video sequences has shown very interesting capabilities.

EURASIP Journal on Advances in Signal Processing, 2007

Advances in technologies for new forms of interactive multimedia services are driving the emergence of a digital world which is transforming all aspects of how people consume and interact with digital content. This emergent digital world is characterised by online access to knowledge resources and services independently from location and time. Here, digital services evolve in response to user behaviour, and technology adapts itself to user needs. As a consequence, new forms of interactive user-centred multimedia services materialise originating in turn new business models and economic growth. These services are underpinned by the confluence of different research fields including knowledge management, data mining, and signal processing. The convergence of these areas is the key to many applications including interactive TV, networked medical imaging, visionbased surveillance, and multimedia visualisation, navigation, search, and retrieval. The latter is a crucial application since the exponential growth of audiovisual data, along with the critical lack of tools to record the data in a well-structured form, is rendering vast portions of available useless content.

1998

Résumé/Abstract In this paper, a scheme for interactive video segmentation is presented. A key feature of the system is the distinction between two levels of segmentation, namely Region and Object Segmentation. Regions are homogeneous areas of the images, which are extracted automatically by the computer. Semantically meaningful objects are obtained through user interaction by grouping of regions, according to application specifications. This splitting relieves the computer of a fully semantic understanding of a scene, and allows a ...

International Journal of Pattern Recognition and Artificial Intelligence, 2004

In this paper, a color image segmentation al- gorithm and an approach to large-format image segmen- tation are presented, both focused on breaking down im- ages to semantic objects for object-based multimedia ap- plications. The proposed color image segmentation algo- rithm performs the segmentation in the combined intensity- texture-position feature space in order to produce con- nected regions that correspond

2013

VideoCycle is a candidate application for this second Video Browser Showdown challenge. VideoCycle allows interactive intra-video and inter-shot navigation with dedicated gestural controllers. MediaCycle, the framework it is built upon, provides media organization by similarity, with a modular architecture enabling most of its workflow to be performed by plugins: feature extraction, clustering, segmentation, summarization, intra-media and inter-segment visualization. MediaCycle focuses on user experience with user interfaces that can be tailored to specific use cases.

TENCON 2008 - 2008 IEEE Region 10 Conference, 2008

In this paper, we present an innovative way for effective interaction of users with the multimedia contents. We propose a novel framework which enables creation of content information through structural, semantic and media feature based descriptors compliant to MPEG-7 standard. The architecture offers content based search and personalized presentation using SMIL. The content based search exploits the MPEG-7 compliant content description to support spatiotemporal query constructs.