MPEG7 audio-visual indexing test-bed for video retrieval

A system for digitization, storage and retrieval of audiovisual information and its associated data (metainfo) is presented. The principles of the evolving MPEG-7 standard have been adopted for the creation of the data model used by the system, permitting efficient separation of database des ign, content description, business logic and presentation of query results. XML Schema is used in defining the data model and XML in describing audiovisual content. Issues regarding problems that emerged during system design and their solutions are discussed, such as customization, deviations from the standard MPEG-7 DSs or even the design of entirely custom DSs. Although the system includes modules for digitization, annotation, archiving and intelligent data mining, the paper mainly focuses on the use of MPEG-7 as the information model.

2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services, 2008

Multimedia analysis and reuse of raw un-edited audio visual content known as rushes is gaining acceptance by a large number of research labs and companies. A set of research projects are considering multimedia indexing, annotation, search and retrieval in the context of European funded research, but only the FP6 project RUSHES is focusing on automatic semantic annotation, indexing and retrieval of raw and un-edited audio-visual content. Even professional content creators and providers as well as home-users are dealing with this type of content and therefore novel technologies for semantic search and retrieval are required. As a first result of this project, the user requirements and possible user-scenarios are presented in this paper. These results lay down the foundation for the research and development of a multimedia search engine particularly dedicated to the specific needs of the users and the content.

Proceedings of European …

Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2016

The cost of manual metadata production is high, especially for audiovisual content, where a time-consuming inspection is usually required in order to identify the most appropriate annotations. There is a growing need from digital content industries for solutions capable of automating such a process. In this work we present ACTIVE, a platform for indexing and cataloging audiovisual collections through the automatic recognition of faces and speakers. Adopted algorithms are described and our main contributions on people clustering and caption-based people identification are presented. Results of experiments carried out on a set of TV shows and audio files are reported and analyzed. An overview of the whole architecture is presented as well, with a focus on chosen solutions for making the platform easily extensible (plug-ins) and for distributing CPU-intensive calculations across a network of computers.

International Conference on Enterprise Information Systems, 2004

This article presents the development of an audiovisual archive that uses the MPEG-7 standard to describe video content and a XML database to store the video descriptions. It presents the model adopted to describe the video content, the framework of the audiovisual archive information system, a video indexing tool developed to allow the creation and manipulation of XML documents with

Technical paper

International journal of engineering research and technology, 2018

In the last few years extensive request for user oriented multimedia information systems has developed.Multimedia database can be defined as a pool of storage and retrieval systems, in which large amount of media objects are created, searched, modifiedand retrieved. Multimedia is the combination of text, image, graphicsand animations, audio and video information. The addition of database application to handle multimedia objects requires organization of multiple media data streams. Apart from text retrieval, the current waves in web searching and multimedia documents retrieval are the exploration for and supply of images, audio, 3D extracts and video. The content-based multimedia information retrieval offers new techniques and methods for probing various multimedia databases over the world.The discussiondeals with a new standard for multimedia search based on content. Keywords— Multimedia database;content based retrivel; text based retrival; free browsing;CAS;

2007 International Symposium on Communications and Information Technologies, 2007

Adistambha, K.; Doeller, M.; Tous, R.; Gruhne, M.; Sano, M.; Tsinaraki, C.; Christodoulakis, S.; Yoon, Kyoungro; Ritz, C. H.; and Burnett, I. S.: The MPEG-7 Query Format: A New Standard in Progress for Multimedia Query by Content 2007.

Journal of the American Society for Information Science and Technology, 2007

The MPEG-7 standard supports the description of both the structure and the semantics of multimedia; however, the generation and consumption of MPEG-7 structural and semantic descriptions are outside the scope of the standard. This article presents two research prototype systems that demonstrate the generation and consumption of MPEG-7 structural and semantic descriptions in retrieval applications. The active system for MPEG-4 video object simulation (AMOS) is a video object segmentation and retrieval system that segments, tracks, and models objects in videos (e.g., person, car) as a set of regions with corresponding visual features and spatiotemporal relations. The region-based model provides an effective base for similarity retrieval of video objects. The second system, the Intelligent Multimedia Knowledge Application (IMKA), uses the novel MediaNet framework for representing semantic and perceptual information about the world using multimedia. MediaNet knowledge bases can be constructed automatically from annotated collections of multimedia data and used to enhance the retrieval of multimedia.

Lecture Notes in Computer Science, 2004

We describe a multimedia, multilingual and multimodal research system (CIMWOS) supporting content-based indexing, archiving, retrieval and on-demand delivery of audiovisual content. CIMWOS (Combined IMage and WOrd Spotting) incorporates an extensive set of multimedia technologies by seamless integration of three major components -speech, text and image processing -producing a rich collection of XML metadata annotations following the MPEG-7 standard. These XML annotations are further merged and loaded into the CIMWOS Multimedia Database. Additionally, they can be dynamically transformed for interchanging semantic-based information into RDF documents via XSL stylesheets. The CIMWOS Retrieval Engine is based on a weighted boolean model with intelligent indexing components. A user-friendly webbased interface allows users to efficiently retrieve video segments by a combination of media description, content metadata and natural language text. The database includes sports, broadcast news and documentaries in three languages.