Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Step-Variable Method
Motion Analysis
References
All Topics
Computer Science
Computer Vision

A Survey on the Automatic Indexing of Video Data

Profile image of Ornella MichOrnella Mich

1999, Journal of Visual Communication and Image Representation

Abstract

Today a considerable amount of video data in multimedia databases requires sophisticated indices for its effective use. Manual indexing is the most effective method to do this, but it is also the slowest and the most expensive. Automated methods have then to be developed. This paper surveys several approaches and algorithms that have been recently proposed to automatically structure audio–visual data, both for annotation and access.

Related papers

<title>MPEG-7 audio-visual indexing test-bed for video retrieval</title>
Samuel Foucher

Internet Imaging V, 2003

This paper reports on the development status of a Multimedia Asset Management (MAM) test-bed for content-based indexing and retrieval of audio-visual documents within the MPEG-7 standard. The project, called "MPEG-7 Audio-Visual Document Indexing System" (MADIS), specifically targets the indexing and retrieval of video shots and key frames from documentary film archives, based on audio-visual content like face recognition, motion activity, speech recognition and semantic clustering. The MPEG-7/XML encoding of the film database is done off-line. The description decomposition is based on a temporal decomposition into visual segments (shots), key frames and audio/speech subsegments. The visible outcome will be a web site that allows video retrieval using a proprietary XQuery-based search engine and accessible to members at the Canadian National Film Board (NFB) Cineroute site. For example, end-user will be able to ask to point on movie shots in the database that have been produced in a specific year, that contain the face of a specific actor who tells a specific word and in which there is no motion activity. Video streaming is performed over the high bandwidth CA*net network deployed by CANARIE, a public Canadian Internet development organization.

View PDFchevron_right
MPEG7 audio-visual indexing test-bed for video retrieval
claude chapdelaine

2003

This paper reports on the development status of a Multimedia Asset Management (MAM) test-bed for content-based indexing and retrieval of audio-visual documents within the MPEG-7 standard. The project, called "MPEG-7 Audio-Visual Document Indexing System" (MADIS), specifically targets the indexing and retrieval of video shots and key frames from documentary film archives, based on audio-visual content like face recognition, motion activity, speech recognition and semantic clustering. The MPEG-7/XML encoding of the film database is done off-line. The description decomposition is based on a temporal decomposition into visual segments (shots), key frames and audio/speech sub-segments. The visible outcome will be a web site that allows video retrieval using a proprietary XQuery-based search engine and accessible to members at the Canadian National Film Board (NFB) Cineroute site. For example, end-user will be able to ask to point on movie shots in the database that have been produced in a specific year, that contain the face of a specific actor who tells a specific word and in which there is no motion activity. Video streaming is performed over the high bandwidth CA*net network deployed by CANARIE, a public Canadian Internet development organization.

View PDFchevron_right
Guest editorial: Content-Based Multimedia Indexing
Jenny Benois-pineau

Multimedia Tools and Applications, 2015

Multimedia indexing systems aim at providing easy, fast and accurate access to large multimedia repositories. Research in Content-Based Multimedia Indexing covers a wide spectrum of topics in content analysis, content description, content adaptation and content retrieval. Various tools and techniques from different fields such as data indexing, machine learning, pattern recognition, image analysis and human computer interaction have contributed to the success of multimedia systems. Although, there has been significant progress in the field, we still face situations when the system show limits in accuracy, generality and scalability. Hence, the goal of this special issue is to bring forward the recent advancements in content-based multimedia indexing. We received 48 submissions, but only accepted 17 (35.42 %), according to the review process that was very rigorous for this special issue and consisted of several rounds of review. The high number of submissions reflect the importance and timeliness of the research field on content-based multimedia indexing. The selected 17 papers in this special issue are high-class publications and cover a wide range of problems in content indexing of multimedia data. The first paper BVariability modelling for audio events detection in movies^(

View PDFchevron_right
Video Retrieval Using Automatically Extracted Audio
ANIL KALE

2013 International Conference on Cloud & Ubiquitous Computing & Emerging Technologies, 2013

Videos are a powerful and expressive media that can capture and present information. As these videos cover many subjects / genres, it is critical task to segregate videos as per the needs or interest of the users which requires classifications. In this paper we present a model for video classification using embedded audio. Video classification is usually accompanied with video annotation which helps in retrieving the archives. Efficient and effective video classification and annotation demands automated unsupervised classification and annotation of videos based on its embedded video content as manual indexing is unfeasible. As a first step the audio content of video is extracted and cleaned for further processing the next step converts audio into textual format .The text is processed upon to get the prime keywords in the video using text mining. The videos are classified and annotated on the keywords thus found. The annotated videos are stored in an object oriented database for future retrieval.

View PDFchevron_right
User Requirements for Multimedia Indexing and Retrieval of Unedited Audio-Visual Footage - RUSHES
Ebroul Izquierdo

2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services, 2008

Multimedia analysis and reuse of raw un-edited audio visual content known as rushes is gaining acceptance by a large number of research labs and companies. A set of research projects are considering multimedia indexing, annotation, search and retrieval in the context of European funded research, but only the FP6 project RUSHES is focusing on automatic semantic annotation, indexing and retrieval of raw and un-edited audio-visual content. Even professional content creators and providers as well as home-users are dealing with this type of content and therefore novel technologies for semantic search and retrieval are required. As a first result of this project, the user requirements and possible user-scenarios are presented in this paper. These results lay down the foundation for the research and development of a multimedia search engine particularly dedicated to the specific needs of the users and the content.

View PDFchevron_right
AUDIO-VISUAL CONTENT-BASED MULTIMEDIA INDEXING AND RETRIEVAL–THE MUVIS FRAMEWORK
Moncef Gabbouj

2004

ABSTRACT MUVIS is a collaborative framework that supports indexing, browsing and querying of various multimedia types such as audio, video, audio/video interlaced in several formats. It allows real-time audio and video capturing, encoding by last generation codecs such as MPEG-4, H. 263+, MP3 and AAC. MUVIS also supports several audio/video file format such as AVI, MP4, MP3 and AAC.

View PDFchevron_right
Audio indexing on a medical video database: The AVISON project
Grégory Senay

2011 4th International Conference on Biomedical Engineering and Informatics (BMEI), 2011

This paper presents an overview of our research conducted in the context of the AVISON project which aims to develop a platform for indexing surgery videos of the Institute of Research Against Digestive Cancer. The platform is intended to provide a friendly query-based access to the videos database of IRCAD institute, that is dedicated to the training of international surgeons. A text-based indexing system is used for querying the videos where the textual contents are obtained with an automatic speech recognition system. The paper presents the new approaches that we proposed for dealing with these highly specialised data in an automatic manner. We present new approaches for obtaining low-cost training corpus, for automatically adapting the automatic speech recognition system, for allowing multilingual querying of videos and, finally, for filtering documents that could affect the database quality due to transcription errors.

View PDFchevron_right
Multimedia content analysis-using both audio and visual clues
Abdul-Ilah As-Saadi

IEEE Signal Processing Magazine, 2000

Multimedia content analysis refers to the computerized understanding of the semantic meanings of a multimedia document, such as a video sequence with an accompanying audio track. With a multimedia document, its semantics are embedded in multiple forms that are usually complimentary of each other, Therefore, it is necessary to analyze all types of data: image frames, sound tracks, texts that can be extracted from image frames, and spoken words that can be deciphered from the audio track. This usually involves segmenting the document into semantically meaningful units, classifying each unit into a predefined scene type, and indexing and summarizing the document for efficient retrieval and browsing. We review advances in using audio and visual information jointly for accomplishing the above tasks. We describe audio and visual features that can effectively characterize scene content, present selected algorithms for segmentation and classification, and review some testbed systems for video archiving and retrieval. We also describe audio and visual descriptors and description schemes that are being considered by the MPEG-7 standard for multimedia content description

View PDFchevron_right
Multimedia Indexing and Retrieval Techniques: A Review
Harsha Bhute

International Journal of Computer Applications, 2012

Retrieval of multimedia has become a requirement for many contemporary information systems. These systems need to provide browsing, querying, navigation, and, sometimes, composition capabilities involving various forms of media. In this survey, we review techniques for text, image, audio and video retrieval. We first look at indexing and retrieval techniques for text, audio, image and video. We also discuss features visual features for video retrieval such as colour, texture, shape. The indexing techniques are discussed for these features. We also compare most popular techniques used for indexing and retrieval.

View PDFchevron_right
Feature Based Digital Video Indexing
Ramesh Jain

Visual Database Systems 3, 1995

Indexing video data is essential for providing content based access. Indexing has typically been viewed either from a manual annotation perspective or from an image sequence processing perspective. This work proposes a methodology for designing video indexing schemes which use low level machine derivable indices to map into the set of application specific desired video indices. The indexing procedure uses image sequence processing and application requirements analysis to arrive at the low level and desired indices. The mapping is created based on the domain constraints. A mapping efficacy measure is presented. Experimental results of indexing video using image motion features are presented.

View PDFchevron_right

References (112)

  1. N. R. Adam and B. K. Bhargava, Digital Libraries, Springer-Verlag, New York/Berlin, 1995.
  2. F. Banfi, Image Databases: State of the Art and Future Directions, Internal Working Paper 96-10, University of Fribourg, Fribourg, Switzerland, September 1996.
  3. A. Brink, S. Marcus, and V. S. Subrahmanian, Heterogeneous multimedia reasoning, Computer, September 1995, 33-39.
  4. G. Davenport and M. Murtaugh, ConText: Toward the evolving documentary, in ACM Multimedia 95, San Francisco, CA, November 1995, pp. 5-8.
  5. E. A. Fox, Advances in interactive digital multimedia systems, Computer, October 1991, 9-21.
  6. D. J. Gemmell, H. M. Vin, D. D. Kandlur, P. V. Rangan, and L. A. Rowe, Multimedia storage servers: A tutorial, Computer, May 1995, 40-49.
  7. R. Jain, InfoScopes: Multimedia Information Systems, Technical Report VCL-95-107, Visual Computing Laboratory, University of California, San Diego, 1995.
  8. R. Jain, A. Pentland, and D. Petkovic, Workshop Report: NFS-ARPA workshop on visual information management systems, in Proceedings of the 5th ICCV, Cambridge, MA, 1995.
  9. S. Moni and R. L. Kashyap, A multiresolution representation scheme for multimedia databases, Multimedia Systems 3, 1995, 228-237.
  10. A. D. Narasimhalu, Multimedia databases, Multimedia Systems 4(5), 1996, 226-249.
  11. H. Nishiyama, S. Kin, T. Yokoyama, and Y. Matsushita, An image retrieval system considering subjective perception, in Proceedings of CHI '94, Boston, 1994, Vol. 4, pp. 30-36.
  12. A. A. Rodriguez and L. A. Rowe, Multimedia systems and applications, Computer, May 1995, 20-23.
  13. V. S. Subrahmanian and S. Jajodia, Multimedia Database Systems, Springer-Verlag, New York/Berlin, 1996.
  14. H. J. Zhang, S. W. Smoliar, J. H. Wu, C. Y. Low, and A. Kankanhalli, A video database system for digi- tal libraries, in Advances in Digital Libraries, Lecture Notes in Computer Science, Springer-Verlag, New York/Berlin, 1995.
  15. A. Hampapur, R. Jain, and T. Weymouth, Digital video indexing in multimedia systems, in Proceedings of the Workshop on Indexing and Reuse in Multimedia Systems, August 1994, AAAI Press, Menlo Park, CA, 1994.
  16. A. Hampapur, R. Jain, and T. Weymouth, Feature based digital video indexing, in Proceedings of IFIP 2.6 Third Working Conference on Visual Database Systems VDB.3, Lausanne, Switzerland, March 29-31, 1995.
  17. G. Ahanger, D. Benson, and T. D. C. Little, Video Query Formulation, Technical Report MCL 01-09-1995, Multimedia Communication Laboratory, Boston University, 1995.
  18. G. Ahanger and T. D. C. Little, A survey of technologies for parsing and indexing digital video, J. Visual Commun. Image Rep. 7(1), 1996, 28-43.
  19. C. Faloutsos and K. I. Lin, FastMap: A fast algorithm for indexing, data-mining and visualization of tradi- tional and multimedia datasets, in Proceedings of SIGMOD '95, 1995, pp. 163-174.
  20. A. S. Gordon and E. A. Domeshek, Conceptual indexing for video retrieval, in Proceedings IJCAI '95 Workshop on Intelligent Multimedia Information Retrieval, Montreal, August 1995 (M. Maybury, Ed.).
  21. T. Sikora, The MPEG-4 video standard and its potential for future multimedia applications, in Proc. IEEE ISCAS Conference, Hong Kong, June 1997.
  22. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, Query by image and video content: The QBIC systems, Computer, September 1995, 23-32.
  23. P. Kelly and M. Cannon, CANDID: Comparison algorithm for navigating digital image databases, in Proceed- ings of the Seventh International Working Conference on Scientific and Statistical Database Management, Charlottesville, VA, September 1994, pp. 252-258.
  24. P. Kelly and M. Cannon, Experience with CANDID: Comparison algorithm for navigating digital image databases, in Proceedings SPIE of the 23rd AIPR Workshop On Image and Information Systems: Applications and Opportunities, Washington DC, October 12-14, 1994, pp. 64-75.
  25. P. Kelly and M. Cannon, Query by image example: The CANDID approach, in Proceedings of SPIE Storage and Retrieval for Image and Video Databases III, 1995, Vol. 2420, pp. 238-248.
  26. I. K. Sethi and N. Patel, A statistical approach to scene change detection, in Proceedings of SPIE Storage and Retrieval for Image and Video Databases III, San Josè, CA, 1995, Vol. 2420.
  27. H. J. Zhang, A. Kankanhalli, and S. W. Smoliar, Automatic partitioning of full-motion video, Multimedia Systems 1, 1993, 10-28.
  28. P. Aigrain and O. Joly, The automatic real-time analysis of film editing and transition effects and its appli- cations, Comput. & Graphics 18(1), 1994, 93-103.
  29. U. Gargi, S. Oswald, D. A. Kosiba, S. Devadiga, and R. Kasturi, Evaluation of video sequence indexing and hierarchical video indexing, in Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases III, 1995, Vol. 2420.
  30. U. Gargi, R. Kasturi, S. Strayer, and S. Antani, An Evaluation of Color Histogram Based Methods in Video Indexing. Technical Report CSE-96-053, Penn State University, Department of Computer Science and Engineering, 1996.
  31. J. M. Corridoni and A. Del Bimbo, Film semantic analysis, in Proceedings of the International Conference on Analysis of Image Patterns, Prague, Czech Republic, September 1995.
  32. W. Xiong, J. Chung-Mong, and R. H. Ma, Automatic video data structuring through shot partitioning and key-frame computing, Mach. Vision Appl. 10, 1997, 51-65.
  33. D. Le Gall, MPEG: A video compression standard for multimedia applications, Commun. ACM 34(4), 1991, 46-58.
  34. H. J. Zhang, C. Y. Low, and S. W. Smoliar, Video parsing and browsing using compressed data, Multimedia Tools Appl. 1, 1995, 91-113.
  35. International Telecommunication Union, ITU Place des Nations CH-1211, Geneva 2, H.263: Video coding for low bit rate communication, E 7244 edition, March 1996.
  36. J. Meng, Y. Juan, and S.-F. Chang, Scene change detection in a MPEG compressed video sequence, in Proceedings of the IS&T/SPIE Symposium on Electronic Imaging: Science & Technology, San Josè, CA, February 1995.
  37. H. C. Liu and G. L. Zick, Automatic determination of scene changes in MPEG compressed video, in Proc. of ISCAS-IEEE International Symposium on Circuits and Systems, 1995.
  38. F. Arman, A. Hsu, and M. Y. Chiu, Feature management for large video databases, in Proceedings of SPIE Storage and Retrieval for Image and Video Databases, 1993, pp. 2-12.
  39. E. Deardorff, T. D. C. Little, J. D. Marshall, D. Venkatesh, and R. Walzer, Video scene decomposition with the motion picture parser, in Proceedings of the IS&T/SPIE Symposium on Electronic Imaging Sci- ence and Technology (Digital Video Compression and Processing on Personal Computers: Algorithms and Technologies), San Josè, CA, February 1994, Vol. 2187, pp. 44-55.
  40. N. V. Patel and I. K. Sethi, Video shot detection and characterization for video databases, Pattern Recognition-Special Issue on Multimedia 30(4), 1997, 583-592.
  41. E. Ardizzone, G. A. M. Gioiello, M. La Cascia, and D. Molinelli, A real-time neural approach to scene cut detection, in IS&T/SPIE-Storage & Retrieval for Image and Video Databases IV, San Josè, CA, January 28-February 2, 1996.
  42. B.-L. Yeo, Efficient Processing of Compressed Images and Video, Ph.D. thesis, Dept. of Electrical Engineer- ing, Princeton University, January 1996.
  43. K. Shen and E. J. Delp, A fast algorithm for video parsing using MPEG compressed sequences, in Proc. of IEEE International Conference on Image Processing, October 1995, pp. 252-255.
  44. A. Hampapur, R. Jain, and T. Weymouth, Production model based digital video segmentation, J. Multimedia Tools Appl. 1(1), 1995, 9-46.
  45. A. Hampapur, R. Jain, and T. Weymouth, Digital video segmentation, in Proceedings Second Annual ACM MultiMedia Conference and Exposition, October 1994.
  46. R. Zabih, J. Miller, and K. Mai, A feature-based algorithm for detecting and classifying scene breaks, in Proceedings of the Fourth ACM Conference on Multimedia, San Francisco, CA, November 1995.
  47. W. Xiong and J. C.-M. Lee, Efficient scene change detection and camera motion annotation for video classification, Comput. Vision Image Understanding 71(2), 1998, 166-181.
  48. A. Dailianas, R. B. Allen, and P. England, Comparisons of automatic video segmentation algorithms, in Proceedings SPIE Photonics East'95: Integration Issues in Large Commercial Media Delivery System, Philadelphia, October 1995.
  49. J. S. Boreczky and L. A. Rowe, A comparison of video shot boundary detection techniques, in Storage & Retrieval for Image and Video Databases IV (I. K. Sethi and R. C. Jain, Eds.), SPIE Proceedings Series, Vol. 2670, pp. 170-179.
  50. R. Brunelli and T. Poggio, Template matching: Matched spatial filters and beyond, Pattern Recognition 30(5), 1997, 751-768.
  51. K. K. Sung and T. Poggio, Example-based learning for view-based human face detection, in Proceedings Image Understanding Workshop, 1994.
  52. M. S. Lew and N. Huijsmans, Information theory and face detection, in Proceedings of ICPR, 1996, pp. 601-605.
  53. B. Moghaddam and A. Pentland, Probabilistic visual learning for object representation, IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 1997, 696-710.
  54. E. Osuna, R. Freund, and F. Girosi, Training support vector machines: An application to face detection, in Proc. of CVPR'97, Puerto Rico, June 1997.
  55. H. Wang and S. Fu Chang, A highly efficient system for automatic face region detection in MPEG video, IEEE Trans. Circuits Systems Video Technol. 7(4), 1997, 615-628.
  56. G. Burel and D. Carel, Detection and localization of faces on digital images, Pattern Recognit. Lett. 15, 1994, 963-967.
  57. H. A. Rowley, S. Baluja, and T. Kanade, Neural network-based face detection, in Image Understanding Workshop, February 1996, pp. 725-735.
  58. T. Sato, T. Kanade, E. K. Hughes, M. A. Smith, and S. Satoh, Video OCR: Indexing digital news libraries by recognition of superimposed caption, ACM Multimedia Systems, Special Issue on Video Libraries, submitted.
  59. Y. Ariki and T. Teranishi, Indexing and classification of TV-news articles based on telop recognition, in Fourth Int. Conf. on Document Analysis and Recognition, Ulm, Germany, August 1997, pp. 422-427.
  60. A. K. Jain and B. Yu, Automatic text location in images and video frames, in 14th Int. Conf. on Pattern Recognition, Brisbane, Australia, August 16-20, 1998.
  61. H.-K. Kim, Efficient automatic text location method and content-based indexing and structuring of video database, J. Visual Commun. Image Representation 7(4), 1996, 336-344.
  62. R. Lienhart and W. Effelsberg, Automatic Text Segmentation and Text Recognition for Video Indexing, Technical Report TR-98-009, Universität Mannheim, Praktische Informatik IV, Mannheim, Germany, 1998.
  63. A. Takeshita, T. Inoue, and K. Tanaka, Extracting text skim structures for multimedia browsing, in Pro- ceedings IJCAI '95 Workshop on Intelligent Multimedia Information Retrieval, Montreal, August 1995 (M. Maybury, Ed.).
  64. V. Wu, R. Manmatha, and E. M. Riseman, Finding text in images, in 2nd ACM Int. Conf. on Digital Libraries, Philadelphia, PA, July 1997, pp. 23-26.
  65. S. Messelodi and C. M. Modena, Automatic identification and skew estimation of text lines in real scene images, Pattern Recognit. 32(5), 1999, 789-808.
  66. U. Gargi, R. Kasturi, and S. Antani, Performance characterization and comparison of video indexing algo- rithms, in Proc. of Computer Society Conference on Computer Vision and Pattern Recognition, 1998.
  67. S. Sato, Y. Nakamura, and T. Kanade, Name-it: Naming and detecting faces in video by the integration of image and natural language processing, in Proc. of IJCAI-97, 1997.
  68. C. Cedras and M. Shah, Motion-based recognition: A survey, Image Vision Comput. 13(2), 1995, 129-155.
  69. J. Y. A. Wang and E. H. Adelson, Spatio-temporal segmentation of video data, in Image and Video Process- ing II, Proceedings of the SPIE, San Josè, CA, February 1994, Vol. 2182.
  70. J. Y. A. Wang, E. H. Adelson, and U. Desai, Applying mid-level vision techniques for video data compression and manipulation, in Digital Video Compression on Personal Computers: Algorithms and Technologies, Proceedings of the SPIE, San Josè, CA, February 1994, Vol. 2187.
  71. S. Ayer and H. S. Sawhney, Layered Representation of Motion Video using Robust Maximum-Likelihood Estimation of Mixture Models and MDL Encoding, Technical report, IBM Almaden Research Center, 650 Harry Road, San Josè, CA 95120, December 1994.
  72. S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, VideoQ: An automated content based video search system using visual cues, in Proceedings of the Fifth ACM Multimedia Conference, Seattle, November 1997.
  73. H. S. Sawhney, S. Ayer, and M. Gorkani, Model-based 2D & 3D dominant motion estimation for mosaicking and video representation, in Proceedings of ICCV 95, Cambridge, MA, June 1995.
  74. M. Bierling, Displacement estimation by hierarchical blockmatching, in Proc. SPIE, Visual Communications and Image Processing '88, January 1988. Vol. 1001, pp. 942-951.
  75. E. Sahouria, Video indexing based on object motion, Master's thesis, Dept. of Electrical Engineering and Computer Science, University of California at Berkeley, 1998.
  76. N. Hirzalla and A. Karmouch, Detecting cuts by understanding camera operation for video indexing, J. Visual Lang. Comput. 6, 1995, 385-404.
  77. M. A. Smith and T. Kanade, Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques, Technical Report CMU-CS-97-111, School of Computer Science, Carnegie Mellon University, Pittsburg, PA 15213, February 1997.
  78. P. Joly and H.-K. Kim, Efficient automatic analysis of camera work and microsegmentation of video using spatiotemporal images, Signal Process. Image Commun. 8, 1996, 295-307.
  79. J. Park and C. W. Lee, Robust estimation of camera parameters from image sequence for video composition, Signal Process. Image Commun. 9, 1996, 43-53.
  80. N. Dimitrova and F. Golshani, Motion recovery for video content classification, ACM Trans. Inform. Systems 13(4), 1995, 408-439.
  81. M. Ioka and M. Kurokawa, Estimation of motion vectors and their application to scene retrieval, Mach. Vision Appl. 7, 1994, 199-208.
  82. S.-Y. Lee and H.-M. Kao, Video indexing-An approach based on moving object and track, in Proceedings SPIE Storage and Retrieval for Image and Video Databases, 1993, pp. 25-36.
  83. D. Zhong and S.-F. Chang, Video object model and segmentation for content-based video indexing, in IEEE Intern. Conf. on Circuits and Systems, Hong Kong, June 1997. [Special session on networked multimedia technology & application]
  84. E. Ardizzone and M. La Cascia, Video indexing using optical flow field, in Int. Conf. on Image Processing, ICIP-96, Lausanne, Switzerland, September 16-19, 1996.
  85. Y. Tonomura, A. Akutsu, K. Otsuji, and T. Sadakata, VideoMAP and video spaceIcon: Tools for anatomizing video content, in Proceedings of INTERCHI '93, ACM, April 24-29, 1993, pp. 131-136.
  86. L. Teodosio and W. Bender, Salient stills from video, in Proceedings of the ACM Multimedia '93 Conference, Anheim, CA, August 1993.
  87. H. S. Sawhney and S. Ayer, Compact representations of video through dominant and multiple motion estimation, IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 1996.
  88. D. Yow, B.-L. Yeo, M. Yeung, and B. Liu, Analysis and presentation of soccer highlights from digital video, in Proceedings of the Second Asian Conference on Computer Vision, December 1995.
  89. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, Performance of optical flow techniques, Int. J. Comput. Vision 12(1), 1994, 43-77.
  90. M. M. Yeung and B. Liu, Efficient Matching and Clustering of Video Shots, technical report, Princeton University, 1995.
  91. H. J. Zhang, S. W. Smoliar, and J. H. Wu, Content-based video browsing tools, in Proceedings SPIE Conference on Multimedia Computing and Networking, San Josè, CA, February 1995.
  92. W. Wolf, Key frame selection by motion analysis, in Proceedings of ICASSP '96.
  93. X. Liu, C. B. Owen, and F. Makedon, Automatic Video Pause Detection Filter, Technical Report PCS-TR97- 307, Dartmouth College, Computer Science, Hanover, NH, February 1997.
  94. B. Yeo and B. Liu, Rapid scene analysis on compressed videos, IEEE Trans. Circuit Systems Video Technol. 5(6), 1995, 533-544.
  95. B.-L. Yeo and B. Liu, A unified approach to temporal segmentation of motion JPEG and MPEG compressed video, in Proceedings of the Second Internation Conference on Multimedia Computing and Systems, May 1995.
  96. M. Yeung, B.-L. Yeo, and B. Liu, Extracting story units from long programs, in Proceedings of the Interna- tional Conference on Multimedia Computing and Systems, June 1996.
  97. M. M. Yeung, B.-L. Yeo, W. Wolf, and B. Liu, Video browsing using clustering and scene transitions on compressed sequences, in Proceedings of the IS&T/SPIE Multimedia Computing and Networking, San Josè, CA, February 1995.
  98. H.-H. Yu and W. Wolf, Scenic classification methods for image and video databases, in Proceedings of the ACM Multimedia '93 Conference (C.-C. J. Kuo, Ed.), Vol. 2606, 1995, pp. 363-371.
  99. S. Pfeiffer, R. Lienhart, S. Fisher, and W. Effelsberg, Abstracting digital movies automatically, J. Visual Commun. Image Representation 7(4), 1996, 345-353.
  100. S. Devadiga, D. A. Kosiba, U. Gargi, S. Oswald, and R. Kasturi, A semiautomatic video database system, in Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases III, Vol. 2420, 1995.
  101. S. Fischer, R. Lienhart, and W. Effelsberg, Automatic recognition of film genres, in Proc. ACM Multimedia 95, San Francisco, CA, November 1995, pp. 295-304.
  102. M. K. Hawley, Structure out of Sound, Ph.D. thesis, School of Architecture and Planning, Massachusetts Institute of Technology, September 1993.
  103. P. Aigrain, P. Joly, and V. Longueville, Medium knowledge-based macrosegmentation of video into se- quences, in Proceedings IJCAI '95 Workshop on Intelligent Multimedia Information Retrieval, Montreal, Canada, August 1995 (M. Maybury, Ed.).
  104. H. J. Zhang, S. Y. Tan, S. W. Smoliar, and G. Yihong, Automatic parsing and indexing of news video, Multimedia Systems 2, 1995, 256-266.
  105. M. G. Christel, M. A. Smith, C. R. Taylor, and D. B. Winkler, Evolving video skims into useful multimedia abstractions, in Proc. of ACM CHI'98, Conference on Human Factors in Computing Systems, Los Angeles, CA, April 1998.
  106. Y. Nakamura and T. Kanade, Semantic analysis for video contents extraction-Spotting by association in news video, in Proc. of the Fifth ACM International Multimedia Conference, November 1997.
  107. R. Lienhart, W. Effelsberg, and R. Jain, VisualGREP: A systematic method to compare and retrieve video sequences, in SPIE, Storage and Retrieval for Image and Video Databases VI, January 1998, Vol. 3312.
  108. M. Caliani, C. Colombo, A. Del Bimbo, and P. Pala, Commercial video retrieval by induced semantics, in Proc. of IEEE Internation Workshop on Content-Based Access of Image and Video Databases (CAIVD8), Bombay, India, 1998.
  109. M. Christel and D. Martin, Information visualization within a digital video library, J. Intell. Inform. Systems 11 (3), 1998. [Special issue on Information Visualization]
  110. D. DeMenthon, V. Kobla, and D. Doermann, Video summarization by curve simplification, in Proceedings of the Sixth ACM Multimedia Conference, Bristol, UK, September 1998.
  111. K. Manske, M. Muhlhauser, S. Vogl, and M. Goldberg, OBVI: Hierarchical 3D video-browsing, in Proceed- ings of the Sixth ACM Multimedia Conference, Bristol, UK, September 1998.
  112. ROBERTO BRUNELLI was born in Trento, Italy in 1961. He received his degree (summa cum laude) in physics from the University of Trento in 1986. He joined ITC-irst in 1987, where he works in the Computer Vision Group of the Interactive Sensory Systems Division. In the past he was involved in research on computer vision tools, analysis of aerial images, development of algorithms working on compressed description of binary images, optimization, neural networks, and face analysis. His current major involvement is in OPAL (ESPRIT Project 25389), on-line programmes, digital archives, and distributed editorial collaboration. His current professional interests include optimization, robust statistics, object recognition, and multimedia databases. Personal interests include comics, inline-skating, science-fiction, motorbiking, and photography. ORNELLA MICH was born in Tesero, Trento, Italy in 1959. She received her degree in electronic engineering from the University of Padova, Italy in 1987. Then she worked on radar electronics for jet-fighters. After teaching electrotecnics in a high school, she joined IRST in 1989, collaborating on VLSI research. From 1990 she is working in the field of computer vision in the Interactive Sensory Systems Division. CARLA MARIA MODENA was born in Rovereto, Trento, Italy in 1961. She received her degree in mathematics from the University of Trento in 1985. In 1986 she worked at the Institut fuer Volkswirtschaftslehre, Universitaet Regensburg, Germany. She joined ITC-IRST in 1987, where she works in the Interactive Sensory Systems Divison. Her current interests in computer vision include text localization and recognition and document archives indexing.

Related papers

ACTIVE, an Extensible Cataloging Platform for Automatic Indexing of Audiovisual Content
Felice Colucci

Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2016

The cost of manual metadata production is high, especially for audiovisual content, where a time-consuming inspection is usually required in order to identify the most appropriate annotations. There is a growing need from digital content industries for solutions capable of automating such a process. In this work we present ACTIVE, a platform for indexing and cataloging audiovisual collections through the automatic recognition of faces and speakers. Adopted algorithms are described and our main contributions on people clustering and caption-based people identification are presented. Results of experiments carried out on a set of TV shows and audio files are reported and analyzed. An overview of the whole architecture is presented as well, with a focus on chosen solutions for making the platform easily extensible (plug-ins) and for distributing CPU-intensive calculations across a network of computers.

View PDFchevron_right
Automatic Video Database Indexing and Retrieval
Edoardo Ardizzone

Multimedia Tools and Applications, 1997

The increasing development of advanced multimedia applications requires new technologies for organizing and retrieving by content databases of still digital images or digital video sequences. To this aim image and image sequence contents must be described and adequately coded. In this paper we describe a system allowing content-based annotation and querying in video databases. No user action is required during the database population step. The system automatically splits a video into a sequence of shots, extracts a few representative frames (said r-frames) from each shot and computes r-frame descriptors based on color, texture and motion. Queries based on one or more features are possible. Very interesting results obtained during the severe tests the system was subjected to are reported and discussed.

View PDFchevron_right
A New Hybrid Approach to Video Organization for Content-Based Indexing
Shih-Ping Liou

Proceedings of the Ieee International Conference on Multimedia Computing and Systems, 1998

Video organization is a key step in the content-based indexing of video archives. The objective of video organization is to capture the semantic structure of a video in a form which is meaningful to the user. We present a hybrid approach to video organization which automatically processes video, creating a video table of contents (VTOC), while providing easy-to-use interfaces for verification, correction and augmentation of the automatically extracted video structure. Algorithms are developed to solve the subproblems of shot detection, shot grouping and VTOC generation without making very restrictive assumptions about the structure or content of the video. We use a nonstationary time series model of difference metrics for shot boundary detection, color and edge similarities for shot grouping and observations about the structure of a wide class of videos for the generation of the VTOC. The use of automatic processing in conjunction with input from the user allows us to produce meaningful video organization efficiently.

View PDFchevron_right
An Automated Video Classification and Annotation Using Embedded Audio for Content Based Retrieval
ANIL KALE

Journal of Industrial and Intelligent Information, 2013

Efficient and effective video classification and annotation demands automated unsupervised classification and annotation of videos based on its embedded video content as manual indexing is unfeasible. Audio is a rich source of information in the digital videos that can provide useful descriptor for indexing the video databases. Audio archives contrast with image or video archives in a number of important dimensions. First, they capture information from all directions and are largely robust to sensor position and orientation, allowing data collection without encumbering the user. Second, the nature of audio is distinct from video, making certain kinds of information (for example, what is said) more accessible, and other information (for example, the presence of nonspeaking individuals) unavailable. In general, processing the content of an audio archive could provide a wide range of useful information. As a first step the audio content of video is extracted and cleaned for further processing the next step converts audio into textual format .The text is processed upon to get the prime keywords in the video using text mining. The videos are classified and annotated on the keywords thus found. The annotated videos  Index Terms-fContent-based access, video, multimedia, keyframes, automatic analysis component.

View PDFchevron_right
Audio visual cues for video indexing and retrieval
Paisarn Muneesawang

Advances in Multimedia Information …, 2005

Abstract. This paper studies content-based video retrieval using the combination of audio and visual features. The visual feature is extracted by an adaptive video indexing technique that places a strong emphasis on accurate characterization of spatio-temporal information within ...

View PDFchevron_right

Related topics

  • Content-Based Video Retrieval
  • Video Indexing
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved