Academia.eduAcademia.edu

Outline

Title
Abstract
Requirements for Designing a Multimedia Ontology
Related Work
Further and Future Issues of Semantic Multimedia
Summary and Outlook
References
All Topics
Computer Science
Information Systems

Semantic Multimedia

Profile image of Steffen StaabSteffen Staab

Abstract

Multimedia constitutes an interesting field of application for Semantic Web and Semantic Web reasoning, as the access and management of multimedia content and context depends strongly on the semantic descriptions of both. At the same time, multimedia resources constitute complex objects, the descriptions of which are involved and require the foundation on sound modeling practice in order to represent findings of low-and high level multimedia analysis and to make them accessible via Semantic Web querying of resources. This tutorial aims to provide a red thread through these different issues and to give an outline of where Semantic Web modeling and reasoning needs to further contribute to the area of semantic multimedia for the fruitful interaction between these two fields of computer science. 8 See also the forthcoming W3C Media Fragments Working Group:

Related papers

Towards a media interpretation framework for the semantic web
Susan Gauch

2007

We present a framework for media interpretation that leverages low-level information extraction to a higher level of abstraction in order to support semantics-based information retrieval for the Semantic Web. The overall goal of the framework is to provide high-level content descriptions of documents for maximizing precision and recall of semantics-based information retrieval. 1 2 Abduction for Media Interpretation Abduction is usually described as a form of reasoning from effects to causes. Another

View PDFchevron_right
ONTOLOGY FOR SEMANTIC MULTIMEDIA WEB
Hiranmay Ghosh

ABSTRACT This paper proposes a new multimedia ontology based scheme for semantic multimedia data processing on the web. The ontology language” Multimedia Web Ontology Language”(MOWL), is designed as an extension of OWL, the W3C recommended ontology language for the web. MOWL supports creation of and reasoning with perceptual modeling of concepts, and probabilistic evidential reasoning. Index Terms—Multimedia systems, Ontology, Semantic

View PDFchevron_right
Feature Article: Hiranmay Ghosh, Santanu Chaudhury and Anupama Mallik 21 Ontology for Multimedia Applications
Anupama Mallik

2015

Abstract—This paper provides an overview of the contents of a tutorial on the subject by one of the authors at WI-2013 Confer-ence. The domination of multimedia contents on the web in recent times has motivated research in their semantic analysis. This tutorial aims to provide a critical overview of the technology, and focuses on application of ontologies for multimedia applications. It establishes the need for a fundamentally different approach for a representation and reasoning scheme with ontologies for semantic interpretation of multimedia contents. It introduces a new ontology representation scheme that enables reasoning with uncertain media properties of concepts in a domain context and a language “Multimedia Web Ontology Language ” (MOWL) to support the representation scheme. We discuss the approaches to semantic modeling and ontology learning with specific reference to the probabilistic framework of MOWL. We present a couple of illustrative application examples. Further, we ...

View PDFchevron_right
Introduction to the special issue on “Semantic Multimedia”
Raphael Troncy

Web Semantics: Science, Services and Agents on the World Wide Web, 2008

It is the target of this special issue to collect and report on recent work that aims at narrowing the large disparity between the low-level descriptors that can be computed automatically from multimedia content and the richness and subjectivity of semantics in user queries and human interpretations of audiovisual media -the so-called Semantic Gap.

View PDFchevron_right
Knowledge representation for semantic multimedia content analysis and reasoning
Siegfried Handschuh

Proc. of the European …, 2004

View PDFchevron_right
Multimedia Annotation using Semantic Web Technologies
Gordan Gledec

Due to the progressively increasing amount of multimedia on the Web, the need for efficient metadata formats describing that content has become increasingly evident. This paper gives an overview of the different approaches and methods for creation and retrieval of semantic rich multimedia metadata. Semantic web and its most important technologies XML, RDF and ontologies used for multimedia annotation are defined. An overview of various multimedia metadata vocabularies and formats that vary in their size and purpose is provided. Multimedia metadata is a type of metadata used for describing different aspects of multimedia content. All formats of multimedia metadata are not compatible with each other and most of it do not provide enough semantics. New Semantic Web technologies provide well-defined information meaning so different multimedia metadata can be more easily processed by computers.

View PDFchevron_right
Multimedia analysis and annotation requirements for the semantic web
Giorgos Stoilos

2005

Abstract The Semantic Web is about adding formal structure and explicit semantics to web content for the purpose of more efficient information management and access by both humans and computers. Through the use of machine understandable semantics, web resources become much easier and more readily accessible. Populating the Semantic Web with multimedia metadata requires for appropriate technologies to support both the analysis (metadata extraction) and the annotation (metadata creation) processes.

View PDFchevron_right
Multimedia data semantics: guest editors introduction
Raphael Troncy

Multimedia Tools and Applications, 2012

In the last decade, substantial progress has been made in multimedia creation, transmission, presentation and analysis to facilitate the development of large-scale multimedia information systems. Together with the maturation and deployment of semantic web technologies, it is now possible to build a new generation of multimedia applications that enables large-scale semantic representation, analysis, and delivery of multimedia data from heterogeneous data sources. However, there is still a long way to go for mature solutions of multimedia database systems that are capable of processing semantics-rich, large-volume of multimedia data. It could be even more challenging if such systems are under stringent functional and nonfunctional (e.g., QoS) requirements.

View PDFchevron_right
Trends in Managing Multimedia Semantics
Lambrini Seremeti

International Journal of Wireless Networks and Broadband Technologies, 2014

This paper reviews various efforts to define and capture the semantics of multimedia data. These efforts are particularly relevant to the problem of storing, managing and querying the semantic content of such data. Since there is not yet an accepted solution to the problem of how to represent, organize and manage multimedia data and the related semantics by means of a formal framework, this paper aims at providing some major research trends in this area. The focus is on ontologies, which allow the exchange of semantics of multimedia content between distributed information systems. This paper aims at reporting on recent trends in the development of multimedia ontologies.

View PDFchevron_right
Adding multimedia to the semantic web-building an mpeg-7 ontology
Jane Hunter

International Semantic Web Working Symposium (SWWS), 2001

For the past two years the Moving Pictures Expert Group (MPEG), a working group of ISO/IEC, have been developing , the "Multimedia Content Description Interface", a standard for describing multimedia content. The goal of this standard is to develop a rich set of standardized tools to enable both humans and machines to generate and understand audiovisual descriptions which can be used to enable fast efficient retrieval from digital archives (pull applications) as well as filtering of streamed audiovisual broadcasts on the Internet (push applications). MPEG-7 is intended to describe audiovisual information regardless of storage, coding, display, transmission, medium, or technology. It will address a wide variety of media types including: still pictures, graphics, 3D models, audio, speech, video, and combinations of these (e.g., multimedia presentations). MPEG-7 is due for completion in October 2001. At this stage MPEG-7 definitions (description schemes and descriptors) are expressed solely in XML Schema . XML Schema has been ideal for expressing the syntax, structural, cardinality and datatyping constraints required by MPEG-7. However it has become increasingly clear that in order to make MPEG-7 accessible, re-usable and interoperable with other domains then the semantics of the MPEG-7 metadata terms also need to be expressed in an ontology using a machine-understandable language. This paper describes the trials and tribulations of building such an ontology represented in RDF Schema and demonstrates how this ontology can be exploited and reused by other communities on the semantic web (such as TV-Anytime [6], , NewsML [8], museum, educational and geospatial domains) to enable the inclusion and exchange of multimedia content through a common understanding of the associated MPEG-7 multimedia content descriptions. • A Description Definition Language (DDL) to allow the creation of new Description Schemes and, possibly, Descriptors and to allows the extension and modification of existing Description Schemes; • System tools, to support multiplexing of descriptions, synchronization of descriptions with content, transmission mechanisms and coded representations (both textual and binary formats) for efficient storage and transmission, management and protection of intellectual property in MPEG-7 descriptions. XML Schema language has been chosen as the DDL [9] for specifying MPEG-7 descriptors and description schemes because of its ability to express the syntactic, structural, cardinality and datatyping constraints required by MPEG-7 and because it also provides the necessary mechanisms for extending and refining existing DSs and Ds. However it has recently become increasingly clear that there is also a need for a machine-understandable representation of the semantics associated with MPEG-7 DSs and Ds to enable the interoperability and integration of MPEG-7 with metadata descriptions from other domains. New metadata initiatives such as TV-Anytime [6], MPEG-21 [7], NewsML , and communities such as the museum, educational, medical and geospatial communities, want to combine MPEG-7 multimedia descriptions with new and existing metadata standards for simple resource discovery (Dublin Core [10]), rights management (INDECS [11]), geospatial (FGDC [12]), educational (GEM [13], IEEE LOM ) and museum (CIDOC CRM ) content, to satisfy their domain-specific requirements. In order to do this, there needs to be a common understanding of the semantic relationships between metadata terms from different domains. XML Schema provides little support for expressing semantic knowledge. RDF Schema provides us with a way to do this. The Resource Description Framework (RDF) is the accepted language of the semantic web due to its ability to express semantics and semantic relationships through class and property hierarchies. In this paper, we investigate the feasibility of expressing the semantics of MPEG-7 Descriptors (Ds) and Description Schemes (DSs) in an RDF Schema ontology. An earlier paper evaluated RDF Schema for video metadata representation (prior to the development of MPEG-7) and determined a number of limitations . In this paper we hope to ascertain whether those limitations still exist when representing the semantics of MPEG-7 DSs and Ds or whether they can be overcome -either by using the extra constraints provided by DAML+OIL [17] or through combining RDF Schema semantics with XML Schema encoding specifications in a complementary manner. Whilst manually building the RDF Schema for a core subset of MPEG-7, we also hope to be able to recognize patterns and hence determine automatic mechanisms for generating compatible RDF Schema definitions corresponding to the complete set of MPEG-7 XML Schema definitions. In Section 2 we describe the methodology, problems encountered and results of building an RDF Schema ontology for MPEG-7. In Section 3 we describe how the RDF Schema semantic definitions for MPEG-7 can be linked to their corresponding pre-existing XML Schema definitions (or recommended encodings). In Section 4 we describe how the MPEG-7 RDF Schema can be merged with RDF schemas from other domains to generate a single "super-ontology" called MetaNet. Expressed in DAML+OIL , MetaNet can be used to provide common semantic understanding between domains. Finally we illustrate how this super-ontology can be used to enable the co-existence of interoperability, extensibility and diversity within metadata descriptions generated by integrating metadata terms from different domains.

View PDFchevron_right

References (101)

  1. Adali, S., Sapino, M.L., Subrahmanian, V.S.: An algebra for creating and querying multimedia presentations. Multimedia Syst. 8(3), 212-230 (2000)
  2. Ahern, S., Naaman, M., Nair, R., Yang, J.H.-I.: World explorer: visualizing aggre- gate data from unstructured text in geo-referenced collections. In: Proceedings of the 7th ACM/IEEE joint conference on Digital libraries, pp. 1-10. ACM Press, New York (2007)
  3. Arndt, R., Troncy, R., Staab, S., Hardman, L., Vacura, M.: COMM: Designing a Well-Founded Multimedia Ontology for the Web. In: 6th Int. Semantic Web Conference (2007)
  4. Blöhdorn, S., Petridis, K., Saathoff, C., Simou, N., Tzouvaras, V., Avrithis, Y., Handschuh, S., Kompatsiaris, Y., Staab, S., Strintzis, M.: Semantic Annotation of Images and Videos for Multimedia Analysis. In: 2nd European Semantic Web Conference (2005)
  5. Brunelli, R., Poggio, T.: Template matching: Matched spatial filters and beyond. Pattern Recognition 30(5), 751-768 (1997)
  6. Brusilovsky, P., Maybury, M.T.: From adaptive hypermedia to the adaptive Web. Communications of the ACM 45(5), 30-33 (2002)
  7. Chen, H., Shimshoni, I., Meer, P.: Model based object recognition by robust in- formation fusion. In: 17th International Conference on Pattern Recognition, Cam- brige, UK (August 2004)
  8. Christianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines. Cambridge University Press, Cambridge (2000)
  9. Cortes, C., Vapnik, V.N.: Support vector networks. Machine Learning 20, 273-297 (1995)
  10. Dey, A.K., Abowd, G.D.: Towards a Better Understanding of Context and Context- Awareness. Technical Report GIT-GVU-99-22, Graphics, Visualization and Usabil- ity Center and College of Computing, Georgia Institute of Technology, Atlanta, GA, USA (June 1999)
  11. Ding, D., Yang, J., Li, Q., Liu, W., Wang, L.: What can expressive semantics tell: Retrieval model for a flash-movie search engine. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 123-133. Springer, Heidelberg (2005)
  12. Eco, U.: Einfuehrung in die Semiotik. Wilhelm Fink Verlag, Munich (1985)
  13. Falkovych, K., Nack, F.: Context Aware Guidance for Multimedia Authoring: Har- monizing domain and discourse knowledge. Multimedia Systems Journal 11(3) (2006)
  14. Falkovych, K., Nack, F., van Ossenbruggen, J., Rutledge, L.: Sample: Towards a framework for system-supported multimedia authoring. In: Multimedia Modelling, p. 362. IEEE Computer Society, Los Alamitos (2004)
  15. Fink, J., Kobsa, A., Schreck, J.: Personalized hypermedia information through adaptive and adaptable system features: User modeling, privacy and security issues. In: Mullery, A., Besson, M., Campolargo, M., Gobbi, R., Reed, R. (eds.) Intelligence in Services and Networks: Technology for Cooperative Competition, pp. 459-467.
  16. Springer, Heidelberg (1997)
  17. Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. In: Readings in multimedia computing and net- working, pp. 255-264. Morgan Kaufmann, San Francisco (2001)
  18. Gangemi, A., Borgo, S., Catenacci, C., Lehmann, J.: Task Taxonomies for Knowl- edge Content. Technical report, Metokis Deliverable 7, (2004)
  19. Gangemi, A., Guarino, N., Masolo, C., Oltramari, A., Schneider, L.: Sweetening ontologies with dolce. In: Gómez-Pérez, A., Benjamins, V.R. (eds.) EKAW 2002. LNCS (LNAI), vol. 2473, pp. 166-181. Springer, Heidelberg (2002)
  20. Garcia, R., Celma, O.: Semantic Integration and Retrieval of Multimedia Meta- data. In: 5th International Workshop on Knowledge Markup and Semantic Anno- tation (2005)
  21. García, R., Gil, R.: Facilitating Business Interoperability from the Semantic Web. In: Abramowicz, W. (ed.) BIS 2007. LNCS, vol. 4439, pp. 220-232. Springer, Hei- delberg (2007)
  22. Garcia, R., Gil, R., Delgado, J.: A Web Ontologies Framework for Digital Rights Management. Journal of Artificial Intelligence and Law 15, 137-154 (2007)
  23. Gemmell, J., Bell, G., Lueder, R.: Mylifebits: a personal database for everything. Commun. ACM 49(1), 88-95 (2006)
  24. Gemmell, J., Williams, L., Wood, K., Lueder, R., Bell, G.: Passive capture and ensuing issues for a personal lifetime store. In: Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences, pp. 48-55. ACM Press, New York (2004)
  25. Geurts, J., van Ossenbruggen, J., Hardman, L.: Application-specific constraints for multimedia presentation generation. In: Multimedia Modeling. IEEE, Los Alamitos (2001)
  26. Geurts, J., van Ossenbruggen, J., Hardman, L.: Requirements for practical multi- media annotation. In: Workshop on Multimedia and the Semantic Web (2005)
  27. Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Prentice Hall, Englewood Cliffs (2001)
  28. Gräßl, C., Deinzer, F., Nieman, H.: Continuous parametrization of normal distri- bution for improving the discrete statistical eigenspace approach for object recog- nition. In: Krasnoproshin, V., Ablameyko, S., Soldek, J. (eds.) Pattern Recognition and Information Processing 2003, Minsk, Belarus, May 2003, pp. 73-77 (2003)
  29. Grzegorzek, M., Izquierdo, E.: Statistical 3d object classification and localization with context modeling. In: Domanski, M., Stasinski, R., Bartkowiak, M. (eds.) 15th European Signal Processing Conference, pp. 1585-1589. PTETiS, Poznan (2007)
  30. Halasz, F., Schwartz, M.: The Dexter Hypertext Reference Model. Communications of the ACM 37(2), 30-39 (1994)
  31. Harth, A., Umbrich, J., Hogan, A., Decker, S.: Yars2: A federated repository for searching and querying graph structured data. Technical report, Digital Enterprise Research Institute, Galway, 4 (2007)
  32. Hornegger, J.: Statistische Modellierung, Klassifikation und Lokalisation von Ob- jekten. Shaker Verlag, Aachen (1996)
  33. Hunter, J.: Adding Multimedia to the Semantic Web -Building an MPEG-7 Ontol- ogy. In: 1st International Semantic Web Working Symposium, pp. 261-281 (2001)
  34. Hunter, J.: Combining the CIDOC/CRM and MPEG-7 to Describe Multimedia in Museums. In: 6th Museums and the Web Conference (2002), http://www. archimuse.com/mw2002/papers/hunter/hunter.html
  35. Hunter, J.: Enhancing the semantic interoperability of multimedia through a core ontology. IEEE Transactions on Circuits and Systems for Video Technology 13(1), 49-58 (2003)
  36. Hunter, J., Armstrong, L.: A Comparison of Schemas for Video Metadata Repre- sentation. In: 8th International World Wide Web Conference, pp. 1431-1451 (1999)
  37. Hunter, J., Little, S.: A Framework to Enable the Semantic Inferencing and Query- ing of Multimedia Content. International Journal of Web Engineering and Tech- nology -Special Issue on the Semantic Web 2(2/3), 264-286 (2005)
  38. Isaac, A., Troncy, R.: Designing and Using an Audio-Visual Description Core On- tology. In: Workshop on Core Ontologies in Ontology Engineering (2004)
  39. Kang, H., Shneiderman, B.: Visualization methods for personal photo collections: Browsing and searching in the photofinder. In: IEEE International Conference on Multimedia and Expo (III), pp. 1539-1542 (August 2000)
  40. Kerr, J., Compton, P.: Toward generic model-based object recognition by knowl- edge acquisition and machine learning. In: Proceedings of the Eighteenth Inter- national Joint Conference on Artificial Intelligence, Acapulco, Mexico, pp. 9-15 (2003)
  41. King, R., Popitsch, N., Westermann, U.: METIS: a flexible database foundation for unified media management. In: Proc.of the 12th annual ACM Int. Conf. on Multimedia, pp. 744-745. ACM Press, New York (2004)
  42. Kobsa, A., Koenemann, J., Pohl, W.: Personalized Hypermedia Presentation Tech- niques for Improving Online Customer Relationships. In: The Knowledge Engineer- ing Review, vol. 16, pp. 111-155. Cambridge University Press, Cambridge (2001)
  43. Kochut, K., Janik, M.: Sparqler: Extended sparql for semantic association discov- ery. In: Franconi, E., Kifer, M., May, W. (eds.) ESWC 2007. LNCS, vol. 4519, pp. 145-159. Springer, Heidelberg (2007)
  44. Lagoze, C., Hunter, J.: The ABC Ontology and Model (v3.0). Journal of Digital Information 2(2) (2001)
  45. Latecki, L.J., Lakaemper, R., Wolter, D.: Optimal partial shape similarity. Image and Vision Computing Journal 23, 227-236 (2005)
  46. Lee, B.N., Chen, W., Chang, E.Y.: Fotofiti: web service for photo management. In: Proceedings of the 14th annual ACM international conference on Multimedia, pp. 485-486. ACM Press, New York (2006)
  47. Lee, T., Sheng, L., Balkir, N.H., Al-Hamdani, A., Özsoyoglu, G., Özsoyoglu, Z.M.: Query Processing Techniques for Multimedia Presentations. Multimedia Tools Appl. 11(1), 63-99 (2000)
  48. Lee, T., Sheng, L., Bozkaya, T., Balkir, N.H., Özsoyoglu, Z.M., Özsoyoglu, G.: Querying Multimedia Presentations Based on Content. IEEE Trans. on Knowledge and Data Engineering 11(3), 361-385 (1999)
  49. Leonardis, A., Bischof, H.: Dealing with occlusions in the eigenspace approach. In: Pelillo, M., Hancock, E.R. (eds.) EMMCVPR 1997. LNCS, vol. 1223, pp. 453-458.
  50. Springer, Heidelberg (1997)
  51. Moghaddam, B., Pentland, A.: Probabilistic visual learning for object representa- tion. PAMI 19(7), 696-710 (1997)
  52. Mokhtarian, F., Bober, M.: Curvature Scale Space Representation: Theory, Appli- cations, and MPEG7-Standardization. Springer, Heidelberg (2003)
  53. MPEG-21. Part 17: Fragment Identification of MPEG Resources. Standard No. ISO/IEC 21000-17 (2006)
  54. MPEG-7. Multimedia Content Description Interface. Standard No. ISO/IEC 15938 (2001)
  55. Murase, H., Nayar, S.K.: Visual learning and recognition of 3-d objects from ap- pearance. International Journal of Computer Vision 14(1), 5-24 (1995)
  56. Naaman, M., Yeh, R.B., Garcia-Molina, H., Paepcke, A.: Leveraging context to resolve identity in photo albums. In: Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, pp. 178-187. ACM Press, New York (2005)
  57. Nack, F.: AUTEUR: The Application of Video Semantics and Theme Representa- tion for Automated Film Editing. PhD thesis, Lancaster University, UK (Septem- ber 1996)
  58. Nack, F., Hardman, L.: Denotative and connotative semantics in hypermedia: pro- posal for a semiotic-aware architecture. New Rev. Hypermedia Multimedia 7(1), 7-37 (2002)
  59. Nack, F., Lindsay, A.T.: Everything you wanted to know about MPEG-7 (Parts I & II). IEEE Multimedia 6(3-4) (1999)
  60. Nack, F., van Ossenbruggen, J., Hardman, L.: That Obscure Object of Desire: Multimedia Metadata on the Web (Part II). IEEE Multimedia 12(1) (2005)
  61. Neumann, B., Möller, R.: On Scene Interpretation with Description Logics. In: Cognitive Vision Systems, pp. 247-275. Springer, Heidelberg (2006)
  62. Niemann, H.: Klassifikation von Mustern. Springer, Heidelberg (1983)
  63. Oberle, D., Lamparter, S., Grimm, S., Vrandecic, D., Staab, S., Gangemi, A.: Towards Ontologies for Formalizing Modularization and Communication in Large Software Systems. Journal of Applied Ontology 1(2), 163-202 (2006)
  64. Sirma Group Corp Ontotext Lab. Bigowlim: System documentation (2006) [15-05- 2008], http://www.ontotext.com/owlim/big/BigOWLIMSysDoc.pdf
  65. van Ossenbruggen, J., Nack, F., Hardman, L.: That Obscure Object of Desire: Multimedia Metadata on the Web (Part I). IEEE Multimedia 11(4) (2004)
  66. Park, S., Lee, J., Kim, S.: Content-based image classification using a neural net- work. Pattern Recognition Letters 25(3), 287-300 (2004)
  67. Paulus, D., Hornegger, J.: Applied Pattern Recognition. Friedr. Vieweg & Sohn Verlagsgesellschaft GmbH, Braunschweig (2003)
  68. Pease, A., Niles, I., Li, J.: The Suggested Upper Merged Ontology: A Large Ontol- ogy for the Semantic Web and its Applications. In: Working Notes of the AAAI- 2002 Workshop on Ontologies and the Semantic Web (2002)
  69. Polleres, A., Scharffe, F., Schindlauer, R.: Sparql++ for mapping between rdf vo- cabularies. In: OTM Conferences (1), pp. 878-896 (2007)
  70. Polydoros, P., Tsinaraki, C., Christodoulakis, S.: GraphOnto: OWL-based ontology management and multimedia annotation in the DS-MIRF framework. Journal of Digital Information Management (JDIM) 4(4), 214-219 (2006)
  71. Popper, K.: Three worlds [the tanner lecture on human values: Delivered at the university of michigan], April (1978), http://www.tannerlectures.utah.edu/ lectures/documents/popper80.pdf
  72. Pösl, J.: Erscheinungsbasierte, statistische Objekterkennung. Shaker Verlag, Aachen (1999)
  73. Pratt, W.K.: Digital Image Processing. John Wiley & Sons Ltd., New York (2001)
  74. Reinhold, M.: Robuste, probabilistische, erscheinungsbasierte Objekterkennung. Logos Verlag, Berlin (2004)
  75. Ross, K., Westermann, G.U., Popitsch, N.: METIS -A Flexible Database Solution for the Management of Multimedia Assets. In: Proc. of the 10th Int. Workshop on Multimedia Information Systems, College Park, MD, USA (August 2004)
  76. Saathoff, C., Staab, S.: Exploiting Spatial Context in Images Using Fuzzy Con- straint Reasoning. In: 9th Int. Workshop on Image Analysis for Multimedia Inter- active Services, Klagenfurt, Austria. IEEE, Los Alamitos (2008)
  77. Schenk, S., Staab, S.: Networked graphs: A declarative mechanism for sparql rules, sparql views and rdf data integration on the web. In: Proceedings of the 17th International World Wide Web Conference, WWW2008, Bejing, China (2008)
  78. Scherp, A., Agaram, S., Jain, R.: Event-centric media management. In: Gevers, T., Jain, R.C., Santini, S. (eds.) Multimedia Content Access: Algorithms and Systems II. Proceedings of the SPIE Society of Photo-Optical Instrumentation Engineers (SPIE) Conference, vol. 6820, pp. 68200C-68200C-15 (January 2008)
  79. Scherp, A.: Semantics support for personalized multimedia content. In: Int. Conf. Internet and Multimedia Systems and Applications, Innsbruck, Austria, March 2008, pp. 57-65. IASTED (2008)
  80. Scherp, A., Boll, S., Cremer, H.: Emergent semantics in personalized multimedia content. J. of Digital Information Management 5(2) (April 2007)
  81. Scherp, A., Jain, R.: Towards an ecosystem for semantics. In: MS 2007: Workshop on multimedia information retrieval on The many faces of multimedia semantics, pp. 3-12. ACM Press, New York (2007)
  82. Schilit, B., Adams, N., Want, R.: Context-Aware Computing Applications. In: Workshop on Mobil Computing Systems and Applications, Santa Cruz, CA, USA, pp. 85-90. IEEE, Los Alamitos (1994)
  83. Schmidt, A., Beigl, M., Gellersen, H.-W.: There is more to context than location. Computers & Graphics 23(6), 893-901 (1999)
  84. Schueler, B., Sizov, S., Staab, S., Tran, D.T.: Querying for meta knowledge. In: WWW 2008: Proceeding of the 17th international conference on World Wide Web, pp. 625-634. ACM, New York (2008)
  85. Shneiderman, B., Kang, H.: Direct annotation: A drag-and-drop strategy for la- beling photos. In: Proceedings of the International Conference on Information Vi- sualisation, p. 88. IEEE Computer Society, Washington (2000)
  86. Straccia, U.: Managing Uncertainty and Vagueness in Description Logics, Logic Programs and Description Logic Programs. Springer, Heidelberg (2008)
  87. Sure, Y., Staab, S., Studer, R.: Methodology for development and employment of ontology based knowledge management applications. SIGMOD Rec. 31(4), 18-23 (2002)
  88. Tadeusiewicz, R.: Introduction to Practice of Application of Neural Networks (in Neuron Networks) StatSoft, Warsaw, Poland (1999)
  89. Troncy, R.: Integrating Structure and Semantics into Audio-visual Documents. In: 2nd International Semantic Web Conference, pp. 566-581 (2003)
  90. Troncy, R., Bailer, W., Hausenblas, M., Hofmair, P., Schlatte, R.: Enabling Multi- media Metadata Interoperability by Defining Formal Semantics of MPEG-7 Pro- files. In: 1st International Conference on Semantics And digital Media Technology, pp. 41-55 (2006)
  91. Troncy, R., Celma, Ó., Little, S., García, R., Tsinaraki, C.: MPEG-7 based Mul- timedia Ontologies: Interoperability Support or Interoperability Issue? In: 1st In- ternational Workshop on Multimedia Annotation and Retrieval enabled by Shared Ontologies, pp. 2-15 (2007)
  92. Troncy, R., Hardman, L., van Ossenbruggen, J., Hausenblas, M.: Identifying Spatial and Temporal Media Fragments on the Web. In: W3C Video on the Web Workshop (2007), http://www.w3.org/2007/08/video/positions/Troncy.pdf
  93. Tsinaraki, C., Christodoulakis, S.: Interoperability of XML Schema Applications with OWL Domain Knowledge and Semantic Web Tools. In: 6th International Conference on Ontologies, DataBases, and Applications of Semantics (ODBASE) (2007)
  94. Tsinaraki, C., Polydoros, P., Christodoulakis, S.: Interoperability support for Ontology-based Video Retrieval Applications. In: 3rd International Conference on Image and Video Retrieval (CIVR), pp. 582-591 (2004)
  95. Tsinaraki, C., Polydoros, P., Christodoulakis, S.: Interoperability support between MPEG-7/21 and OWL in DS-MIRF. Transactions on Knowledge and Data Engi- neering (TKDE) 19(2), 219-232 (2007) (Special Issue on the Semantic Web Era)
  96. Turk, M., Pentland, A.: Face recognition using eigenfaces. In: Conference on Com- puter Vision and Pattern Recognition, Maui, USA, pp. 586-591 (June 1991) 95.
  97. van Ossenbruggen, J., Hardman, L., Geurts, J., Rutledge, L.: Towards a multimedia formatting vocabulary. In: World Wide Web. ACM, New York (2003)
  98. Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (1995)
  99. Walter, J., Arnrich, B.: Gabor filters for object localization and robot grasp- ing. In: Proceedings of the 15th International Conference on Pattern Recognition, Barcelona, Spain, September 2000. ICSP, pp. 124-127 (2000)
  100. Westermann, U., Jain, R.: Toward a common event model for multimedia applica- tions. IEEE MultiMedia 14(1), 19-29 (2007)
  101. Yuan, C., Niemann, H.: Neural networks for the recognition and pose estimation of 3-d objects from a single 2-d perspective view. International Journal of Image and Vision Computing 19, 585-592 (2001)

Related papers

Semantic Modeling of Digital Multimedia
Raphael Attias

Citeseer

- The requirement for a commonly accepted efficient mapping between multimedia metadata standards and semantic web-ontology standards is a major issue recognized by semantic multimedia research community. Though there have been several attempts to translate MPEG-7 ...

View PDFchevron_right
A framework to enable the semantic inferencing and querying of multimedia content
Jane Hunter

International Journal of Web Engineering and Technology, 2005

Cultural institutions, broadcasting companies, academic, scientific and defence organisations are producing vast quantities of digital multimedia content. With this growth in audiovisual material comes the need for standardised representations encapsulating the rich semantic meaning required to enable the automatic filtering, machine processing, interpretation and assimilation of multimedia resources. Additionally generating high-level descriptions is difficult and manual creation is expensive although significant progress has been made in recent years on automatic segmentation and low-level feature recognition for multimedia. Within this paper we describe the application of semantic web technologies to enable the generation of high-level, domain-specific, semantic descriptions of multimedia content from low-level, automatically-extracted features. By applying the knowledge reasoning capabilities provided by ontologies and inferencing rules to large, multimedia data sets generated by scientific research communities, we hope to expedite solutions to the complex scientific problems they face.

View PDFchevron_right
Ontology For Multimedia Applications
Hiranmay Ghosh

This paper provides an overview of the contents of a tutorial on the subject by one of the authors at WI-2013 Conference. The domination of multimedia contents on the web in recent times has motivated research in their semantic analysis. This tutorial aims to provide a critical overview of the technology, and focuses on application of ontologies for multimedia applications. It establishes the need for a fundamentally different approach for a representation and reasoning scheme with ontologies for semantic interpretation of multimedia contents. It introduces a new ontology representation scheme that enables reasoning with uncertain media properties of concepts in a domain context and a language "Multimedia Web Ontology Language" (MOWL) to support the representation scheme. We discuss the approaches to semantic modeling and ontology learning with specific reference to the probabilistic framework of MOWL. We present a couple of illustrative application examples. Further, we discuss the issues of distributed multimedia information systems and how the new ontology representation scheme can create semantic interoperability across heterogeneous multimedia data sources.

View PDFchevron_right
Multimedia Annotations on the Semantic Web
Ari Schreiber

IEEE Multimedia, 2006

Multimedia and the Semantic Web: in theory, it is a perfect match. The Semantic Web, on the one hand, provides a stack of languages and technologies for annotating Web resources, enabling machine processing of metadata describing semantics of web content. Multimedia applications, on the other hand, require metadata descriptions of their media items to facilitate search and retrieval, intelligent processing and effective presentation of multimedia information. This need for multimedia metadata was recognized by the media industry long ago. Semantic Web technologies, however, still play a very minor role within multimedia applications and most approaches employ non-RDF based techniques. This paper describes a number of current approaches to multimedia metadata and provides an inventory of the open issues to achieve a practical integration of multimedia metadata into the Semantic Web.

View PDFchevron_right
Semantic abstractions in the multimedia domain
Thanasis Hadzilacos

IEEE Transactions on Knowledge and Data Engineering, 2003

Information searching by exactly matching content is traditionally a strong point of machine searching; this is not, however, how human memory works and is rarely satisfactory for advanced retrieval tasks in any domain-multimedia in particular, where the presentational aspects can be equally important to the semantic information content. A combined abstraction of the conceptual and presentational characteristics of multimedia applications, leading on the one hand to their conceptual structure (with classic semantics of the real-world modeled by entities, relationships, and attributes) and on the other to the presentational structure (including media type, logical structure, temporal synchronization, spatial (on the screen) "synchronization" and interactive behavior) is developed in this paper. Multimedia applications are construed as consisting of "Presentational Units:" elementary (a media object with play duration and screen position), and composite (recursive structures of PUs in the temporal, spatial, and logical dimensions). The fundamental concept introduced is that of Semantic Multimedia Abstractions (SMA): qualitative abstract descriptions of multimedia applications in terms of their conceptual and presentational properties at an adjustable level of abstraction. SMAs, which could be viewed as metadata, form an abstract space to be queried. A detailed study of possible abstractions (from multimedia applications to SMAs and SMA-to-SMA), a definition and query language for Semantic Multimedia Abstractions (SMA-L) and the corresponding SMA model (equivalent to extended OMT), as well as an implementation of a system capable of wrapping the presentational structure of XML-based documents complete this work, whose contribution lays in the classically fruitful boundary between AI, software engineering, and database research.

View PDFchevron_right

Related topics

  • Computer Science
  • Social Semantic Web
  • Semantic Computing
  • Semantic Analytics
  • Semantic Grid
  • Semantic Description
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved