Abstract
Annotation support in interactive systems is often considered a simple task by the CG community, since it entails the apparently easy selection of a region and to connect it with some information. The reality appears more complex. The scope of this paper is twofold: first, to review the status of this domain, discussing and characterizing several approaches proposed in literature to manage annotations over geometric models; second, to present in detail an innovative solution proposed and assessed in the framework of Cultural Heritage (CH) applications, called ClippingVolumes. At the annotation definition stage ClippingVolumes uses 3D data to characterize the annotation region; subsequently, annotations are visualized by adopting a two-pass rendering solution which uses stencil buffers, thus without introducing new geometric elements, changing the topology or duplicating geometry elements. It solves most of the issues that afflict the current state of the art, such as: fragmentation; annotation transfer to multiple representations; and enabling to annotate multi-resolution data encoding. The latter is a mandatory requirement to produce efficient web-based systems. We implemented and we fully tested this approach in the framework of a complex system that supports the documentation of CH restoration projects.
References (41)
- M., AGUGIARO G., BILLEN N., LOOS L., ZIPF A.: Web-based Visualization and Query of semantically seg- mented multiresolution 3D Models in the Field of Cultural Her- itage. ISPRS Annals of Photogrammetry, Remote Sensing and Spa- submitted to COMPUTER GRAPHICS Forum (6/2018). tial Information Sciences (May 2014), 33-39. doi:10.5194/ isprsannals-II-5-33-2014. 1, 3 [ABC * 18] APOLLONIO F. I., BASILISSI V., CALLIERI M., DELLEPI- ANE M., GAIANI M., PONCHIO F., RIZZO F., RUBINO A. R., SCOPIGNO R., SOBRA G.: A 3d-centered information system for the documentation of a complex restoration intervention. J. of Cult. Herit. 29 (2018), 89-99. 1, 2, 3, 5, 9, 10, 11, 12
- ATTENE M., ROBBIANO F., SPAGNUOLO M., FALCIDIENO B.: Part-based annotation of virtual 3d shapes. In Cyberworlds, 2007. CW'07. International Conference on (2007), IEEE, pp. 427-436. 1, 10
- ATTENE M., ROBBIANO F., SPAGNUOLO M., FALCIDIENO B.: Semantic annotation of 3d surface meshes based on feature charac- terization. In Semantic Multimedia (Second Int. Conf. on Semantic and Digital Media Technologies, SAMT 2007) (2007), Springer LNCS 4816, pp. 126-139. 1, 3, 11
- ATTENE M., ROBBIANO F., SPAGNUOLO M., FALCIDIENO B.: Characterization of 3d shape parts for semantic annotation. Computer-Aided Design 41, 10 (2009), 756 -763. Selected Papers from the 2007 New Advances in Shape Analysis and Geometric Mod- eling Workshop. doi:http://dx.doi.org/10.1016/j.cad. 2009.01.003. 11
- BANERJEE I., CATALANO C. E., PATANÉ G., SPAGNUOLO M.: Semantic annotation of 3d anatomical models to support diagno- sis and follow-up analysis of musculoskeletal pathologies. International Journal of Computer Assisted Radiology and Surgery 11, 5 (May 2016), 707-720. doi:10.1007/s11548-015-1327-6. 2, 4, 6
- CFG * 15] CHANG A. X., FUNKHOUSER T. A., GUIBAS L. J., HAN- RAHAN P., HUANG Q.-X., LI Z., SAVARESE S., SAVVA M., SONG S., SU H., XIAO J., YI L., YU F.: Shapenet: An information-rich 3d model repository. CoRR abs/1512.03012 (2015). 1, 3, 11
- CGG * 05] CIGNONI P., GANOVELLI F., GOBBETTI E., MARTON F., PONCHIO F., SCOPIGNO R.: Batched multi triangulation. In Proceed- ings IEEE Visualization (Conference held in Minneapolis, MI, USA, Oc- tober 2005), IEEE Computer Society Press, pp. 207-214. 8
- CAMPANARO D. M., LANDESCHI G., DELLÂ Ȃ ŹUNTO N., TOUATI A.-M. L.: 3d gis for cultural heritage restoration: A â ȂŸwhite boxâ Ȃ Ź workflow. Journal of Cultural Heritage 18, Supplement C (2016), 321 -332. URL: http://www.sciencedirect.com/ science/article/pii/S1296207415001582, doi:https: //doi.org/10.1016/j.culher.2015.09.006. 7
- DOERR M.: The cidoc conceptual reference module: An onto- logical approach to semantic interoperability of metadata. AI Mag. 24, 3 (Sept. 2003), 75-92. 11
- DOERR M., ORE C.-E., STEAD S.: The CIDOC Conceptual Reference Model: A new standard for knowledge sharing. In Tutori- als, Posters, Panels and Industrial Contributions at the 26th Interna- tional Conference on Conceptual Modeling -Volume 83 (Darlinghurst, Australia, Australia, 2007), ER '07, Australian Computer Society, Inc., pp. 51-56. URL: http://dl.acm.org/citation.cfm?id= 1386957.1386963. 11
- ETG * 12] ECHAVARRIA K. R., THEODORIDOU M., GEORGIS C., ARNOLD D., DOERR M., STORK A., SERNA S. P.: Semantically Rich 3D Documentation for the Preservation of Tangible Heritage. In VAST: International Symposium on Virtual Reality, Archaeology and In- telligent Cultural Heritage (2012), Arnold D., Kaminski J., Niccolucci F., Stork A., (Eds.), The Eurographics Association. doi:10.2312/ VAST/VAST12/041-048. 11
- EVERITT, CASS AND KILGARD, MARK J. : Robust Stenciled Shadow Volumes (Graphics/Visualization Seminar to the Center for Computational Visualization, University of Texas). URL http://www.cs.dartmouth.edu/~spl/Academic/
- FOLEY J., KWAN P., WELCH M.: A web-based infrastructure for the assisted annotation of heritage collections. J. Comput. Cult. Herit. 10, 3 (July 2017), 14:1-14:25. doi:10.1145/3012287. 3
- GOLDFEDER C., ALLEN P.: Autotagging to improve text search for 3d models. In Proceedings of the 8th ACM/IEEE-CS Joint Confer- ence on Digital Libraries (New York, NY, USA, 2008), JCDL '08, ACM, pp. 355-358. doi:10.1145/1378889.1378950. 1
- HUNTER J., GERBER A.: Harvesting community annotations on 3d models of museum artefacts to enhance knowledge, discovery and re- use. Journal of Cultural Heritage 11, 1 (2010), 81 -90. doi:http: //dx.doi.org/10.1016/j.culher.2009.04.004. 3, 11
- HOPPE H.: Progressive meshes. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques (1996), ACM, pp. 99-108. 8
- HSB * 09] HAVEMANN S., SETTGAST V., BERNDT R., EIDE O., FELL- NER D. W.: The arrigo showcase reloaded—towards a sustain- able link between 3d and semantics. ACM J. Computing and Cul- tural Heritage 2, 1 (July 2009), 4:1-4:13. URL: http://doi.acm. org/10.1145/1551676.1551680, doi:10.1145/1551676. 1551680. 11
- KALOGERAKIS E., HERTZMANN A., SINGH K.: Learning 3d mesh segmentation and labeling. ACM Trans. Graph. 29, 4 (July 2010), 102:1-102:12. doi:10.1145/1778765.1778839. 1
- M., TSIPIDIS
- S., KOTSAKIS
- K., KOUSOULAKOU A.: A 3d digital workflow for archaeological intra-site research using gis. Journal of Archaeological Science 35, 3 (2008), 655 -667. URL: http://www.sciencedirect. com/science/article/pii/S0305440307001069, doi:https://doi.org/10.1016/j.jas.2007.06.002.
- LUEBKE D. P.: Level of detail for 3D graphics. Morgan Kauf- mann, 2003. 8
- MANUEL A., DE LUCA L., VÉRON P.: A hybrid approach for the semantic annotation of spatially oriented images. International Journal of Heritage in the Digital Era 3, 2 (2014), 305-320. 4, 6
- MESSAOUDI T., VÃL'RON P., HALIN G., LUCA L. D.: An ontological model for the reality-based 3d annotation of her- itage building conservation state. Journal of Cultural Heritage 29 (2018), 100 -112. URL: http://www.sciencedirect.com/ science/article/pii/S1296207417304508, doi:https: //doi.org/10.1016/j.culher.2017.05.017. 11
- MANUEL A., VÃL'RON P., LUCA L. D.: 2D/3D Semantic Annotation of Spatialized Images for the Documentation and Analysis of Cultural Heritage. In Eurographics Workshop on Graphics and Cultural Heritage (2016), Catalano C. E., Luca L. D., (Eds.), The Eurographics Association. doi:10.2312/gch.20161391. 2, 4, 6
- PIETRONI N., CORSINI M., CIGNONI P., SCOPIGNO R.: An interactive local flattening operator to support digital investigations on artwork surfaces. IEEE Trans. on Visualization and Computer Graphics, 17, 12 (2011), 1989-1996. 2
- PONCHIO F., DELLEPIANE M.: Multiresolution and fast decom- pression for optimal web-based rendering. Graphical Models 88 (2016), 1 -11. doi:http://dx.doi.org/10.1016/j.gmod.2016. 09.002. 8, 9
- PENG H., LONG F., MYERS E. W.: Vano: a volume-object image annotation system. Bioinformatics 25, 5 (2009), 695-697. URL: http://dx.doi.org/10.1093/bioinformatics/btp046, arXiv:/oup/backfile/content_public/journal/ bioinformatics/25/5/10.1093_bioinformatics_ btp046/1/btp046.pdf, doi:10.1093/bioinformatics/ btp046. 3
- RODRIGUEZ-ECHAVARRIA K., MORRIS D., ARNOLD D.: Web based presentation of semantically tagged 3d content for public sculptures and monuments in the uk. In Proceedings of the 14th In- ternational Conference on 3D Web Technology (New York, NY, USA, 2009), Web3D '09, ACM, pp. 119-126. URL: http://doi.acm. org/10.1145/1559764.1559783, doi:10.1145/1559764. 1559783. 4, 11
- submitted to COMPUTER GRAPHICS Forum (6/2018).
- RONZINO P., NICCOLUCCI F., HERMON S.: A Metadata Schema for Cultural Heritage Documentation. In Electronic Imaging & the Visual Arts -EVA 2012 Florence (2012), Cappellini V., (Ed.), Firenze University Press. URL: http://digital.casalini.it/ 10.1400/187333, doi:10.1400/187333. 11
- SBJB * 14] STEFANI C., BRUNETAUD X., JANVIER-BADOSA S., BECK K., LUCA L. D., AL-MUKHTAR M.: Developing a toolkit for mapping and displaying stone alteration on a web- based documentation platform. Journal of Cultural Heritage 15, 1 (2014), 1 -9. URL: http://www.sciencedirect.com/ science/article/pii/S1296207413000630, doi:https: //doi.org/10.1016/j.culher.2013.01.011. 5, 7 [SCC * 11] SCOPIGNO R., CALLIERI M., CIGNONI P., CORSINI M., DELLEPIANE M., PONCHIO F., RANZUGLIA G.: 3d models for cultural heritage: Beyond plain visualization. Computer 44, 7 (2011), 48-55. 3
- SCHÜTZ M.: Potree: Rendering large point clouds in web browsers. Technische Universität Wien, Wiedeń (Master Thesis) (2016).
- SKA * 16] SHI W., KOTOULA E., AKOGLU K., YANG Y., RUSHMEIER H.: Cher-ob: A tool for shared analysis in cultural heritage. In Proceed- ings of the 14th Eurographics Workshop on Graphics and Cultural Her- itage (Goslar Germany, Germany, 2016), GCH '16, Eurographics Asso- ciation, pp. 187-190. doi:10.2312/gch.20161404. 6, 9, 11
- SKETCHFAB: Publish, share and discover 3D content over the web. URL https://sketchfab.com, 2014. 3
- SOLER F., MELERO F. J., LUZÓN M. V.: A complete 3d information system for cultural heritage documentation. Journal of Cultural Heritage 23, Supplement C (2017), 49 -57. doi:https: //doi.org/10.1016/j.culher.2016.09.008. 8, 11
- SCALAS A., MORTARA M., SPAGNUOLO M.: 3D Annotation Transfer. In Eurographics Workshop on Graphics and Cultural Heritage (2017), Schreck T., Weyrich T., Sablatnig R., Stular B., (Eds.), The Eu- rographics Association. doi:10.2312/gch.20171295. 8
- SSD * 11] SERNA S. P., SCOPIGNO R., DOERR M., THEODORIDOU M., GEORGIS C., PONCHIO F., STORK A.: 3d-centered media link- ing and semantic enrichment through integrated searching, browsing, viewing and annotating. In Proceedings of the 12th International Con- ference on Virtual Reality, Archaeology and Cultural Heritage (2011), VAST'11, Eurographics Association, pp. 89-96. URL: http://dx. doi.org/10.2312/VAST/VAST11/089-096, doi:10.2312/ VAST/VAST11/089-096. 4, 11
- SERNA S. P., SCHMEDT H., RITZ M., STORK A.: Interactive semantic enrichment of 3d cultural heritage collections. In EG VAST 2012 Symp. (2012), Eurographics, pp. 33-40. 3, 4, 5, 6, 11
- SOLER F., TORRES J. C., LEÓN A. J., LUZÓN M. V.: Design of cultural heritage information systems based on information layers. J. Comput. Cult. Herit. 6, 4 (Dec. 2013), 15:1-15:17. doi:10.1145/ 2532630.2532631. 2, 4, 5, 7, 8
- YU C.-H., HUNTER J.: Documenting and sharing com- parative analyses of 3d digital museum artifacts through seman- tic web annotations. J. Comput. Cult. Herit. 6, 4 (Dec. 2013), 18:1-18:20. URL: http://doi.acm.org/10.1145/2532630. 2532634, doi:10.1145/2532630.2532634. 2, 3, 4, 6 submitted to COMPUTER GRAPHICS Forum (6/2018).