Academia.eduAcademia.edu

Outline

Title
Abstract
What is a Curated Database?
Updates in Curated Databases
Database Archiving
Other Issues and Conclusions
References

Curated databases

Profile image of Wang-chiew TanWang-chiew Tan

2008, Proceedings of the twenty-seventh ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems - PODS '08

Abstract

Curated databases are databases that are populated and updated with a great deal of human effort. Most reference works that one traditionally found on the reference shelves of libraries -dictionaries, encyclopedias, gazetteers etc.are now curated databases. Since it is now easy to publish databases on the web, there has been an explosion in the number of new curated databases used in scientific research. The value of curated databases lies in the organization and the quality of the data they contain. Like the paper reference works they have replaced, they usually represent the efforts of a dedicated group of people to produce a definitive description of some subject area.

Related papers

Progressing Toward Bibliography; or: Organic Growth in the Bibliographic Record
James P. Ascher

RBM: A Journal of Rare Books, Manuscripts and …, 2009

Much of traditional book cataloging is influenced by a touch-it-once mentality, where work is completed in as few steps as possible. By avoiding unnecessary revision, libraries can process materials quickly and benefit from economies of scale. Valuable staff time is preserved to process additional materials. However, the touch-it-once mentality is problematic when dealing with special collections materials, since they often differ between manifestations and are primary sources for research that informs their description. This paper discusses the idea of "progressive bibliography," or proceeding from minimal to fuller descriptions, as an intellectually valid and pragmatically essential methodology. It examines some already existing approaches and discusses a few of the challenges and further areas of research. While the idea of positive accumulation of knowledge is old, computerized tools and modern information theories enables us to streamline this process to the benefit of patrons and scholars, and so managers of these collections have new tools to tackle ever-increasing backlogs of underprocessed materials.

View PDFchevron_right
HARMONIZING AND PUBLISHING MANUSCRIPT METADATA 1 Harmonizing and Publishing Heterogeneous Pre-Modern Manuscript Metadata as Linked Open Data
Doug Emery

2021

Manuscripts are a crucial form of evidence for research into all aspects of pre-modern European history and culture, and there are numerous databases devoted to describing them in detail. This descriptive information, however, is typically available only in separate data silos based on incompatible data models and user interfaces. As a result, it has been difficult to study manuscripts comprehensively across these various platforms. To address this challenge, a team of manuscript scholars and computer scientists worked to create ”Mapping Manuscript Migrations” (MMM), a semantic portal, and a Linked Open Data service. MMM stands as a successful proof of concept for integrating distinct manuscript datasets into a shared platform for research and discovery with the potential for future expansion. This paper will discuss the major products of the MMM project: a unified data model, a repeatable data transformation pipeline, a Linked Open Data knowledge graph, and a Semantic Web portal. I...

View PDFchevron_right
Publishing and Consuming Provenance Metadata on the Web of Linked Data
Olaf Hartig

Lecture Notes in Computer Science, 2010

The World Wide Web evolves into a Web of Data, a huge, globally distributed dataspace that contains a rich body of machineprocessable information from a virtually unbound set of providers covering a wide range of topics. However, due to the openness of the Web little is known about who created the data and how. The fact that a large amount of the data on the Web is derived by replication, query processing, modification, or merging raises concerns of information quality. Poor quality data may propagate quickly and contaminate the Web of Data. Provenance information about who created and published the data and how, provides the means for quality assessment. This paper takes a first step towards creating a quality-aware Web of Data: we present approaches to integrate provenance information into the Web of Data and we illustrate how this information can be consumed. In particular, we introduce a vocabulary to describe provenance of Web data as metadata and we discuss possibilities to make such provenance metadata accessible as part of the Web of Data. Furthermore, we describe how this metadata can be queried and consumed to identify outdated information.

View PDFchevron_right
Quantifying the Consistency of Scientific Databases
Andrej Kastrin, Zoran Levnajić

PLOS ONE, 2015

Science is a social process with far-reaching impact on our modern society. In the recent years, for the first time we are able to scientifically study the science itself. This is enabled by massive amounts of data on scientific publications that is increasingly becoming available. The data is contained in several databases such as Web of Science or PubMed, maintained by various public and private entities. Unfortunately, these databases are not always consistent, which considerably hinders this study. Relying on the powerful framework of complex networks, we conduct a systematic analysis of the consistency among six major scientific databases. We found that identifying a single "best" database is far from easy. Nevertheless, our results indicate appreciable differences in mutual consistency of different databases, which we interpret as recipes for future bibliometric studies.

View PDFchevron_right
Approaches to Building Metadata for Data Curation
Cynthia chen

International Conference on Dublin Core and Metadata Applications, 2013

In National Taiwan University (NTU), the Library aims to provide data curation services for university researchers from different research fields, particularly focusing on those from small sciences. In this paper, we will first investigate existing metadata schemas used for data curation services in North America and Europe. Next, we will attempt to develop an application profile, proposing metadata fields to be applied to data curation services in NTU. Finally, we will discuss our findings in this study, and take further action to develop a repository platform.

View PDFchevron_right
The emerging role of libraries in data curation and e-science
P. Bryan Heidorn

2011

The role of libraries is to collect, preserve and disseminate the intellectual output of the society. This output includes books and serials as well as the digital versions of the same.

View PDFchevron_right
Harmonizing and publishing heterogeneous premodern manuscript metadata as Linked Open Data
Doug Emery

Journal of the Association for Information Science and Technology, 2021

Manuscripts are a crucial form of evidence for research into all aspects of premodern European history and culture, and there are numerous databases devoted to describing them in detail. This descriptive information, however, is typically available only in separate data silos based on incompatible data models and user interfaces. As a result, it has been difficult to study manuscripts comprehensively across these various platforms. To address this challenge, a team of manuscript scholars and computer scientists worked to create "Mapping Manuscript Migrations" (MMM), a semantic portal, and a Linked Open Data service. MMM stands as a successful proof of concept for integrating distinct manuscript datasets into a shared platform for research and discovery with the potential for future expansion. This paper will discuss the major products of the MMM project: a unified data model, a repeatable data transformation pipeline, a Linked Open Data knowledge graph, and a Semantic Web portal. It will also examine the crucial importance of an iterative process of multidisciplinary collaboration embedded throughout the project, enabling humanities researchers to shape the development of a digital platform and tools, while also enabling the same researchers to ask more sophisticated and comprehensive research questions of the aggregated data.

View PDFchevron_right
Metadatapedia: A proposal for aggregating metadata on data archiving
Sally Jo Cunningham

ACM International Conference Proceeding Series, 2012

The open access movement has highlighted the barriers that exist for users to gain access to significant portions of the research literature. The open data approach seeks to extend the principles of open access to the data and code that supports the published scholarly record. Current metadata is inadequate to allow information researchers to evaluate claims made about data archiving practices. Assessing current archiving practice and understanding the impact of archiving policies requires improved metadata. We propose that information researchers create an infrastructure for the collection of metadata about data use in the research literature, and that infrastructure should itself be open.

View PDFchevron_right
Hypostatizing Data Collections, Especially Bibliographic
Roland Hjerppe

Visualizing subject access for 21st …, 1998

View PDFchevron_right
Solid Foundations and Some Secondary Assumptions in the Design of Bibliographic Metadata: Toward a Typology of Complementary Uses of Metadata
Athena Salaba

2017

Historically catalogs of library resources have taken different forms, the bibliographic data included in a library catalog entry has increasingly been enhanced, and the way a user is interacting with the catalog and its bibliographic data has also changed, especially since the end of the last century. Bibliographic data include information that describes and represents a resource. Throughout their history, library catalogs have served a variety of purposes. The majority of the literature on the purposes of the catalog focuses on the finding and selecting functions. Cutter, in his Rules for a Dictionary Catalog , identifies three catalog objectives: to find a resource, to show (collocate) what resources a library has, and to assist in the choice of a resource (Cutter, 1876). Theories of bibliographic control identify five main catalog functions, find, collocate, identify, select, and obtain, with the additional function of navigation included in fewer works (Svenonius, 2000). More ...

View PDFchevron_right

References (75)

  1. REFERENCES
  2. C. Aravindan and P. Baumgartner. Theorem proving techniques for view deletion in databases. J. Symb. Comput., 29(2):119-147, 2000.
  3. A. Bairoch and R. Apweiler. The SWISS-PROT protein sequence data bank and its supplement trEMBL. Nucleic Acids Research, 25(1):31-36, 1997.
  4. V. Benzaken, G. Castagna, and A. Frisch. CDuce: an XML-centric general-purpose language. In ICFP 2003, pages 51-63. ACM, 2003.
  5. G. J. Bex, W. Gelada, F. Neven, and S. Vansummeren. Learning deterministic regular expressions for the inference of schemas from XML data. In WWW 2008, 2008.
  6. G. J. Bex, F. Neven, and J. V. den Bussche. DTDs versus XML Schema: a practical study. In WebDB 2004, pages 79-84, New York, NY, USA, 2004. ACM.
  7. G. J. Bex, F. Neven, T. Schwentick, and K. Tuyls. Inference of concise DTDs from XML data. In VLDB 2006, pages 115-126, 2006.
  8. G. J. Bex, F. Neven, and S. Vansummeren. Inferring XML schema definitions from XML data. In VLDB 2007, pages 998-1009, 2007.
  9. D. Bhagwat, L. Chiticariu, G. Vijayvargiya, and W. Tan. An annotation management system for relational databases. VLDB Journal, 14(4):373-396, 2005.
  10. S. Bowers, L. Delcambre, and D. Maier. Enriching documents in an information portal using superimposed schematics. In dg.o '02: Proceedings of the 2002 annual national conference on Digital government research, pages 1-6. Digital Government Research Center, 2002.
  11. S. Bowers, T. McPhillips, B. Ludaescher, S. Cohen, and S. B. Davidson. A model for user-oriented data provenance in pipelined scientific workflows. In Moreau and Foster [59], pages 133-147.
  12. R. J. Brachman and J. G. Schmolze. An overview of the KL-ONE knowledge representation system. Cognitive Science, 9(2):171-216, 1985.
  13. P. Buneman. How to cite curated databases and how to make them citable. In SSDBM 2006, pages 195-203. IEEE Computer Society, 2006.
  14. P. Buneman, A. Chapman, and J. Cheney. Provenance management in curated databases. In SIGMOD 2006, pages 539-550, 2006.
  15. P. Buneman, J. Cheney, and S. Vansummeren. On the expressiveness of implicit provenance in query and update languages. In Database Theory -ICDT 2007, volume 4353 of LNCS, pages 209-223, 2007.
  16. P. Buneman, S. B. Davidson, W. Fan, C. S. Hara, and W. Tan. Keys for XML. Computer Networks, 39(5):473-487, 2002.
  17. P. Buneman, S. Khanna, K. Tajima, and W. Tan. Archiving scientific data. ACM Trans. Database Syst., 27(1):2-42, 2004.
  18. P. Buneman, S. Khanna, and W. Tan. On the propagation of deletions and annotations through views. In PODS 2002, pages 150-158. ACM, 2002.
  19. P. Buneman, S. Khanna, and W. C. Tan. Why and where: A characterization of data provenance. In Database Theory - ICDT 2001, volume 1973 of LNCS, pages 316-330, 2001.
  20. P. Buneman, S. A. Naqvi, V. Tannen, and L. Wong. Principles of programming with complex objects and collection types. Theor. Comp. Sci., 149(1):3-48, 1995.
  21. Central Intelligence Agency. The world factbook. http://www.cia.gov/cia/publications/factbook/.
  22. A. Chapman and H. V. Jagadish. Issues in building practical provenance systems. IEEE Data Eng. Bull., 30(4):38-43, 2007.
  23. J. Cheney. Program slicing and data provenance. IEEE Data Eng. Bull., 30(4):22-28, 2007.
  24. J. Cheney. Lux: A lightweight, statically typed XML update language. In ACM SIGPLAN Workshop on Programming Language Technology and XML (PLAN-X 2007), pages 25-36, 2007.
  25. J. Cheney, A. Ahmed, and U. A. Acar. Provenance as dependency analysis. In Database Programming Languages - DBPL 2007, volume 4797 of LNCS, pages 139-153. Springer, 2007.
  26. L. Chiticariu and W. Tan. Debugging schema mappings with routes. In VLDB 2006, pages 79-90, 2006.
  27. L. Chiticariu, W. Tan, and G. Vijayvargiya. DBNotes: A post-it system for relational databases based on provenance. In SIGMOD 2005, pages 942-944, 2005. (Demonstration paper).
  28. G. Cong, W. Fan, and F. Geerts. Annotation propagation revisited for key preserving views. In CIKM 2006, pages 632-641. ACM, 2006.
  29. Y. Cui and J. Widom. Run-time translation of view tuple deletions using data lineage. Technical report, Stanford University, 2001.
  30. Y. Cui, J. Widom, and J. L. Wiener. Tracing the lineage of view data in a warehousing environment. ACM Trans. Database Syst., 25(2):179-227, 2000.
  31. N. Dalvi and D. Suciu. Management of probabilistic data: foundations and challenges. In PODS 2007, pages 1-12. ACM, 2007.
  32. R. D. Dowell, R. M. Jokerst, A. Day, S. R. Eddy, and L. Stein. The distributed annotation system. BMC Bioinformatics, 2:7, 2001.
  33. J. R. Driscoll, N. Sarnak, D. D. Sleator, and R. E. Tarjan. Making Data Structures Persistent. J. Comput. Syst. Sci., 38(1):86-124, 1989.
  34. W. Fan. Dependencies revisited for improving data quality. In PODS 2008. ACM, June 2008. These proceedings.
  35. K. Fisher, D. Walker, K. Q. Zhu, and P. White. From dirt to shovels: fully automatic tool generation from ad hoc data. In POPL 2008, pages 421-434. ACM, 2008.
  36. J. N. Foster, T. Green, and V. Tannen. Annotated XML: Queries and provenance. In PODS 2008. ACM, June 2008. These proceedings.
  37. M. Y. Galperin. The molecular biology database collection: 2008 update. Nucleic Acids Research, 36, 2008.
  38. D. Gao and R. T. Snodgrass. Temporal slicing in the evaluation of XML queries. In VLDB 2003, pages 632-643, 2003.
  39. H. Garcia-Molina, Y. Papakonstantinou, D. Quass, A. Rajaraman, Y. Sagiv, J. D. Ullman, V. Vassalos, and J. Widom. The TSIMMIS approach to mediation: Data models and languages. J. Intell. Inf. Syst., 8:117-132, 1997.
  40. P. Gardner, G. Smith, M. Wheelhouse, and U. Zarfaty. Local hoare reasoning about DOM. In PODS 2008, June 2008. These proceedings.
  41. F. Geerts, A. Kementsietsidis, and D. Milano. MONDRIAN: Annotating and querying databases through colors and blocks. In ICDE 2006, page 82. IEEE Computer Society, 2006.
  42. F. Geerts and J. Van den Bussche. Relational completeness of query languages for annotated databases. In Database Programming Languages -DBPL 2007, volume 4797 of LNCS, pages 127-137, 2007.
  43. W. Gelade, W. Martens, and F. Neven. Optimizing schema languages for XML: Numerical constraints and interleaving. In Database Theory -ICDT 2007, volume 4353 of LNCS, pages 269-283. Springer, 2007.
  44. G. Ghelli, D. Colazzo, and C. Sartiani. Efficient inclusion for a class of XML types with interleaving and counting. In Database Programming Languages: DBPL 2007, volume 4797 of LNCS, pages 231-245, 2007.
  45. T. J. Green, G. Karvounarakis, and V. Tannen. Provenance semirings. In PODS 2007, pages 31-40. ACM Press, 2007.
  46. J. Hidders, N. Kwasnikowska, J. Sroka, J. Tyszkiewicz, and J. V. den Bussche. DFL: A dataflow language based on petri nets and nested relational calculus. Inf. Syst., 33(3):261-284, 2008.
  47. H. Hosoya and B. C. Pierce. XDuce: A statically typed xml processing language. ACM Trans. Interet Technol., 3(2):117-148, 2003.
  48. T. Imielinski and J. Witold Lipski. Incomplete information in relational databases. J. ACM, 31(4):761-791, 1984.
  49. IUPHAR receptor database. http://www.iuphar-db.org.
  50. S. Jones, D. Abbott, , and S. Ross. Risk Assessment for AHDS Performing Arts Collections: A Response to the Withdrawal of Core Funding. Technical report, Glasgow, December 2007.
  51. S. Kumar and T. Bednar. Oracle9i flashback query. Technical report, Oracle Corporation, 2001.
  52. T. Lee, S. Bressan, and S. E. Madnick. Source attribution for querying against semi-structured documents. In First Workshop on Web Information and Data Management, pages 33-39. ACM, 1998.
  53. H. Liefke and S. B. Davidson. Specifying updates in biomedical databases. In SSDBM 1999, pages 44-53. IEEE, 1999.
  54. D. Lomet, R. Barga, M. F. Mokbel, G. Shegalov, R. Wang, and Y. Zhu. Immortal DB: transaction time support for SQL server. In SIGMOD 2005, pages 939-941. ACM, 2005.
  55. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger-Frank, M. Jones, E. Lee, J. Tao, and Y. Zhao. Scientific workflow management and the Kepler system. Concurrency and Computation: Practice & Experience, 18(10):1039-1065, 2006.
  56. P. Maniatis, M. Roussopoulos, T. J. Giuli, D. S. H. Rosenthal, and M. Baker. The LOCKSS peer-to-peer digital preservation system. ACM Trans. Comput. Syst., 23(1):2-50, 2005.
  57. A. J. Mayer and L. J. Stockmeyer. Word problems-this time with interleaving. Inf. Comput., 115(2):293-311, 1994.
  58. D. L. McGuinness, R. Fikes, J. Rice, and S. Wilder. The Chimaera ontology environment. In Proceedings of Twelfth Conference on Innovative Applications of Artificial Intelligence, pages 1123-1124. AAAI Press, 2000.
  59. V. A. McKusick. OMIM -online mendelian inheritance in man. www.ncbi.nlm.nih.gov/omim/.
  60. L. Moreau and I. T. Foster, editors. Provenance and Annotation of Data -IPAW 2006, volume 4145 of LNCS. Springer, 2006.
  61. H. Müller, P. Buneman, and I. Koltsidas. XArch: Archiving scientific and reference data. In SIGMOD 2008, June 2008. Demonstration Paper. To appear.
  62. N. F. Noy, M. Sintek, S. Decker, M. Crubezy, R. W. Fergerson, and M. A. Musen. Creating semantic web contents with Protege-2000. IEEE Intelligent Systems, 16(2):60-71, 2001.
  63. T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver, K. Glover, M. R. Pocock, A. Wipat, and P. Li. Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics, 20(17):3045-3054, 2004.
  64. Y. Papakonstantinou, S. Abiteboul, and H. Garcia-Molina. Object fusion in mediator systems. In VLDB 1996, pages 413-424. Morgan Kaufmann, 1996.
  65. Plutarch. Vita Thesei 22-23.
  66. D. Rémy. Type inference for records in a natural extension of ML. In Theoretical aspects of object-oriented programming. MIT Press, 1994.
  67. A. D. Sarma, O. Benjelloun, A. Halevy, and J. Widom. Working models for uncertain data. In ICDE 2006, page 7. IEEE Computer Society, 2006.
  68. R. T. Snodgrass. Developing Time-Oriented Database Applications in SQL. Morgan Kaufmann, July 1999.
  69. L. D. Stein and J. Thierry-Mieg. AceDB: A genome database management system. Computing in Science and Engg., 1(3):44-52, 1999.
  70. W. Tan. Containment of relational queries with annotation propagation. In Database Programming Languages -DBPL 2003, volume 2921 of LNCS, pages 37-53. Springer, 2003.
  71. The Gene Ontology Consortium. Gene ontology: tool for the unification of biology. Nature Genetics, 25(1):25-29, May 2000.
  72. F. Wang and C. Zaniolo. Temporal queries in XML document archives and web warehouses. In TIME, pages 47-55. IEEE Computer Society, 2003.
  73. Y. R. Wang and S. E. Madnick. A polygen model for heterogeneous database systems: The source tagging perspective. In VLDB 1990, pages 519-538. Morgan Kaufmann, 1990.
  74. M. Weiser. Program slicing. In ICSE, pages 439-449, Piscataway, NJ, USA, 1981. IEEE Press.
  75. G. Yang, I. V. Ramakrishnan, and M. Kifer. On the complexity of schema inference from web pages in the presence of nullable data attributes. In CIKM 2003, pages 224-231. ACM, 2003.

Related papers

Toward the modeling of data provenance in scientific publications
Imran Jami

Computer Standards & Interfaces, 2013

In this paper, we implement a provenance-aware system for documenting publications, called PADS. It employs a three-layered provenance hierarchy, which can output diverse types of provenance data related to the research life cycle. From this, we generate different profiles for research ventures, reviewers, and authors. PADS employs the standard Open Provenance Model (OPM) specification for capturing provenance data, and stores this data as ontological instances. We show that data is retrieved without any apparent delay in the execution time of the queries. We also demonstrate how this data can be used to make useful recommendations to the organizers, in order to manage upcoming research ventures.

View PDFchevron_right
Interpreting Strings, Weaving Threads: Structuring Provenance Data with AI
max koss

Sammlungsforschung im digitalen Zeitalter. Chances, Herausforderungen und Grenzen, 2024

View PDFchevron_right
Collection, Curation, Citation at Source: Publication@Source 10 Years On
Colin Bird

International Journal of Digital Curation, 2015

The Southampton chemical information group had its genesis in 2001, when we began an e-Science pilot project to investigate structure-property mapping, combinatorial chemistry, and the Grid. CombeChem instigated a range of activities that have since been underway for more than ten years, in many ways matching the expansion of interest in using the Web as a vehicle for collection, curation, dissemination, reuse, and exploitation of scientific data and information. Chemistry has frequently provided the exemplar case studies, notably for the series of projects – funded by Jisc and EPSRC – that investigated the issues associated with the long-term preservation of data to support the scholarly knowledge cycle, such as the eBank UK project. Rapid developments in Internet access and mobile technology have significantly influenced the way researchers view connectivity, data standards, and the increasing importance and power of semantics and the Semantic Web. These technical advances interac...

View PDFchevron_right
Collaborate, automate, prepare, prioritize: Creating metadata for legacy research data
Inna Kouper

2013

Data curation projects frequently deal with data that were not created for the purposes of longterm preservation and re-use. How can curation of such legacy data be improved by supplying necessary metadata? In this report, we address this and other questions by creating robust metadata for twenty legacy research datasets. We report on the metrics of creating domainspecific metadata and propose a four-prong framework of metadata creation for legacy research data. Our findings indicate that there is a steep learning curve in encoding metadata using the FGDC content standard for digital geospatial metadata. Our project demonstrates that when data curators are handed research data "as is," they may be successful in incorporating such data into a data sharing environment. We found that data curators can be successful in creating descriptive metadata and enhancing discoverability via subject analysis. However, curators must be aware of the limitations in applying structural and administrative metadata for legacy data.

View PDFchevron_right
Linking Data and Publications: Towards a Cross-Disciplinary Approach
Paolo Manghi

2013

In this paper, we tackle the challenge of linking scholarly information in multi-disciplinary research infrastructures. There is a trend towards linking publications with research data and other information, but, as it is still emerging, this is handled differently by various initiatives and disciplines. For OpenAIRE, a European cross-disciplinary publication infrastructure, this poses the challenge of supporting these heterogeneous practices. Hence, OpenAIRE wants to contribute to the development of a common approach for discipline-independent linking practices between publications, data, project information and researchers. To this end, we constructed two demonstrators to identify commonalities and differences. The results show the importance of stable and unique identifiers, and support a "by reference" approach of interlinking research results. This approach allows discipline-specific research information to be managed independently in distributed systems and avoids redundant maintenance. Furthermore, it allows these disciplinary systems to manage the specialized structures of their contents themselves.

View PDFchevron_right

Related topics

  • Scientific Discovery
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved