Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Data Object
Platform-Independent Model of Data Object
Platform-Specific Model of Data Object
Data Quality Requirements Specification
Data Quality Evaluation
Conclusions
Future Work
References
All Topics
Computer Science
Modeling and Simulation

User-Oriented Approach to Data Quality Evaluation

Profile image of Ivo OdītisIvo Odītis

2020, JUCS - Journal of Universal Computer Science

Abstract

The paper proposes a new data object-driven approach to data quality evaluation. It consists of three main components: (1) a data object, (2) data quality requirements, and (3) data quality evaluation process. As data quality is of relative nature, the data object and quality requirements are (a) use-case dependent and (b) defined by the user in accordance with his needs. All three components of the presented data quality model are described using graphical Domain Specific Languages (DSLs). In accordance with Model-Driven Architecture (MDA), the data quality model is built in two steps: (1) creating a platform-independent model (PIM), and (2) converting the created PIM into a platform-specific model (PSM). The PIM comprises informal specifications of data quality. The PSM describes the implementation of a data quality model, thus making it executable, enabling data object scanning and detecting data quality defects and anomalies. The proposed approach was applied to open data sets, ...

Related papers

A Software Engineering View of Data Quality
Daniel Yankelevich

Thirty years ago, software was not considered a concrete value. Everyone agreed on its importance, but it was not considered as a good or possession. Nowadays, software is part of the balance of an organization. Data is slowly following the same process. The information owned by an organization is an important part of its assets. Information can be used as a competitive advantage. However, data has long been underestimated by the software community. Usually, methods and techniques apply to software (including data schemata), but the data itself has often been considered as an external problem. Validation and verification techniques usually assume that data is provided by an external agent and concentrate only on software.

View PDFchevron_right
Data quality assessment and improvement
Janne Harkonen

International Journal of Business Information Systems, 2016

Data quality has significance to companies, but is an issue that can be challenging to approach and operationalise. This study focuses on data quality from the perspective of operationalisation by analysing the practices of a company that is a world leader in its business. A model is proposed for managing data quality to enable evaluation and operationalisation. The results indicate that data quality is best ensured when organisation specific aspects are taken into account. The model acknowledges the needs of different data domains, particularly those that have master data characteristics. The proposed model can provide a starting point for operationalising data quality assessment and improvement. The consequent appreciation of data quality improves data maintenance processes, IT solutions, data quality and relevant expertise, all of which form the basis for handling the origins of products.

View PDFchevron_right
A formal definition of data quality problems
Pedro Henrique

2005

The exploration of data to extract information or knowledge to support decision making is a critical success factor for an organization in today's society. However, several problems can affect data quality. These problems have a negative effect in the results extracted from data, affecting their usefulness and correctness. In this context, it is quite important to know and understand the data problems. This paper presents a taxonomy of data quality problems, organizing them by granularity levels of occurrence. A formal definition is presented for each problem included. The taxonomy provides rigorous definitions, which are information-richer than the textual definitions used in previous works. These definitions are useful to the development of a data quality tool that automatically detects the identified problems.

View PDFchevron_right
A Classification of Data Quality Assessment Methods
Ajith Kumar Parlikad

Proceedings of the 16th International …, 2011

Data quality (DQ) assessment can be significantly enhanced with the use of the right DQ assessment methods, which provide automated solutions to assess DQ. The range of DQ assessment methods is very broad: from data profiling and semantic profiling to data matching and data validation. This paper gives an overview of current methods for DQ assessment and classifies the DQ assessment methods into an existing taxonomy of DQ problems. Specific examples of the placement of each DQ method in the taxonomy are provided and illustrate why the method is relevant to the particular taxonomy position. The gaps in the taxonomy, where no current DQ methods exist, show where new methods are required and can guide future research and DQ tool development.

View PDFchevron_right
A process for assessing data quality
Harry Sneed

Proceedings of the 8th international workshop on Software quality - WoSQ '11, 2011

This industrial contribution describes a tool support approach to assessing the quality of relational databases. The approach combines two separate audits-an audit of the database structure as described in the schema and an audit of the database content at a given point in time. The audit of the database schema checks for design weaknesses, data rule violations and deviations from the original data model. It also measures the size, complexity and structural quality of the database. The audit of the database content compares the state of selected data attributes to identify incorrect data and checks for missing and redundant records. The purpose is to initiate a data clean-up process to ensure or restore the quality of the data.

View PDFchevron_right
MMPRO: A Methodology Based on ISO/IEC 15939 to Draw Up Data Quality Measurement Processes
Ismael Caballero

Iq, 2008

Nowadays, data plays a key role in organizations, and management of its quality is becoming an essential activity. As part of such required management, organizations need to draw up processes for measuring the data quality (DQ) levels of their organizational units, taking into account the particularities of different scenarios, available resources, and characteristics of the data used in them. Given that there are not many works in the literature related to this objective, this paper proposes a methodology-abbreviated MMPROto develop processes for measuring DQ. MMPRO is based on ISO/IEC 15939. Despite being a standard of quality software, we believe it can be successfully applied in this context because of the similarities between software and data. The proposed methodology consists of four activities: (1) Establish and sustain the DQ measurement commitment, (2) Plan the DQ Measurement Process, (3) Perform the DQ Measurement Process, and (4) Evaluate the DQ Measurement Process. These four activities are divided into tasks. For each task, input and output products are listed, as well as a set of useful techniques and tools, many of them borrowed from the Software Engineering field.

View PDFchevron_right
Data Quality By Design: A Goal-Oriented Approach
Thodoros Topaloglou

We present a design process for incorporating data quality requirements into database schemas that is rooted in goal-oriented requirements analysis techniques, developed in the Requirement Engineering community over last 15 years. Goal-oriented approaches (i) offer a body of notations, techniques and processes for modeling, analyzing and operationalizing quality requirements; (ii) support representation and evaluation of alternatives in goal fulfillment; and (iii) provide automated reasoning tools for various analysis and design tasks. This paper extends existing proposals for addressing data/information quality issues during database requirements analysis and design in two ways. First, we consider a broader range of quality assurance data requirements, which can be classified as restrictive, descriptive, supportive and reflective. Second, we offer a systematic way to operationalize high-level, abstract quality goals into operational, concrete quality assurance data requirements plu...

View PDFchevron_right

References (32)

  1. Acosta, 13] Acosta M., Zaveri A., Simperl E., Kontokostas D., Auer S., Lehmann J.: Crowdsourcing linked data quality assessment, In International Semantic Web Conference (pp. 260-276). Springer, Berlin, Heidelberg, 2013.
  2. Adedugbe, 18] Adedugbe, O., Benkhelifa, E., & Campion, R.: A Cloud-Driven Framework for a Holistic Approach to Semantic Annotation. In 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS) (pp. 128-134). IEEE, 2018.
  3. Askham, 13] Askham N., Cook D., Doyle M., Fereday H., Gibson M., Landbeck U., Lee R., Maynard C., Palmer G., Schwarzenbach J.: The six primary dimensions for data quality assessment, DAMA UK Working Group, 432-435, 2013.
  4. Baker, 18] Baker, Q. B., Al-Rashdan, W., & Jararweh, Y.: Cloud-Based Tools for Next- Generation Sequencing Data Analysis. In 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS) (pp. 99-105). IEEE, 2018.
  5. Batini, 16] Batini C., Scannapieco M., "Data and information quality" Cham, Switzerland: Springer International Publishing, Google Scholar, 2016.
  6. Bevan, 12] Bevan C., Strother D.: Best practices for evaluating method validity, data quality and study reliability of toxicity studies for chemical hazard risk assessments, Washington (DC): American Chemical Council, Centre for Advancing Risk Assessment Science and Policy, 2012. [Bicevska, 17] Bicevska Z., Bicevskis J., Oditis I.: Models of Data Quality, 12th Conference, ISM 2017, Held as Part of FedCSIS, Prague, Czech Republic, Extended Selected Papers. Lecture Notes in Business Information Processing, Vol. 311, pp. 194-211, 2017.
  7. Bicevskis, 19] Bicevskis J., Nikiforova A., Bicevska Z., Oditis I.: A Step Towards a Data Quality Theory, In 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS), IEEE, 2019 (in print).
  8. Bicevskis, 18a] Bicevskis J., Bicevska Z., Nikiforova A., Oditis I.: An approach to data quality evaluation, In 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS), pp. 196-201, IEEE, 2018.
  9. Bicevskis, 18b] Bicevskis J., Bicevska Z., Nikiforova A., Oditis I.: Data quality evaluation: a comparative analysis of company registers' open data in four European countries, In FedCSIS Communication Papers (pp. 197-204), 2018, http://dx.doi.org/10.15439/2018F92.
  10. Caro, 07] Caro A., Calero C., Piattini M.: A Portal Data Quality Model for Users and Developers, In ICIQ (pp. 462-476), 2007.
  11. Chungoora, 13] Chungoora N., Young R. I., Gunendran G., Palmer C., Usman Z., Anjum N. A., Cutting-Decelle A. F., Harding J. A., Case K.: A model-driven ontology approach for manufacturing system interoperability and knowledge sharing, Computers in Industry, 64(4), 392-401, 2013. [Companies House, 18] Companies House: Free Company Data Product, http://download.companieshouse.gov.uk/en_output.html [ComputerWorld, 15] ComputerWorld: The "All In" Costs of Poor Data Quality. It goes beyond dollars and cents, 2015, https://www.computerworld.com/article/2949323/the-all-in-costs-of- poor-data-quality.html [Coutinho, 12] Coutinho C., Cretan A., Jardim-Goncalves R.: Negotiations framework for monitoring the sustainability of interoperability solutions, In International IFIP Working Conference on Enterprise Interoperability (pp. 172-184). Springer, Berlin, Heidelberg, 2012. [Ferney, 17] Ferney M., Estefan L., Alexander V.: Assessing data quality in open data: A case study, Congreso Internacional de Innovacion y Tendencias en Ingenieria (CONIITI) (pp. 1-5). IEEE, 2017 [Global Open Data Index, 18] Global Open Data Index, 2018, https://index.okfn.org/ [Khider, 18] Khider, H., Hammoudi, S., Benna, A., & Meziane, A. Social Business Process Model Recommender: An MDE Approach. In 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS) (pp. 106-113). IEEE, 2018.
  12. Kleppe, 03] Kleppe A. G., Warmer J., Warmer J. B., Bast W.: MDA explained: the model driven architecture: practice and promise, Addison-Wesley Professional, 2003.
  13. Mellor, 04] Mellor S. J., Scott K., Uhl A., Weise D.: MDA distilled: principles of model-driven architecture, Addison-Wesley Professional, 2004.
  14. Miller, 03] Miller J., Mukerji J.: MDA Guide Version 1.0. 1, Object Management Group (OMG), Needham, MA, 2494, 2003.
  15. Neumaier, 16] Neumaier S., Umbrich J., Polleres A.: Automated quality assessment of metadata across open data portals, Journal of Data and Information Quality (JDIQ), 8(1), 2016. [Nikiforova, 19a] Nikiforova, A.: Analysis of open health data quality using data object-driven approach to data quality evaluation: insights from a Latvian context. In IADIS International Conference e-Health 2019, MCCSIS 2019, (pp. 119-126). IADIS, 2019. [Nikiforova, 19b] Nikiforova A., Bicevskis, J.: An Extended Data Object-driven Approach to Data Quality Evaluation: Contextual Data Quality Analysis, Proceedings of the 21st International Conference on Enterprise Information Systems. In ICEIS 2019. [Nikiforova, 18a] Nikiforova A.: Open Data Quality, In Baltic DB&IS 2018 Joint Proceedings of the Conference Forum and Doctoral Consortium, Trakai, Lithuania (Vol. 2158), 2018. [Nikiforova, 18b] Nikiforova A.: Open Data Quality Evaluation: A Comparative Analysis of Open Data in Latvia, Baltic Journal of Modern Computing, 6(4), 363-386, 2018.
  16. Pauker, 16] Pauker F., Frühwirth T., Kittl B., Kastner W.: A systematic approach to OPC UA information model design, Procedia CIRP, 57, 321-326, 2016. [Paulheim, 14] Paulheim H., Bizer C.: Improving the quality of linked data using statistical distributions, International Journal on Semantic Web and Information Systems (IJSWIS), 10(2), 63-86, 2014.
  17. Redman, 01] Redman T. C.: Data quality: the field guide, Digital press, 2001
  18. Redman, 97] Redman T. C., Blanton A.: Data quality for the information age, Artech House, Inc., 1997.
  19. Ruiz, 18] Ruiz M.: TraceME: A Traceability-Based Method for Conceptual Model Evolution, Springer International Publishing, 2018.
  20. Salesi, 18] Salesi, S., Alani, A. A., Cosma, G.: A Hybrid Model for Classification of Biomedical Data Using Feature Filtering and a Convolutional Neural Network. In 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS) (pp. 226-232). IEEE, 2018.
  21. Sasse, 17] Sasse T., Smith A., Broad E., Kennison J., Wells P., Atz U.: Recomendations for Open Data Portals: from Setup to sustainability, https://www.europeandataportal.eu/sites/default/files/edp_s3wp4_sustainability_recommendati ons.pdf, 2017
  22. Sáez Martín, 16] Sáez Martín A., Rosario A. H. D., Pérez M. D. C. C.: An international analysis of the quality of open government data portals, Social Science Computer Review, 34(3), 298- 311, 2016.
  23. Scannapieco, 02] Scannapieco, M., Catarci, T.: Data quality under a computer science perspective, Archivi & Computer, 2, 1-15, 2002.
  24. Schmidt, 15] Schmidt M., Schmidt S. A. J., Sandegaard J. L., Ehrenstein V., Pedersen L., Sørensen H. T.: The Danish National Patient Registry: a review of content, data quality, and research potential, Clinical epidemiology, 7, 449, 2015.
  25. Shi, 15] Shi X., Han W., Huang Y., Li Y.: Service-oriented business solution development driven by process model, In the Fifth International Conference on Computer and Information Technology (CIT'05) (pp. 1086-1092). IEEE, 2015.
  26. Soley, 00] Soley R.: Model driven architecture, OMG white paper, 308(308), 5, 2000. [Sprogis, 13] Sprogis A., Barzdins J.: Specification, Configuration and Implementation of DSL Tool, In Databases and Information Systems VII: Selected Papers from the Tenth International Baltic Conference, DB & IS 2012 (Vol. 249, p. 330). IOS Press, 2013. [TDQM, 18] TDQM. The MIT Total Data Quality Management program. Available: http://web.mit.edu/tdqm/
  27. Tomic, 15] Tomic K., Sandin F., Wigertz A., Robinson D., Lambe M., Stattin P.: Evaluation of data quality in the National Prostate Cancer Register of Sweden, European journal of cancer, 51(1), 101-111, 2015.
  28. The Economist, 17] Economist, T.: The world's most valuable resource is no longer oil, but data. The Economist: New York, NY, USA, 2017.
  29. Umbrich, 15] Umbrich J., Neumaier S., Polleres A.: Quality assessment and evolution of open data portals, In 2015 3rd International Conference on Future Internet of Things and Cloud (pp. 404-411). IEEE, 2015. [Van den Berghe, 17] Van den Berghe S., Van Gaeveren K.: Data quality assessment and improvement: a Vrije Universiteit Brussel case study, Procedia Computer Science, 32-38, 2017.
  30. Vetrò, 16] Vetrò A., Canova L., Torchiano M., Minotas C. O., Iemma R., Morando F.: Open data quality measurement framework: Definition and application to Open Government Data, Government Information Quarterly, 33(2), 325-337, 2016.
  31. Wand, 96] Wand Y., Wang R. Y.: Anchoring data quality dimensions in ontological foundations, Communications of the ACM, 39(11), 86-96, 1996.
  32. Wang, 96] Wang R. Y., Strong D. M.: Beyond accuracy: What data quality means to data consumers, Journal of management information systems, 12(4), 5-33, 1996.

Related papers

Executable Data Quality Models
Jānis Bičevskis

Procedia Computer Science, 2017

The paper discusses an external solution for data quality management in information systems. In contradiction to traditional data quality assurance methods, the proposed approach provides the usage of a domain specific language (DSL) for description data quality models. Data quality models consists of graphical diagrams, which elements contain requirements for data object's values and procedures for data object's analysis. The DSL interpreter makes the data quality model executable therefore ensuring measurement and improving of data quality. The described approach can be applied: (1) to check the completeness, accuracy and consistency of accumulated data; (2) to support data migration in cases when software architecture and/or data models are changed; (3) to gather data from different data sources and to transfer them to data warehouse.

View PDFchevron_right
Domain-Specific Characteristics of Data Quality
Ivo Odītis

Proceedings of the 2017 Federated Conference on Computer Science and Information Systems, 2017

The research discusses the issue how to describe data quality and what should be taken into account when developing an universal data quality management solution. The proposed approach is to create quality specifications for each kind of data objects and to make them executable. The specification can be executed step-by-step according to business process descriptions, ensuring the gradual accumulation of data in the database and data quality checking according to the specific use case. The described approach can be applied to check the completeness, accuracy, timeliness and consistency of accumulated data.

View PDFchevron_right
Riga , Latvia Executable Data Quality Models
Jānis Bičevskis

2018

The paper discusses an external solution for data quality management in information systems. In contradiction to traditional data quality assurance methods, the proposed approach provides the usage of a domain specific language (DSL) for description data quality models. Data quality models consists of graphical diagrams, which elements contain requirements for data object’s values and procedures for data object’s analysis. The DSL interpreter makes the data quality model executable therefore ensuring measurement and improving of data quality. The described approach can be applied: (1) to check the completeness, accuracy and consistency of accumulated data; (2) to support data migration in cases when software architecture and/or data models are changed; (3) to gather data from different data sources and to transfer them to data warehouse. © 2016 The Authors. Published by Elsevier B.V. Peer-review under responsibility of organizing committee of the scientific committee of the internat...

View PDFchevron_right
Developing Data Quality Aware Applications
Cesar Guerra

2009 Ninth International Conference on Quality Software, 2009

Inadequate levels of Data Quality (DQ) in Information Systems (IS) suppose a very important problem for organizations. In any case, they look for to assure data quality from earlier stages on information system developments. This paper proposes to incorporate mechanisms into software development methodologies, in order to integrate users DQ requirements aimed at assuring the data quality from the beginning of development. It brings a framework consisting of processes, activities and tasks, well defined, which would be incorporated in existent software development methodology, as METRICA V3; and therefore, to assure software product data quality created according to this methodology. The extension presented, is a guideline, and this can be extended and applied to other development methodologies like Unified Development Process.

View PDFchevron_right
An Extended Data Object-driven Approach to Data Quality Evaluation: Contextual Data Quality Analysis
Jānis Bičevskis

2019

This research is an extension of a data object-driven approach to data quality evaluation allowing to analyse data object quality in scope of multiple data objects. Previously presented approach was used to analyse one particular data object, mainly focusing on syntactic analysis. It means that the primary data object quality can be analysed against secondary data objects of unlimited number. This opportunity allows making more comprehensive, in-depth contextual data object analysis. The given analysis was applied to open data sets, making comparison between previously obtained results and results of application of the extended approach, underlying importance and benefits of the given extension.

View PDFchevron_right

Related topics

  • Computer Science
  • Executable Models
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved