Academia.eduAcademia.edu

Data reconciliation

description411 papers
group155 followers
lightbulbAbout this topic
Data reconciliation is the process of ensuring that data from different sources or systems is consistent, accurate, and complete. It involves comparing and adjusting datasets to resolve discrepancies, thereby enhancing data integrity and reliability for analysis and decision-making.
lightbulbAbout this topic
Data reconciliation is the process of ensuring that data from different sources or systems is consistent, accurate, and complete. It involves comparing and adjusting datasets to resolve discrepancies, thereby enhancing data integrity and reliability for analysis and decision-making.
All process measurements contain some element of error. Typically, a distinction is made between random errors, with zero expected value, and gross errors with non-zero magnitude. Data Reconciliation (DR) and Gross Error Detection (GED)... more
All process measurements contain some element of error. Typically, a distinction is made between random errors, with zero expected value, and gross errors with non-zero magnitude. Data Reconciliation (DR) and Gross Error Detection (GED)... more
On-line optimisation provides a means for maintaining a process around its optimum operating plant. An important component of optimisation relies in data reconciliation which is used for obtaining consistent data. On a mathematical point... more
For process control improvement, coherency of information supplied by sensors must first be ensured. Because of the presence of random and possibly gross errors, the model equations of the process are not generally satisfied. The problem... more
After un slight rearangement one eliminates the state vector x in order to generate the redundancy equations between the measured variables. If q is the forward shift operator (q u(t) = u(t+1)), equations (1) are rewriten : After a short... more
HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or... more
In the steel industry, the determination of the control system set-points of batch processes is a common problem. It consists in adjusting the set-points in order to reach the given product specifications thanks to a process model. Small... more
In this survey, the authors try to summarize the various aspects of data reconciliation, to point out the main difficulties and to present the state of the art in this field specially for systems described by generalized bilinear models.... more
The quality of the state estimation of a system is strongly conditioned by the number of measurements obtained from this system. Here, this dependence is studied by specifying especially the influence of the number and the position of... more
HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or... more
This paper deals with reconciling measurements characterized by an unknown variance from processes described by linear equations. We use the technique of maximum likelihood to give an estimate of the real values and of the measurement... more
This l:,aper presents an analysis of processes with regard to their circulating flows and mainly focuses on the characterization of variables depending on their redundancy level. Previous studies in this field were performed on processes... more
The data validation consists in obtaining an estimation of the true values of process variables that respect the balance equations. Generally, the procedure needs the knowledge of the variance of the measurement errors; unfortunately, in... more
This paper deals with the problem of data validation in large scale steady state linear systems which are described by algebraic equations. The conditions for observability and redundancy are defined and a procedure is presented for... more
In the steel industry, the determination of the control system set-points of batch processes is a common problem. It consists in adjusting the set-points in order to reach the given product specifications thanks to a process model. Small... more
Before improving the control of a plant, we must make sure of information coherence issued from instrument lines or sensors. In fact, these informations can be corrupted by errors and can also deviate from the optimum functioning range.... more
In this survey, the authors try to summarize the various aspects of data reconciliation, to point out the main difficulties and to present the state of the art in this field specially for systems described by generalized bilinear models.... more
Quantum key distribution (QKD) is a concept of secret key exchange supported by fundamentals of quantum physics. Its perfect realization offers unconditional key security, however, known practical schemes are potentially vulnerable if the... more
RESUMO -As operações de partida de processos químicos e em particular, colunas de destilação, representam interessantes problemas de operabilidade, controle e simulação. Durante a operação de partida de uma coluna de destilação ocorrem... more
The research field of data integration is an area of growing practical importance, especially considering the increasing availability of huge amounts of data from more and more source systems. According current research includes... more
New applications from the areas of analytical data processing and data integration require powerful features to condense and reconcile available data. Object-relational and other data management systems available today provide only... more
On-line optimisation provides a means for maintaining a process around its optimum operating range. This optimisation heavily relies on process measurements and accurate process models. However, these measurements often contain random and... more
A new method of data reconciliation for linear static systems which is able to take into account the knowledge about the uncertainties of the used model is proposed. The uncertainties are represented by bounded variables. The elementary... more
Resumo. Este trabalho apresenta um estudo sobre reconciliação de dados em estado estacionário em beneficiamento de minério, com base em uma unidade industrial publicada por Alhaj-Dibo et al. [1]. É realizada uma breve revisão... more
In chemical and hydrocarbon industry operational efficiency is improved by model-based solutions. Historical process data plays an important role in the identification and verification of models utilized by these tools. Since most of the... more
We present a model based algorithm for simultaneous validation of online analysers and process simulators. Reconciled on-line and historical process data satisfying balance and model equations provides the opportunity to validate and... more
Data reconciliation and principal component analysis are two recognised statistical methods used for plant monitoring and fault detection. We propose to combine them for increased efficiency. Data reconciliation is used in the first step... more
Analysis of the results of a data reconciliation program is made easier by extracting more information from the Jacobian matrix of the constraint equations. Standard deviation for all state variables (measured or not measured) is related... more
The oxygen mass transfer coefficient (K L a) is of paramount importance in conducting aerobic fermentation. K L a also serves to compare the efficiency of bioreactors and their mixing devices as well as being an important scale-up factor.... more
Fermentation experiments using Aspergillus niger result in a very viscous broth due to the growth of filamentous microorganism. For viscous fermentation processes, it is difficult to estimate with confidence the volumetric oxygen mass... more
A new technique of data reconciliation, applied to validation of measures collected on a system, is suggested in this paper. This approach is based on the inequality constraints describing the hyper space in which the state of the... more
A stepwise experimental design procedure to obtain reliable data from wastewater treatment plants (WWTPs) was developed. The proposed procedure aims at determining sets of additional measurements (besides available ones) that guarantee... more
This chapter proposes an approach to generate predictions for decision support issues. It relies on case-based and reconciliation methods, using an ontology. The objective of the chapter is to provide an overview of the state of the art,... more
Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. JSTOR is a not-for-profit service that helps scholars, researchers, and students... more
Process data reconciliation and rectification and their relationship to process performance monitoring functions have been the subject of many recent publications. [See, for instance, Mah (1981) for a review of these publications.] In... more
In this article, we propose an explicit integer optimization formulation for the design of reliable and robust (to uncertainty in reliability data) sensor networks. The robustness is achieved by incorporating simultaneous occurrence of... more
The quality of on-line measurement data usually cannot meet the demands of practical process monitoring and control due to the influence of measurement noise. Although extended Kalman filter (EKF) is able to improve the quality by... more
The availability of small diameter (10-50 mm) hydrocyclones allows classification and clarification of aqueous slurries containing fine particles (down to-2 lam in size). However, in some applications it is necessary to treat ultra-fine... more
Parameters for data collection Kinetic data were recorded at 30 °C. Continuous cell cultures were studied at 37 °C. Further details are explained in the section Experimental Design, Materials and Methods. Description of data collection... more
Download research papers for free!