Academia.eduAcademia.edu

Outline

Title
Abstract
Service Orie Ted Spatial Data I Tegratio
Data Layer
References

Rule based ETL (RETL) approach for GEO spatial data warehouse

Profile image of Norhaira NordinNorhaira Nordin

2014

Abstract

This paper presents the use of Service Oriented Architecture (SOA) for integrating multi source heterogeneous geospatial data in order to facilitate geospatial data warehouse. In this study, Real Based ETL (RETL) concept is adapted in order to extract, transform and load data from a variety of heterogeneous data sources. ETL will transform data to schematic format and loading data into the Geo spatial data warehouse.By using a rule-based technique, the distribution of parallel ETL pipeline will enhance and perform more efficient in large scale of data and overcome data bottleneck and performance overhead. This can ease the disaster management and enables planners to monitor disaster emergency response in an efficient manner.

Related papers

Design of Service-Oriented Architecture for Spatial Data Integration and Its Application in Building Web-based GIS Systems
Yichun Xie

In this paper we propose a service-oriented architecture for spatial data integration (SOA-SDI) in the context of a large number of available spatial data sources that are physically sitting at different places, and develop web-based GIS systems based on SOA-SDI, allowing client applications to pull in, analyze and present spatial data from those available spatial data sources. The proposed architecture logically includes 4 layers or components; they are layer of multiple data provider services, layer of data integration, layer of backend services, and front-end graphical user interface (GUI) for spatial data presentation. On the basis of the 4-layered SOA-SDI framework, WebGIS applications can be quickly deployed, which proves that SOA-SDI has the potential to reduce the input of software development and shorten the development period. ► Supported by the Research Fund of Key GIS Lab of the Education Ministry (No. 200610). ► SHA Zongyao is currently an associate professor at International School of Software, Wuhan University. He received Ph.D. degree in photogrammetry and remote sensing in 2003. Geospatial web services, spatial data mining, and GIS and remote sensing applications in grassland ecology are the research areas he is interested in. ►

View PDFchevron_right
An approach for service oriented discovery and retrieval of spatial data
Manoj Paul

Proceedings of the 2006 international workshop on Service-oriented software engineering - SOSE '06, 2006

Successful information integration and sharing data across disparate systems and designs are required for fast access to and interpretation of many types of geospatial information. Spatial data are highly heterogeneous-not only they differ from data representation and storage methods, but they also differ in the way of querying the data. Finding and accessing spatial data in an environment like this is a crucial task. Enterprise geographic information system (E-GIS) is an organization-wide approach to GIS implementation, operation, and management. The main focus of the paper is to integrate diverse spatial data repositories for geographic applications using service-based methodology. We have adopted service-oriented architecture (SOA) for the discovery and retrieval of geospatial data. The architecture uses a central ontology as metadata information, which acts as service broker. Ontology-based discovery and retrieval of geographic data solves the problem of semantic heterogeneity, the major bottleneck for spatial interoperability. The implementation is in compliant with the Web Map Service (WMS) and Web Feature Service (WFS), the web service standards proposed by OGC. The need for loosely coupled service-based access of data in the spatial domain has been exploited. A query processing mechanism in distributed environment of spatial data sources has been discussed at the end. The proposed system has been implemented and fully tested.

View PDFchevron_right
GMLA: A XML Schema for Integration and Exchange of Multidimensional-Geographical Data
Robson Fidalgo

2003

The integration among DW, OLAP and GIS has been given considerable attention in recent years by many researchers and industrial corporations. This may be a result of: 1) DW/OLAP can improve GIS spatial queries whereas, 2) a GIS can provide better support to deal with the DW/OLAP geographic data. Some research about this integration has already been done. However, these approaches do not deal with open and extensible solutions. In order to address this problem, we use the GOLAPA architecture, which follows Java, XML and Web Service technologies. Based on this architecture, this paper proposes GML for Analysis (GMLA), which provides a XML format to integrate and interchange geographical multidimensional data. GMLA is based on OLAP and GIS XML standards, namely XML for Analysis (XMLA) and Geography Markup Language (GML), respectively.

View PDFchevron_right
A geo-service semantic integration in spatial data infrastructures
Maurizio Marchese

International Journal, 2009

In this paper we focus on the semantic heterogeneity problem as one of the main challenges in current Spatial Data Infrastructures (SDIs). We first report on the state of the art in reducing such a heterogeneity in SDIs. We then consider a particular geo-service integration ...

View PDFchevron_right
An Intelligent ETL Grid-Based Solution to Enable Spatial Data Warehouse Deployment in Cyber Physical System Context
Nafaa Jabeur

Procedia Computer Science, 2015

Thanks to their spatially distributed sensors, Cyber-Physical System (CPS) applications are currently accumulating large amounts of heterogeneous data. When it comes to allowing several decision-makers to collaboratively plan their actions, these applications need appropriate tools for an efficient storage, analysis, and visualization of the available data. Spatial Data Warehouses (SDWs) have proven their efficiency in carrying out these operations. However, because of the increasing quantity of data, the Extract-Transform-Load (ETL) process (which is in charge of aggregating several data sources within a unified data storage repository) generally fails to update the SDW within predefined window times. In order to solve this problem, we propose in this paper to distribute the ETL tasks over a grid of computing resources. We also propose a multiagent-based approach that controls the ETL grid while allowing a convenient use of the shared resources. In addition to being the unique solution that uses grid computing for the ETL process of SDWs, our approach allows a joint use of archive and real-time data for personalized reporting and visualization of services envisioned to the decision-makers who are using the CPS application.

View PDFchevron_right
A Service Oriented Architecture for Spatial and Business Data Applications: an eCampus Case Study
James Carswell

2012

View PDFchevron_right
A CONCEPTUAL METADATA FRAMEWORK FOR SPATIAL DATA WAREHOUSE
Kanna Velusamy

Metadata represents the information about data to be stored in Data Warehouses. It is a mandatory element of Data Warehouse to build an efficient Data Warehouse. Metadata helps in data integration, lineage, data quality and populating transformed data into data warehouse. Spatial data warehouses are based on spatial data mostly collected from Geographical Information Systems (GIS) and the transactional systems that are specific to an application or enterprise. Metadata design and deployment is the most critical phase in building of data warehouse where it is mandatory to bring the spatial information and data modeling together. In this paper, we present a holistic metadata framework that drives metadata creation for spatial data warehouse. Theoretically, the proposed metadata framework improves the efficiency of accessing of data in response to frequent queries on SDWs. In other words, the proposed framework decreases the response time of the query and accurate information is fetched from Data Warehouse including the spatial information.

View PDFchevron_right
Geoinformatics Technology Distributed Geospatial Database Development for Economic Crisis Management and Natural Disasters
Taha A L F A D U L Taha Ali

Academic Journal of Research and Scientific Publishing| AJRSP(2706-6495), 2022

Distributing Geodatabase allows organizations to disperse their data as necessary from central servers to regional or local offices, which may be in a connected or disconnected environment. The aim of this study is distributed geospatial database development For Economic Crisis Management and Natural Disasters (ECM-GDB) using Geoinformatics technology. The motivation is deep need to organize the Economic Crisis Management and Natural Disasters in Sudan. The objectives are: Define the crisis & emergency concepts, Design and implementation Economic Crisis Management and Natural Disasters Geodatabase (ECM-GDB) Geodatabase in Sudan, and apply GIS call center Managing Economic Crises and Natural Disasters the GIS call center. The importances are to support decision maker in Government, Society and Customer. The methodology depends on GIS phases. There are many recommendations of this study: build ECM System. Also There are many future researches: build many mobile applications specific ECM.

View PDFchevron_right
Data Warehousing Concept Using ETL Process For Informatica Mapping Designer, K.Srikanth, N.V.E.S Murthy, J.Anitha
Nistala V.E.S. Murthy
View PDFchevron_right
Development of Spatial Data Infrastructure based on Free Data Integration
maythm al-bakri

Journal of Engineering

In recent years, the performance of Spatial Data Infrastructures for governments and companies is a task that has gained ample attention. Different categories of geospatial data such as digital maps, coordinates, web maps, aerial and satellite images, etc., are required to realize the geospatial data components of Spatial Data Infrastructures. In general, there are two distinct types of geospatial data sources exist over the Internet: formal and informal data sources. Despite the growth of informal geospatial data sources, the integration between different free sources is not being achieved effectively. The adoption of this task can be considered the main advantage of this research. This article addresses the research question of how the integration of free geospatial data can be beneficial within domains such as Spatial Data Infrastructures. This was carried out by suggesting a common methodology that uses road networks information such as lengths, centeroids, start and end points,...

View PDFchevron_right

References (23)

  1. Knowledge Management International Conference (KMICe) 2014, 12 -15 August 2014, Malaysia http://www.kmice.cms.net.my/ 571 REFERE CES
  2. Basco, J. R., Gerardo, B. D., Dofitas Jr., C., & Byun, Y.-C. (2012). A Rule-based Parallel Processing to Speed-Up an Application. 2012 IEEE 14th International Conference on Commerce and Enterprise Computing, 144-146. doi:10.1109/CEC.2012.32
  3. Chen, X., & Chi, Z. (2004). Applying dp to etl of spatial data warehouse, (August), 26-29.
  4. Feng, Y.-H., & Lee, C. J. (2010). Exploring Development of Service- Oriented Architecture for Next Generation Emergency Management System. 2010 IEEE 24th International Conference on Advanced Information etworking and Applications Workshops, 557-561. doi:10.1109/WAINA.2010.198
  5. Kimball, R., & Caserta, J. (2004). The Data Warehouse ETL Toolkit. Wiley Publishing, Inc.
  6. Microsoft. (2012).Integration Services (SSIS) -SQL Server. (n.d.). Retrieved from http://msdn.microsoft.com/en- us/sqlserver/cc511477.aspx
  7. Mendes, S. F., & Falcone Sampaio, P. R. (1998). Rule-based parallel query optimization for OQL using a parallelism extraction technique. Proceedings inth International Workshop on Database and Expert Systems Applications (Cat. o.98EX130), 705-710. doi:10.1109/DEXA.1998.707485
  8. Naeem, M. A., Dobbie, G., Weber, G., Bag, P., Street, P., & Zealand, N. (2008). An Event-Based Near Real-Time Data Integration Architecture Keywords :
  9. Niu, H., Guo, P., Lu, Y., & Chen, H. (2011). Disaster Recovery, 1-4.
  10. Oracle. (1997).Parallel Programming with Microsoft . ET. (2010, January). Retrieved from http://docs.oracle.com/cd/A58617_01/server.804/a58238/ch1_und e.htm Oracle. (201 0). Oracle Warehouse Builder. Retrieved 3/2/20 10, from http://www.oracle.com/technetwork/developer- tools/warehouse/overview/index.ht~nl.
  11. Rifaie, M., Blas, E. J., Muhsen, A. M., Mok, T. T. H., & Ridley, M. J. (2008). Data Warehouse Architecture for GIS Applications, (178), 178-185.
  12. Santos, R. J., Bernardino, J., & Vieira, M. (2011). 24 / 7 Real-Time Data Warehousing : A Tool for Continuous Actionable Knowledge. doi:10.1109/COMPSAC.2011.44
  13. Song, J., Bao, Y., & Shi, J. (2010). A Triggering and Scheduling Approach for ETL in A Real-time Data Warehouse, (Cit), 91-98. doi:10.1109/CIT.2010.57
  14. Song, W., Chen, J., & Yang, Y. (2011). OPERATIONAL DATA STORE OF MULTI-PLATFORM , MULTI-SOURCE , MULTI-SCALE , MULTI-TEMPORAL DATA SETS, (68), 2-5.
  15. Sun, K. (2012). SETL : A Scalable And High Performance ETL System, 8-11.
  16. Tedrick J. (2013). The Best of ArcGIS 10.2. Retrieved from http://msdn.microsoft.com/en-us/sqlserver/cc511477.aspx
  17. Tok, W., Parida, R., Masson, M., Ding, X., & Sivashanmugam, K. (2012). Microsoft SQL Server 2012 Integration Service.
  18. Wang, X., Liu, J., Wang, Y., & Xu, S. (2011). Service-oriented Integration and Application of Earthquake Emergency Information, (7771014).
  19. Wenfeng, Z. (2010). Spatial information integration of earthquake disaster prevention and reduction based on SOA. The 2nd International Conference on Information Science and Engineering, 1-4. doi:10.1109/ICISE.2010.5689162
  20. Ying, L., Yang, W., Ya-fu, C., & Li-zhou, F. (2010). The Application of Spatial Data Warehouse Technology in The National Petroleum Resources Database, 257-260.
  21. Yvan Bédard, & Han, J. (2009). Fundamentals of Spatial Data Warehousing for Geographic Knowledge Discovery, 45-68.
  22. Zheng, Z., He, S., Xiong, Z., Liu, Z., & Framework, A. S. O. A. (2011). Hydrologic Prediction and Visualization Integrated Mobile System Based on Service Oriented Architecture, (200805016).
  23. Zheng, Z., Huang, D., & Zhang, J. (2010). A SOA-based Decision Support Geographic Information System for Storm Disaster Assessment, (200805016).

Related papers

Developing Geospatial Service-Oriented Architecture for Realizing Spatial Data Infrastructure
M. Saadi Mesgari

International Journal of Multimedia and Image Processing, 2011

Establishing the accessibility and usability of spatial data is one of the most important goals of SDI 1. In this respect, during recent years, a great number of spatial data\processes have been published through Open Geospatial Consortium (OGC) interfaces. Due to absence of semantic interoperability, Users encounter many problems in finding and combining of OGC services. In this article, we propose a service oriented architecture to solve the existing problems in finding and combining of OGC services. In this architecture, semantic catalogue service and dynamic chaining were used for finding and combining of spatial services respectively. Furthermore, in the architecture, other OGC services were utilized for transformation, view and download spatial data. Semantic catalogue service generates and saves the ontology of submitted services automatically. Users can utilize semantic queries for accessing, invoking and interpretation of saved ontology. Therefore, the semantic web capabilities were used in the semantic catalogue service (without requiring any change in the publishing methods). In order to facilitate exchanging spatial data as the main goal of SDI, the catalogue service provides the possibility of exchanging information about spatial data in form of choreography. Finally, the proposed method was evaluated using a case study.

View PDFchevron_right
Spatial Data Warehouse – A Prototype
Karine Zeitouni

Lecture Notes in Computer Science, 2003

Nowadays, there are an emergence of spatial or geographic data stored in several and heterogeneous databases, mostly in Geographic Information Systems (GIS). The diversity of GIS and the increasing accumulation of non-spatial (simple attributes) and spatial (geometric shapes) data make it difficult to apply conventional OLAP and data mining tools. Thus, the need to build a spatial data warehouse over heterogeneous GIS is becoming necessary in many fields. Our architecture is a central type architecture based on GML (for spatial data representation) and more generally on XML (for all data). In this paper we will focus on the study of data integration into a data warehouse, and data representation. We will show how the specificities of our architecture contribute to manage spatial and non-spatial data.

View PDFchevron_right
Integration of Heterogeneous Spatial Databases for Disaster Management
mustapha yusuf

Lecture Notes in Computer Science, 2014

The response phase in a disaster case is often considered to be the most critical in terms of saving lives and dealing with irreversible damage. The timely provision of geospatial information is crucial in the decision-making process. Thus, there is a need for the integration of heterogeneous spatial databases which are inherently distributed and created under different projects by various organizations. The integration of all relevant data for timely decision making is a challenging task due to syntactic, schematic and semantic heterogeneity. This paper aims to propose a framework for the integration of heterogeneous spatial databases using novel approaches, such as web services and ontologies. We focus on providing solutions for the three levels of heterogeneity, in order to be able to interrogate the content of the different databases conveniently. Based on the proposed framework, we implemented a use case using heterogeneous data belonging to La Rochelle city in France.

View PDFchevron_right
A Query-Driven Spatial Data Warehouse Conceptual Schema For Disaster Management
Safiza Suhana

2016

Malaysia has experienced various types of disasters. Such events cause billions of USD and posing great challenges to a nation’s government to provide better disaster management. Indeed, disaster management is an important global problem. The National Security Council’s (NSC) Directive No. 20 outlines Malaysia’s policy on disaster and relief management demonstrates government efforts and initiatives to efficiently respond to disasters. In this regard, decision making is a key factor for organizational success. Positive outcomes are dependent on available data that can be manipulated to provide information to the decision maker, who faces the difficult and complex task of anticipating upcoming events and analyzing multiple parameters. Disaster management involves multiple sources for data collection at various levels as well as a wide array of stakeholders. Hence, accessibility to heterogenous spatial data is challenging. It is crucial to address this problem in terms of data distrib...

View PDFchevron_right
An automatic transition from the design to the implementation of a spatial data warehouse
Sami Yassine Turki

International Journal of Computational Systems Engineering, 2018

Existing approaches for the design and implementation of spatial data warehouses have not considered spatial and non-spatial decision maker's requirements. In this paper, we propose an approach based on the model driven architecture to transit automatically from the design of the spatial data warehouse to its implementation. The implementation takes into account spatial and non-spatial requirements. We use the formalism of the platform independent model to design the spatial data warehouse and the platform specific model for the implementation. An experimentation of the different steps of our approach is presented. The case study is about five users in urban governance field. The experimentation allowed to generate a personalised spatial data warehouse for a group of users sharing similar spatial requirements. The experimentation is evaluated by the use of the diffusion theory.

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved