The Grid-Idea and Its Evolution (Die Grididee und ihre Evolution)
2005, IT
https://doi.org/10.1524/ITIT.2005.47.6.319Abstract
In this paper we review the essence of the Grid-Idea. Specifically, we explore the changing definition of the Grid and follow its evolution over the past decade. This evolution is motivated by the gradual expansion of management issues that must be addressed to make production Grids a reality and to meet user requirements for increased functionality. Additionally, we focus on the evolutionary path of the Globus Toolkit taken to address the increasing needs of the community. We also discuss the evolutionary inclusion of commodity technologies as illustrated by the Java Commodity Grid Project. Grid computing has become a valuable asset in scientific and business communities for integrating distributed resources needed to match increased requirements in managing computations and data . We have seen the development of single computers, mainframes, vector computers, parallel computers, distributed computers, and metacomputers and, most recently, the emergence of the Grid infrastructure. With these developments several issues have arisen: (1) the ever increasing need of scientists to gain access to massive computing power; (2) the recognition that the most powerful computers, while useful for solving complex problems, may be too ex- * The submitted manuscript has been created by the University of Chicago as Operator of Argonne National Laboratory ("Argonne") under Contract No. W-31-109-ENG-38 with the U.S. Department of Energy. The U.S. Government retains for itself, and others acting on its behalf, a paid-up, nonexclusive, irrevocable worldwide license in said article to reproduce, prepare derivative works, distribute copies to the public, and perform publicly and display publicly, by or on behalf of the Government.
References (71)
- 1996 2005 1997 1998 1999 2000 2001 2002 2003 2004 2005 1998 NASA IPG Launched 2001 DOE Science Grid 2000 NASA IPG Prototype 2002 PlanetLab 1997 GUSTO 2001 Alliance Virtual Machine Room 1997 Condor@NCSA 1996 SETI@HOME 2004 TeraGrid 2003 Grid2003/Grid3 2003 NAREGI 2000 ASCI DRM References
- XML Schema, Primer 0 -3, 2001. Available from: http: //www.w3.org/XML/Schema.
- The Access Grid. Web Page. Available from: http:// www-fp.mcs.anl.gov/fl/accessgrid/.
- Bill Allcock, Joe Bester, John Bresnahan, Ann L. Cher- venak, Carl Kesselman, Sam Meder, Veronika Nefedova, Darcy Quesnel, Steven Tuecke, and Ian Foster. Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. In MSS '01: Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies, page 13, Wash- ington, DC, USA, 2001. IEEE Computer Society.
- ApGrid: Partnership for Grid Computing in the Asia Pa- cific Region. Web Page, 2001. Available from: http: //www.apgrid.org/.
- Fran Berman, Anthony Hey, and Geoffrey Fox, editors. Grid Computing: Making the Global Infrastructure a Re- ality. Number ISBN:0-470-85319-0. John Wiley, 2003.
- D. Bhatia, V. Burzevski, M. Camuseva, G. C. Fox, W. Furmanski, and G. Premchandran. WebFlow -a vi- sual programming paradigm for Web/Java based coarse grain distributed computing. Concurrency: Practice and Experience, 9(6):555-577, 1997.
- R. Butler, D. Engert, I. Foster, C. Kesselman, S. Tuecke, J. Volmer, and V. Welch. A National-Scale Authentica- tion Infrastructure. IEEE Computer, 33(12):60-66, 2000.
- Roberto Chinnici, Martin Gudgin, Jean-Jacques Moreau, and Sanjiva Weerawarana. Web Services Description Language Version 1.2, July 2002. W3C Working Draft 9. Available from: http://www.w3.org/TR/2002/ WD-wsdl12-20020709/.
- Condor: High Throughput Computing. Web Page. Avail- able from: http://www.cs.wisc.edu/condor/.
- K. Czajkowski, I. Foster, and C. Kesselman. Co-allocation Services for Computational Grids. In Proceedings of the 8th IEEE Symposium on High Performance Distributed Computing, 1999.
- Doe Science Grid. Web Page. Available from: http: //www.doesciencegrid.org/.
- FAFNER. Web Page, Syracuse University. Available from: http://www.npac.syr.edu/factoring.html.
- I. Foster, J. Geisler, W. Nickless, W. Smith, and S. Tuecke. Software Infrastructure for the I-WAY High Performance Distributed Computing Experiment. In Proc. 5th IEEE Symposium on High Performance Dis- tributed Computing, pages 562-571, 1997. Available from: ftp://ftp.globus.org/pub/globus/papers/isoft.pdf.
- I. Foster and C. Kesselman. Globus: A metacomputing infrastructure toolkit. International Journal of Supercom- puter Applications, 11(2):115-128, 1997.
- I. Foster and C. Kesselman, editors. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, July 1998.
- I. Foster and C. Kesselman, editors. The Grid 2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, 2004. second eddition.
- I. Foster, C. Kesselman, et al. The Physiology of the Grid:An Open Grid Services Architecture for Distributed Systems Integration. Technical report, Argonne National Laboratory, Chicago, January 2002.
- I. Foster, C. Kesselman, and S. Tuecke. The nexus ap- proach to integrating multithreading and communication. Journal Parallel and Distributed Computing, 37:70-82, 1996.
- Ian Foster. Personal communication.
- Ian Foster. The Grid: A New Infrastructure for 21st Cen- tury Science. Physics Today, 55(22):42, 2002. Available from: http://www.aip.org/pt/vol-55/iss-2/p42.html.
- Ian Foster, Jeffrey Frey, Steve Graham, Steve Tuecke, Karl Czajkowski, Don Ferguson, Frank Leymann, Mar- tin Nally, Igor Sedukhin, David Snelling, Tony Storey, William Vambenepe, and Sanjiva Weerawarana. Modeling Stateful Resources with Web Services. Technical report, IBM Developerworks, 5 March 2004. Version 1.1. Avail- able from: http://www-128.ibm.com/developerworks/ library/ws-resource/ws-modelingresources.pdf.
- Ian Foster, Carl Kesselman, Jeffrey M. Nick, and Steven Tuecke. Grid Computing: Making the Global Infras- tructure a Reality, chapter The Physiology of the Grid, pages 217-249. Wiley, 2003. Available from: http: //www.globus.org/research/papers/ogsa.pdf.
- Ian Foster, Carl Kesselman, and Steve Tuecke. The Anatomy of the Grid: Enabling Scalable Virtual Orga- nizations. International Journal of Supercomputing Ap- plications, 15(3), 2002. Available from: http://www. globus.org/research/papers/anatomy.pdf.
- Ian Foster, George Thiruvathukal, and Steve Tuecke. Technologies for Ubiquitous Supercomputing: A Java In- terface to the Nexus Communication system. Concur- rency: Practice and Experience, June 1997.
- The Global Grid Forum Web Page. Web Page. Available from: http://www.gridforum.org.
- Grid3: An Application Grid Laboratory for Science. Web Page. Available from: http://www.ivdgl.org/grid2003/.
- GriPhyN -Grid Physics Network. Web page. Available from: http://www.griphyn.org/index.php.
- Globus Ubiquitous Supercomputing Testbed Organiza- tion (GUSTO). Web page, 1998. Available from: http: //www-fp.globus.org/research/testbeds.html.
- Information Power Grid Engeneering and Research Site. Web Page, 2001. Available from: http://www.ipg.nasa. gov/.
- The International Virtual Data Grid Laboratory. Web Page. Available from: http://www.ivdgl.org/.
- N. Karonis, B. Toonen, and I. Foster. MPICH-G2: A Grid-Enabled Implementation of the Message Passing In- terface. Journal of Parallel and Distributed Computing (JPDC), to appear, 2003. Available from: ftp://ftp. cs.niu.edu/pub/karonis/papers/JPDC_G2/JPDC_G2.pdf.
- Leonard Kleinrock. UCLA to Build The First Sta- tion in Nationwide Computer Network. Press Release, 1969. Available from: http://www.lk.cs.ucla.edu/LK/ Bib/REPORT/press.html.
- The Legion Project. Web Page. Available from: http: //legion.virginia.edu.
- Robert McMillan. Grid guru: An interview with argonne's steve tuecke. IBM Developerworks, 2003. Available from: http://www-106.ibm.com/developerworks/java/ library/j-tuecke.html?dwzone=java.
- NSF Middleware Initiative. Web Page. Available from: http://www.nsf-middleware.org/Middleware/.
- J. Novotny. The Grid Portal Development Kit, 2001. Available from: http://dast.nlanr.net/ Projects/GridPortal/.
- Open Grid Computing Environments. Web Page. Avail- able from: http://www.ogce.org.
- Manish Parashar and Craig A. Lee. Scanning the Issue: Special Isssue on Grid-Computing.
- Manish Parashar and Craig A. Lee. Special Isssue on Grid-Computing. Proceedings of the IEEE, 93(3), March 2005. Available from: http://ieeexplore.ieee.org/ xpl/tocresult.jsp?isNumber=30407&puNumber=5.
- Manish Parashar, Gregor von Laszewski, Snigdha Verma, Jarek Gawor, and Kate Keahey. A CORBA Com- modity Grid Kit. Concurrency and Computation: Practice and Experience, 14:1057-1074, 2002. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ corbacog-ccpe-gce01-final.pdf.
- Particle Physics Data Grid. Web Page, 2001. Available from: http://www.ppdg.net/.
- pyGlobus Commodity Grid Kit. Web Page. Available from: http://dsd.lbl.gov/gtg/projects/pyGlobus/.
- David De Roure, Mark A. Baker, Nicholas R Jennings, and Nigel R. Schadbolt. Grid Computing: Making the Global Infrastructure a Reality, chapter The Evolution of the Grid, pages 65-100. Number ISBN:0-470-85319- 0. John Wiley, 2003.
- Scientific Discovery through Advanced Computing (Sci- DAC). Web Page, 2001. Available from: http://scidac. org/.
- SETI@Home. Web Page, February 2002. Available from: http://setiathome.ssl.berekeley.edu/.
- L. Smarr and C.E. Catlett. Metacomputing. Communi- cations of the ACM, 35(6):44-52, 1992.
- Larry Smarr. Multimedia online expo, "science for the millennium.". Online, 1995. NCSA. Avail- able from: http://archive.ncsa.uiuc.edu/Cyberia/ MetaComp/MetaHome.html.
- David F. Snelling. Web Services Resource Framework: Impacton OGSA and the Grid Computing Roadmap. 2(1):1, 2004.
- Storage Resource Broker (SRB). Web Page, 2001. Avail- able from: http://www.npaci.edu/DICE/SRB/.
- P. Stelling, C. DeMatteis, I. Foster, C. Kesselman, C. Lee, and G. von Laszewski. A Fault Detection Service for Wide Area Distributed Computations. Cluster Comput- ing, 2(2):117-128, 1999. Available from: http://www. globus.org/research/papers/stelling--hbm.pdf.
- TeraGrid. Web Page, 2001. Available from: http://www. teragrid.org/.
- Mary Thomas, Steve Mock, and Gregor von Laszewski. A Perl Commodity Grid Kit. Concurrency and Computa- tion: Practice and Experience, 14:1085-1095, 2002. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--perl-cog.pdf.
- John Towns. The Alliance Virtual Machine Room. Web Page, 2001. Available from: http://archive.ncsa.uiuc. edu/SCD/Alliance/VMR/.
- Steve Tuecke. Personal communication.
- Steven Tuecke, Karl Czajkowski, Ian Foster, Jeffrey Frey, Steve Graham, and Carl Kesselman. Grid Service Spec- ification (Draft 2). Web page, June 2002. Available from: http://www.gridforum.org/ogsi-wg/drafts/GS_ Spec_draft02_2002-06-13.pdf.
- Unicore. Web Page. Available from: http://www. unicore.de/.
- Gregor von Laszewski. An Interactive Parallel Pro- gramming Environment Applied in Atmospheric Sci- ence. In G.-R. Hoffman and N. Kreitz, editors, Mak- ing Its Mark, Proceedings of the 6th Workshop on the Use of Parallel Processors in Meteorology, pages 311- 325, Reading, UK, 2-6 December 1996. European Centre for Medium Weather Forecast, World Scientific. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--ecwmf-interactive.pdf.
- Gregor von Laszewski. A Loosely Coupled Metacom- puter: Cooperating Job Submissions Across Multiple Supercomputing Sites. Concurrency, Experience, and Practice, 11(5):933-948, December 1999. The initial version of this paper was available in 1996. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--CooperatingJobs.ps.
- Gregor von Laszewski. Grid Computing: Enabling a Vi- sion for Collaborative Research. In Juha Fagerholm, Juha Haataja, Jari Järvinen, Mikko Lyly, Peter Raback, and Ville Savolainen, editors, The Sixth International Con- ference on Applied Parallel Computing, volume 2367 of Lecture Notes in Computer Science, pages 37-52, Espoo, Finland, 15-18 June 2002. Springer. (Invited Talk). Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--para4.pdf.
- Gregor von Laszewski and Kaizar Amin. Grid Middleware, chapter Middleware for Commnica- tions, pages 109-130. Wiley, 2004. Available from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--grid-middleware.pdf.
- Gregor von Laszewski, Steve Fitzgerald, Ian Foster, Carl Kesselman, Warren Smith, and Steve Tuecke. A Directory Service for Configuring High-Performance Distributed Computations. In Proceedings of the 6th IEEE Sym- posium on High-Performance Distributed Computing, pages 365-375, Portland, OR, 5-8 August 1997. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ fitzgerald--hpdc97.pdf.
- Gregor von Laszewski, Ian Foster, George K. Thiru- vathukal, and Brian Toonen. A Computational Frame- work for Telemedicine. Journal of Future Gener- ation Computer Systems, 14:10-123, 1998. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--telemed.pdf.
- Gregor von Laszewski, Jarek Gawor, Sriram Krish- nan, and Keith Jackson. Grid Computing: Making the Global Infrastructure a Reality, chapter Commod- ity Grid Kits -Middleware for Building Grid Comput- ing Environments, pages 639-656. Communications Net- working and Distributed Systems. Wiley, 2003. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--grid2002book.pdf.
- Gregor von Laszewski, Jarek Gawor, Carlos J. Peña, and Ian Foster. InfoGram: A Peer-to-Peer Information and Job Submission Service. In Proceedings of the 11th Symposium on High Performance Distributed Computing, pages 333-342, Edinbrough, U.K., 24-26 July 2002. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--infogram.ps.
- Gregor von Laszewski, Branko Ruscic, Kaizar Amin, Patrick Wagstrom, Sriram Krishnan, and Sandeep Ni- jsure.
- A Framework for Building Scientific Knowl- edge Grids Applied to Thermochemical Tables. The International Journal of High Performance Comput- ing Applications, 17(4):431-447, Winter 2003. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--knowledge-grid.pdf.
- Gregor von Laszewski, Mike Seablom, Milo Makivic, Pe- ter Lyster, and Sanya Ranka. Design Issues for the Par- allelization of an Optimal Interpolation Algorithm. In G.-R. Hoffman and N. Kreitz, editors, Coming of Age, Proceedings of the 4th Workshop on the Use of Paral- lel Processing in Atmospheric Science, pages 290-302, Reading, UK, 21-25 November 1994. European Centre for Medium Weather Forecast, World Scientific. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski94-4dda-design.pdf.
- Gregor von Laszewski, Mei-Hui Su, Joseph A. Insley, Ian Foster, John Bresnahan, Carl Kesselman, Marcus Thiebaux, Mark L. Rivers, Steve Wang, Brian Tieman, and Ian McNulty. Real-Time Analysis, Visualization, and Steering of Microtomography Experiments at Pho- ton Sources. In Ninth SIAM Conference on Parallel Pro- cessing for Scientific Computing, San Antonio, TX, 22- 24 March 1999. Available from: http://www.mcs.anl. gov/~gregor/papers/vonLaszewski--siamCmt99.pdf.
- Gregor von Laszewski and Patrick Wagstrom. Tools and Environments for Parallel and Distributed Comput- ing, chapter Gestalt of the Grid, pages 149-187. Par- allel and Distributed Computing. Wiley, 2004. Avail- able from: http://www.mcs.anl.gov/~gregor/papers/ vonLaszewski--gestalt.pdf.
- Web Services Resource Framework (WSRF). Web Page. Available from: http://www.globus.org/wsrf.