Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Conclusions
References
All Topics
Computer Science
Operating Systems

K42: an infrastructure for operating system research

Profile image of O. KriegerO. KriegerProfile image of Robert WisniewskiRobert Wisniewski

2006

https://doi.org/10.1145/1131322.1131333
visibility

…

description

10 pages

link

1 file

Abstract

K42 is an open-source scalable research operating system well suited to support systems research. The primary goals of K42's design that support such research include flexibility to allow a multitude of policies and implementations to be supported simultaneously, extensibility to allow new policies and implementations to be readily added, and scalability to enable good performance for both small and large applications on both small and large multiprocessor systems. The goals are accomplished via key features including an objectoriented structure that allows specialized resource management implementations and policies on a per-resource, perapplication basis, implementation in user-level servers of much of the system functionality, and a sophisticated set of underlying services that provides a programming model for developing system software in a scalable and modular fashion.

Related papers

Towards a framework for dedicated operating systems development in high-end computing systems
Rolf Riesen

Operating Systems Review, 2006

In the context of high-end computing systems, general-purpose operating systems impose overhead on the applications they support due to unneeded services. Although dedicated operating systems overcome this issue, they are difficult to develop or adapt. In this paper, we propose a framework, based on the component programming paradigm, which supports the development and adaptation of such operating systems. This framework makes possible the a la carte construction of operating systems which provide specific highend computing system characteristics.

View PDFchevron_right
SPIN - an extensible microkernel for application-specific operating system services
Chris Maeda

1994

Application domains, such as multimedia, databases, and parallel computing, require operating system services with high performance and high functionality. Existing operating systems provide fixed interfaces and implementations to system services and resources. This makes them inappropriate for applications whose resource demands and usage patterns are poorly matched by the services provided. The SPIN operating system enables system services to be defined in an application-specific fashion through an extensible microkernel. It offers fine-grained control over a machine's logical and physical resources to applications through run-time adaptation of the system to application requirements. 1

View PDFchevron_right
The need for customizable operating systems
Dylan J McNamee

Proceedings of IEEE 4th Workshop on Workstation Operating Systems. WWOS-III

View PDFchevron_right
Resource Management in a Multicore Operating System
SIMON PETER
View PDFchevron_right
A tool for isolating performance in general-purpose operating systems
Renato Cerqueira

Proceedings of the 6th international workshop on Middleware for grid computing - MGC '08, 2008

General-purpose Operating Systems do not provide effective mechanisms for application processing reservation. For this reason, some initiatives aim at guaranteeing processing by instrumenting kernels or by isolating the performance through the creation of virtual machines. As will be described in the present paper, CPUReserve works differently from these approaches. It is a processing reservation system that runs at user level. Because CPUReserve presents a client-server architecture and significant scalability -as suggested by the experiments carried out -it can be used in distributed and shared environments just like computational grids.

View PDFchevron_right
Building an adaptive operating system for predictability and efficiency
Sarah Bird

We address the system-level challenge of supporting a dynamically changing, complex mix of simultaneously running applications with diverse requirements including responsiveness, throughput, and performance guarantees. In our approach, called Adaptive Resource Centric Computing (ARCC), the OS distributes resources to QoS domains called cells, which are explicitly parallel lightweight containers with guaranteed, user-level access to resources. The resource allocations are dynamically adjusted whenever applications change state or the mix of applications changes. This paper gives explicit details about our implementation of ARCC on Tessellation OS, an experimental platform for resource management on multicore-based computers. We discuss the implementation of cells, user-level scheduling, and resource allocation policies. Our running example is a realistic video conferencing scenario that incorporates parallelism, QoS guarantees, and dynamic optimization with two-level scheduling. Our system reduces reserved CPU bandwidth to 69.95% of that of a static allocation, while still meeting performance and QoS targets. Performance Counters/ Monitoring Cell Creation Requests Cell #1 (Service) Cell #2 (App) Cell #3 (App) User/System QoS Specifications

View PDFchevron_right
Broad new os research: Challenges and opportunities
David Tarditi

2005

Contemporary software systems are beset by problems that create challenges and opportunities for broad new OS research. To illustrate, we describe five areas where broad OS research could significantly improve the current user experience. These areas are dependability, security, system configuration, system extension, and multi-processor programming. In each area we explore how contemporary systems fall short. Where we have thought of possible solutions, we offer directions for future research. To prove our point that opportunities for new OS research exist, we describe Singularity, a research project at Microsoft Research. Singularity is a new operating system designed to explore solutions to four of the challenges we have identified. Singularity incorporates three specific design decisions in order to increase system dependability and improve system security, configuration, and extension. These design decisions include the adoption of an abstract instruction set as part of the system binary interface, a unified extension architecture for both the OS and applications, and a firstclass application abstraction.

View PDFchevron_right
WebOS: Operating System Services for Wide Area Applications
naveed imran

In this paper, we argue for the power of providing a common set of OS services to wide area applications, including mechanisms for resource discovery, a global namespace, remote process execution, resource management, authentica-tion, and security. On a single machine, application developers can rely on the local operating system to provide these abstractions. In the wide area, however, application developers are forced to build these abstractions themselves or to do without. This ad-hoc approach wastes programmer effort and system resources. To address these problems, WebOS provides basic operating systems services needed to build applications that are geographically distributed, highly available, incrementally scalable, and dynamically reconfiguring. Experience with a number of applications developed under WebOS indicates that it simplifies system development and improves resource utilization. In particular, we use WebOS to implement Rent-A-Server to provide dynamic replication of overloaded services across the wide area in response to client demands.

View PDFchevron_right
π: Effective Use of Metacomputation for Structuring Operating Systems
David Cohn

1993

To respond to continuing hardware advances and changing application demands, operating systems must be flexible. Recently developed metacomputation techniques can provide the desired flexibility. The p architecture investigates the use of metaobject protocols to tailor subsystems of operating systems. It allows effective utilization of events and resources through interfaces for tailorable object implementations. Its main contributions are flexible event management, scope reification and change management. The challenges and possible solutions are described in the context of a distributed shared object subsystem. Keywords: Operating systems, distribution, resources, events, interfaces, reification, metacomputation, scope, distributed shared objects p: Effective Use of Metacomputation for Structuring Operating Systems Dinesh C. Kulkarni, Arindam Banerji, David L. Cohn 1. Introduction There is an emerging need for operating systems to be flexible and it is caused by two key factors: ...

View PDFchevron_right
Operating system directions for the next Millennium
Christopher Fraser

Proceedings. The Sixth Workshop on Hot Topics in Operating Systems (Cat. No.97TB100133), 1997

We believe it is time to reexamine the operating system's role in computing. Operating systems exist to create an environment in which compelling applications come to life. They do that by providing abstractions built on the services provided by hardware. We argue that advances in hardware and networking technology enable a new kind of operating system to support tomorrow's applications. Such an operating system would raise the level of abstraction for developers and users, so that individual computers, file systems, and networks become unimportant to most computations in the same way that processor registers, disk sectors, and physical pages are today.

View PDFchevron_right

References (40)

  1. REFERENCES
  2. Linux VServer Project. http://linux-vserver.org/.
  3. Report from the 4th FAST-OS (forum to address scalable technologies for runtime and operating systems) workshop. http://www.cs.unm.edu/ fas- tos/03workshop/report.pdf, July 2003.
  4. Eric Allen, David Chase, Victor Luschangco, Jan-Willem Maessen, Sukyoung Ryu, Guy L. Steele Jr., and Sam Tobin-Hochstadt. The Fortress language specification (version 0.785). Sun Microsystems, Inc., November 2005.
  5. Thomas E. Anderson, Brian N. Bershad, Edward D. Lazowska, and Henry M. Levy. Scheduler activations: Effective kernel support for the user-level management of parallelism. ACM Transactions on Computer Systems, 10(1):53-79, Feb 1992.
  6. Jonathan Appavoo, Marc Auslander, David Edelsohn, Dilma da Silva, Orran Krieger, Michal Ostrowski, Bryan Rosenburg, Robert W. Wisniewski, and Jimi Xenidis. Providing a Linux API on the scalable K42 kernel. In Freenix track, USENIX Technical Conference, pages 323-336, San Antonio, TX, June 9-14 2003.
  7. Jonathan Appavoo, Kevin Hui, Michael Stumm, Robert Wisniewski, Dilma da Silva, Orran Krieger, and Craig Soules. An infrastructure for multiprocessor run-time adaptation. In WOSS -Workshop on Self-Healing Systems, pages 3-8, 2002.
  8. Gaurav Banga, Peter Druschel, and Jeffrey C. Mogul. Resource containers: a new facility for resource management in server systems. In OSDI'99: Proceedings of the Third Symposium on Operating Systems Design and Implementation, pages 45-58, Berkeley, CA, USA, 1999. USENIX Association.
  9. Andrew Baumann, Jonathan Appavoo, Dilma da Silva, Orran Krieger, and Robert W. Wisniewski. Improving operating system availability with dynamic update. In Workshop of Operating System and Architectural Support for the On-demand IT Infrastructure (OASIS), pages 21-27, Boston Massachusetts, October 9 2004.
  10. Andrew Baumann, Jonathan Appavoo, Dilma Da Silva, Jeremy Kerr, Orran Krieger, and Robert W. Wisniewski. Providing dynamic update in an operating system. In USENIX Technical Conference, pages 279-291, Anaheim, CA, April 2005.
  11. Andrew Baumann, Jeremy Kerr, Jonathan Appavoo, Dilma Da Silva, Orran Krieger, and Robert W. Wisniewski. Module hot-swapping for dynamic update and reconfiguration in K42. In Proc. of 6th Linux.conf.au (LCA), Canberra, April 2005.
  12. Brian N. Bershad, Stefan Savage, Przemyslaw Pardyn, Emin Gun Sirer, Marc E. Fiuczynski, David Becker, Craig Chambers, and Susan Eggers. Extensibility, safety and performance in the SPIN operating system. In ACM Symposium on Operating System Principles, 3-6 December 1995.
  13. Patrick Bohrer, James Peterson, Mootaz Elnozahy, Ram Rajamony, Ahmed Gheith, Ron Rockhold, Charles Lefurgy, Hazim Shafi, Tarun Nakra, Rick Simpson, Evan Speight, Kartik Sudeep, Eric Van Hensbergen, and Lixin Zhang. Mambo: a full system simulator for the PowerPC architecture. SIGMETRICS Perform. Eval. Rev., 31(4):8-12, 2004.
  14. Angela Demke Brown, Todd C. Mowry, and Orran Krieger. Compiler-based I/O prefetching for out-of-core applications. ACM Transactions on Computer Systems, 19(2):111-170, 2001.
  15. Ray Bryant, John Hawkes, and Jack Steiner. Scaling Linux to the extreme: from 64 to 512 processors. In Ottawa Linux Symposium. Linux Symposium, 2004.
  16. Brad Chamberlain. An introduction to Chapel: Cray Cascade's High Productivity Language. In AHPCRC DARPA Parallel Global Address Space (PGAS) Programming Models Conference, Minneapolis, MN, September 2005.
  17. Philippe Charles, Christian Grothoff, Vijay Saraswat, Christopher Donawa, Allan Kielstra, Kemal Ebcioglu, Christoph von Praun, and Vivek Sarkar. X10: an object-oriented approach to non-uniform cluster computing. In OOPSLA '05: Proceedings of the 20th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages and Applications, pages 519-538, New York, NY, USA, 2005. ACM Press.
  18. Dilma da Silva, Livio Soares, and Orran Krieger. KFS: Exploring flexilibity in file system design. In Proc. of the Brazilian Workshop in Operating Systems, Salvador, Brazil, August 2004.
  19. Francis Dang, Maria Jesus Garzaran, Milos Prvulovic, Ye Zhang, Alin Jula, Hao Yu, Nancy Amato, Lawrence Rauchwerger, and Josep Torrellas. Smartapps: An application centric approach to high performance computing: Compiler-assisted software and hardware support for reduction operations. In Proc. Next Generation Software Workshop, pages 10-19, Fort Lauderdale, Florida, April 2002.
  20. Dawson R. Engler, M. Frans Kaashoek, and James O'Toole Jr. Exokernel: an operating system architecture for application-level resource management. In ACM Symposium on Operating System Principles, pages 251-266, 3-6 December 1995.
  21. Marc E. Fiuczynski, Robert Grimm, Yvonne Coady, and David Walker. Patch (1) considered harmful. In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS), Santa Fe, NM, June 2005. USENIX.
  22. Ben Gamsa, Orran Krieger, Jonathan Appavoo, and Michael Stumm. Tornado: maximizing locality and concurrency in a shared memory multiprocessor operating system. In Symposium on Operating Systems Design and Implementation, pages 87-100, February 22-25 1999.
  23. Gregory R. Ganger, Dawson R. Engler, M. Frans Kaashoek, Hector M. Briceno, Russell Hunt, and Thomas Pinckney. Fast and flexible application-level networking on exokernel systems. ACM Transactions on Computer Systems, 20(1):49-83, February 2002.
  24. Gideon Glass and Pei Cao. Adaptive page replacement based on memory reference behavior. In Proceedings of the 1997 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, pages 115-126. ACM Press, 1997.
  25. Jeffrey Katcher. Postmark: A new file system benchmark. Technical Report TR3022, Network Appliance.
  26. Jong Min Kim, Jongmoo Choi, Jesung Kim, Sam H. Noh, Sang Lyul Min, Yookun Cho, and Chong Sang Kim. A low-overhead high-performance unified buffer management scheme that exploits sequential and looping references. In Symposium on Operating Systems Design and Implementation, pages 119-134. USENIX Association, 23-25 October 2000.
  27. Steve R. Kleiman. Vnodes: An architecture for multiple file system types in Sun UNIX. In Proceedings of 1986 Summer USENIX Annual Technical Conference, pages 238-247, Atlanta, GA, USA, 1986.
  28. Orran Krieger, Marc Auslander, Bryan Rosenburg, Robert W. Wisniewski, Jimi Xenidis, Dilma Da Silva, Michal Ostrowski, Jonathan Appavoo, Maria Butrico, Mark Mergen, Amos Waterland, and Volkmar Uhlig. K42: Building a real operating system. In Proceedings of EuroSys'2006, pages 133-145. ACM SIGOPS, April 2006.
  29. Orran Krieger and Michael Stumm. HFS: a performance-oriented flexible file system based on building-block compositions. ACM Transactions on Computer Systems, 15(3):286-321, 1997.
  30. Paul E. McKenney, Dipankar Sarma, Andrea Arcangeli, Andi Kleen, Orran Krieger, and Rusty Russell. Read copy update. In Proceedings of the Ottawa Linux Symposium (OLS), pages 338-367, 26-29 June 2002.
  31. Rodney Van Meter and Minxi Gao. Latency management in storage systems. In Symposium on Operating Systems Design and Implementation, pages 103-117. USENIX Association, 23-25 October 2000.
  32. Jeff Mogul. Operating systems should support business change. In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS), Santa Fe, NM, June 2005. USENIX.
  33. David Mosberger and Larry L. Peterson. Making paths explicit in the Scout operating system. In Symposium on Operating Systems Design and Implementation, volume 30, pages 153-167. ACM, 1996.
  34. Calton Pu, Tito Autrey, Andrew Black, Charles Consel, Crispin Cowan, Jon Inouye, Lakshmi Kethana, Jonathan Walpole, and Ke Zhang. Optimistic incremental specialization: streamlining a commercial operating system. In ACM Symposium on Operating System Principles, volume 29, 3-6 December 1995.
  35. ReiserFS home page, April 2002. http://www.namesys.com.
  36. Margo Seltzer, Yasuhiro Endo, Christopher Small, and Keith A. Smith. An introduction to the architecture of the VINO kernel. Technical report, Harvard University, 1994.
  37. Craig A. N. Soules, Jonathan Appavoo, Kevin Hui, Robert W. Wisniewski, Dilma da Silva, Gregory R. Ganger, Orran Krieger, Michael Stumm, Marc Auslander, Michal Ostrowski, Bryan Rosenburg, and Jimi Xenidis. System support for online reconfiguration. In USENIX Technical Conference, pages 141-154, San Antonio, TX, June 9-14 2003.
  38. Michael M. Swift, Muthukaruppan Annamalai, Brian N. Bershad, and Henry M. Levy. Recovering device drivers. In Procedings of the 6th ACM/USENIX ymposium on Operating Systems Design and Implementation (OSDI), pages 1-16, San Francisco, CA, December 2004. USENIX.
  39. David Tam. Performance analysis and optimization of the Hurricane File System. Master's thesis, Department of Electrical and Computer Engineering, University of Toronto, Toronto, Ontario, Canada, January 2003.
  40. Robert W. Wisniewski and Bryan Rosenburg. Efficient, unified, and scalable performance monitoring for multiprocessor operating systems. In Supercomputing, Phoenix Arizona, November 17-21 2003.

Related papers

Experience with K42, an open-source, Linux-compatible, scalable operating-system kernel
O. Krieger, Robert Wisniewski

IBM Systems Journal, 2000

K42 is an open-source, Linux-compatible, scalable operating-system kernel that can be used for rapid prototyping of operating-system policies and mechanisms. This paper reviews the structure and design philosophy of K42 and discusses our experiences in developing and using K42 in the open-source environment.

View PDFchevron_right
K42: building a complete operating system
Dilma Silva

2006

K42 is one of the few recent research projects that is examining operating system design structure issues in the context of new whole-system design. K42 is open source and was designed from the ground up to perform well and to be scalable, customizable, and maintainable. The project was begun in 1996 by a team at IBM Research. Over the last nine years there has been a development effort on K42 from between six to twenty researchers and developers across IBM, collaborating universities, and national laboratories. K42 supports the Linux API and ABI, and is able to run unmodified Linux applications and libraries. The approach we took in K42 to achieve scalability and customizability has been successful.

View PDFchevron_right
Recent Trends in Operating Systems and their Applicability to
Rolf Riesen

In this paper we consider recent trends in operating systems and discuss their applicability to high performance computing systems. In particular, we will consider the relationship between lightweight kernels, hypervisors, microkernels, modular kernels, and approaches to building systems with a single system image. We then describe how the Catamount lightweight kernel can be extended to support the Xen hypervisor API. This will, in turn, support use of Linux on the compute nodes of a large scale parallel system while minimizing the effort needed to support both, a lightweight OS and a full-featured OS.

View PDFchevron_right
Proposed Challenges And Areas of Concern in Operating System Research and Development
Plawan Rath

2012

Computers are a very important part of our lives and the major reason why they have been such a success is because of the excellent graphical operating systems that run on these powerful machines. As the computer hardware is becoming more and more powerful, it is also vital to keep the software updated in order to utilize the hardware of the system efficiently and make it faster and smarter. This paper highlights some core issues that if dealt with in the operating system level would make use of the full potential of the computer hardware and provide an excellent user experience.

View PDFchevron_right
Extensibility for Commercial Operating Systems
Arindam Banerji

1994

Extensibility enables system services to be adapted to changing hardware and software trends. Providing extensible system services need not necessarily entail construction of new operating systems or inefficient implementations. Rather it can be effectively incorporated into existing commercial operating systems. We have incorporated the programming and run-time support necessary to build extensible system software into the AIX 3.2 kernel. Support for object-orientation within the kernel is provided though system call classes. Efficient crossdomain data transfer is facilitated by a shared object implementation. Loadable subclasses and flexible class objects enable dynamic composition and reconfiguration of system services. This paper describes the design and implementation of this support.

View PDFchevron_right

Related topics

  • Operating Systems
  • Performance Monitoring
  • High End Computing
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved