Demo

Proceedings of the 2006 international workshop on Network and operating systems support for digital audio and video - NOSSDAV '06, 2006

Despite the growing popularity and advantages of thin-client systems, they still have some important shortcomings. Current thin-client systems are ideally suited to be used with classic office-applications but as soon as multimedia and 3D gaming applications are used they require a large amount of bandwidth and processing power. Furthermore, most of these applications heavily rely on the Graphical Processing Unit (GPU). Due to the architectural design of thin-client systems, they cannot profit from the GPU resulting in slow performance and bad image quality. In this paper, we propose a thin-client system which addresses these problems: we introduce a realtime desktopstreamer using a videocodec to stream the graphical output of applications after GPUprocessing to a thin-client device, capable of decoding a videostream. We compare this approach to a number of popular classic thin-client systems in terms of bandwidth, delay and image quality. The outcome is an architecture for a hybrid protocol, which can dynamically switch between a classic thin-client protocol and realtime desktopstreaming.

IEEE Transactions on Visualization and Computer Graphics, 2000

Mobile devices such as Personal Digital Assistants, Tablet PCs, and cellular phones have greatly enhanced user capability to connect to remote resources. Although a large set of applications are now available bridging the gap between desktop and mobile devices, visualization of complex 3D models is still a task hard to accomplish without specialized hardware. This paper proposes a system where a cluster of PCs, equipped with accelerated graphics cards managed by the Chromium software, is able to handle remote visualization sessions based on MPEG video streaming involving complex 3D models. The proposed framework allows mobile devices such as smart phones, Personal Digital Assistants (PDAs), and Tablet PCs to visualize objects consisting of millions of textured polygons and voxels at a frame rate of 30 fps or more depending on hardware resources at the server side and on multimedia capabilities at the client side. The server is able to concurrently manage multiple clients computing a video stream for each one; resolution and quality of each stream is tailored according to screen resolution and bandwidth of the client. The paper investigates in depth issues related to latency time, bit rate and quality of the generated stream, screen resolutions, as well as frames per second displayed.

ACM Transactions on Multimedia Computing, Communications, and Applications, 2012

Mobile devices are gradually changing people's computing behaviors. However, due to the limitations of physical size and power consumption, they are not capable of delivering a 3D graphics rendering experience comparable to desktops. Many applications with intensive graphics rendering workloads are unable to run on mobile platforms directly. This issue can be addressed with the idea of remote rendering: the heavy 3D graphics rendering computation runs on a powerful server and the rendering results are transmitted to the mobile client for display. However, the simple remote rendering solution inevitably suffers from the large interaction latency caused by wireless networks, and is not acceptable for many applications that have very strict latency requirements. In this article, we present an advanced low-latency remote rendering system that assists mobile devices to render interactive 3D graphics in real-time. Our design takes advantage of an image based rendering technique: 3D im...

This paper presents a new distributed video game streaming system. Newly developed streaming protocols and system architectures enable transfer of the game graphics in real-time across the wired / wireless network. Initial tests have shown that the Games@Large system is capable of running video games of different genres, also including First Person Shooter games that are very popular and usually highly interactive and demanding for high end device performance. Further, the experiments prove that a Games@Large server can be hosted on a single PC and support multiple game executions and streaming with a high visual quality to concurrently connected clients via a wireless / wired network. In particular, a Quality of Service solution is exploited, which improves system performance also in the presence of competing traffic.

Lecture Notes in Computer Science, 2013

Nowadays mobile phones, especially smartphones, are equipped with advanced computing capabilities. Most of these devices have multicore processors such as dual-core CPUs and many-core GPUs. These processors are designed for both low power consumption and high performance computation. Moreover, most devices still lack libraries for generic multicore computing usage, such as CUDA or OpenCL. However, computing certain kind of tasks in these mobile GPUs, and other available multicores processors, may be faster and much more efficient than their single threaded CPU counterparts. This advantage can be used in game development to optimize some aspects of a game loop and also include new features. This work presents an architecture designed to process most of the game loop inside a mobile GPU using the Android Renderscript API. As an illustrated test case for the proposed architecture, this work presents a game prototype called "MobileWars", completely developed using the proposed architecture.

There is a potential demand for networked interactive media solutions that enable the rendering of PC games on set-top boxes, PDAs or low-cost CE devices. The Games@Large (G@L) project has been developing such a solution that would enable pervasive accessibility of interactive media from low-end devices. This paper describes the G@L framework and presents an experiment comparing user experience of G@L 3D-grahics streaming with a state-of-the-art video streaming solution. Subjects played three games using either G@L or StreamMyGame and self-reports of the acceptability of game graphics were compared. Depending on the game, the image quality of the G@L 3D-streaming protocol was perceived as being as good as or significantly better than state-of-the-art video streaming. Future studies will further explore the advantages and possible limitations of the G@L system with a wider range of games and users.

2012

4th IEEE International Conference on Cloud Computing Technology and Science Proceedings, 2012

We present a software framework that facilitates the development of OpenGL applications utilizing the limited GPU capacities of a portable client in combination with the high-end rendering hardware on a server. The resulting webapplication uses standard technologies and can be run on a wide variety of devices, such as smart phones, tablets and laptops. The framework is designed so that it is simple to make an existing OpenGL application into a web-application, gradually adding client-side rendering. Furthermore, it provides automatic network scaling to provide interactivity even on poor connections.

Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2021

High Quality Mobile Virtual Reality (VR) is what the incoming graphics technology era demands: users around the world, regardless of their hardware and network conditions, can all enjoy the immersive virtual experience. However, the state-of-the-art softwarebased mobile VR designs cannot fully satisfy the realtime performance requirements due to the highly interactive nature of user's actions and complex environmental constraints during VR execution. Inspired by the unique human visual system effects and the strong correlation between VR motion features and realtime hardwarelevel information, we propose Q-VR, a novel dynamic collaborative rendering solution via software-hardware co-design for enabling future low-latency high-quality mobile VR. At software-level, Q-VR provides flexible high-level tuning interface to reduce network latency while maintaining user perception. At hardware-level, Q-VR accommodates a wide spectrum of hardware and network conditions across users by effectively leveraging the computing capability of the increasingly powerful VR hardware. Extensive evaluation on real-world games demonstrates that Q-VR can achieve an average end-to-end performance speedup of 3.4x (up to 6.7x) over the traditional local rendering design in commercial VR devices, and a 4.1x frame rate improvement over the state-of-the-art static collaborative rendering. CCS CONCEPTS • Computing methodologies → Virtual reality; Sequential decision making; • Computer systems organization → Clientserver architectures; System on a chip.

With the proliferation of smart mobile devices and broadband wireless networks, the mobile gaming market is rapidly expanding among younger generations due to its ubiquitous entertainment features. Cloud-based mobile computing is a promising technology to address the inherent restrictions of mobile devices, such as limited battery lifetime and computational capacity. In this work, we categorize the current approaches to cloud-based mobile gaming and explicitly define Mobile Cloud Gaming (MCG) 1 . Based on its unique features, we propose a framework for next generation MCG systems. Open research issues for MCG are also discussed.