Location-based augmented reality on mobile phones

In this paper we present two techniques for natural feature tracking in real-time on mobile phones. We achieve interactive frame rates of up to 20Hz for natural feature tracking from textured planar targets on current-generation phones. We use an approach based on heavily modified state-of-the-art feature descriptors, namely SIFT and Ferns. While SIFT is known to be a strong, but computationally expensive feature descriptor, Ferns classification is fast, but requires large amounts of memory. This renders both original designs unsuitable for mobile phones. We give detailed descriptions on how we modified both approaches to make them suitable for mobile phones. We present evaluations on robustness and performance on various devices and finally discuss their appropriateness for Augmented Reality applications.

Smartphones have been identified as most promising future devices for an Augmented Reality (AR) mass market. However, their use puts considerable constraints on the design and composition of AR applications. The key problem is to find a registration mechanism for accurate six degree of freedom (6DOF) self-localization with respect to the environment. Approaches based on Computer Vision (CV) have been shown to be promising, but the feasibility of many CV methods on smartphones is questionable. In this paper we discuss current and future challenges faced in developing AR on smartphones, in particular for large and unconstrained outdoor environments. We focus on the registration task, giving a survey and an assessment of existing approaches from AR and CV. From this survey, we identify a set of important issues still seeking for practical solutions, both in terms of the fundamental registration problem and for making AR on smartphones a unique experience. As will become apparent, despite recent advances, we are still far from arriving at a universal solution to the problem.

2013

Recently, augmented reality has been proved immensely useful on a day to day basis when tied with location-based technology. In this paper, we present a new method for displaying augmented reality contents on mobile devices. We add 3D models on the view of the camera and use location-based services, motion sensors to calculate the transformation of models. Instead of remaining at a fixed position on camera view while moving around a 3D model, the model rotates on display in the opposite direction that the user is walking. We also design client as a ubiquitous client to reduce constraints on disk space and memory capacity on mobile devices. Implementation results show effective use in creating GPS-based 3D view augmented reality contents for Smart Mobile Devices.

2005

Mobile phones have reached a level where it is possible to run selfcontained Augmented Reality applications using the built-in camera for optical tracking. In this paper we present some of our work in this area. We have created a custom port of the ARToolKit library to the Symbian mobile phone operating system and then developed sample applications which have been evaluated. These include a face-to-face collaborative AR game where we conducted a user study to evaluate multi-modal feedback. We also examined user interface issues where an AR enabled mobile phone acts as an interaction device. Additionally, we discuss how traditional 3D manipulation techniques apply to this new platform. We also describe a mobile phone based Augmented Reality application for 3D scene assembly, which adds a 6 DOF isomorphic interaction technique for manipulating 3D content.

Lecture Notes in Business Information Processing, 2015

Contemporary smart mobile devices are already capable of running advanced mobile applications with demanding resource requirements. However, utilizing the technical capabilities of such devices constitutes a challenging task (e.g., when querying their sensors at run time). This paper deals with the design and implementation of an advanced mobile application, which enables location-based mobile augmented reality on dierent mobile operating systems (i.e., iOS and Android). In particular, this kind of application is characterized by high resource demands. For example, at run time various calculations become neccessary in order to correctly position and draw virtual objects on the screen of the smart mobile device. Hence, we focus on the lessons learned when implementing a robust and ecient, location-based mobile augmented reality engine as well as ecient mobile business applications based on it.

Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems - CHI EA '11, 2011

Augmented reality is a technology which allows 2D and 3D computer graphics to be accurately aligned or registered with scenes of the real-world in real-time. The potential uses of this technology are numerous, from architecture and medicine to manufacturing and entertainment. This thesis presents an overview of the (complex) research area of Augmented Reality and describes the basic parts of an Augmented Reality system. It points out the most significant problems and various methods of trying to solve them. This thesis also presents the design and implementation of an augmentation system that makes use of a three degrees of freedom orientation tracker. Augmented reality är en teknologi som gör det möjligt för två-och tredimensionell datorgrafik att på ett precist sätt överlappa scener från den verkliga världen i realtid. De potentiella användningsområdena för denna teknologi är flera, från arkitektur och medicin till tillverkningsindustri och underhållning. Det här arbetet ger en överblick av det mycket komplexa forskningsområdet Augmented Reality och beskriver de grundläggande delarna av ett Augmented Reality-system. Arbetet tar upp de mest signifikanta problemen och olika metoder för att försöka lösa dem. Det här arbetet presenterar också en design och implementation av ett Augmented Reality-system som använder sig av en orienteringssensor i tre dimensioner.

2012

F e a t u r e : a u g m e n t e d r e a l i t y Online Creation of Panoramic augmentedreality annotations on mobile Phones J im Spohrer first envisioned the idea of superimposing georeferenced information using augmented reality (AR) in his 1999 essay on the WorldBoard. 1 This idea has recently gained popularity with applications such as Layar (http://layar.com), which use camera phones equipped with a compass and GPS as an inexpensive, albeit crude, platform for AR. However, GPS sensors and compasses have limited accuracy and can't provide precise pose information. Furthermore, these sensors have update rates of approximately 1 Hz, so overlays onto the live video image in a mobile phone's viewfinder are roughly placed, sometimes resembling a directional hint rather than an overlay matched to an exact location. Here, we present a novel system that improves compass accuracy using vision-based orientation tracking, enabling accurate object registration. However, vision tracking can only work in relation to an image database or 3D reconstruction, which must either be predetermined or constructed on the fly. We thus employ a natural-feature mapping and tracking approach for mobile phones that's efficient and robust enough to track with three degrees of freedom. By assuming pure rotational movements, the system creates a panoramic map from live video on the fly and simultaneously tracks from it (see ).

Lecture Notes in Geoinformation and Cartography, 2007

We introduce the term "Anywhere Augmentation" to refer to the idea of linking location-specific computing services with the physical world, making them readily and directly available in any situation and location. This chapter presents a novel approach to "Anywhere Augmentation" based on efficient human input for wearable computing and augmented reality (AR). Current mobile and wearable computing technologies, as found in many industrial and governmental service applications, do not routinely integrate the services they provide with the physical world. Major limitations in the computer's general scene understanding abilities and the infeasibility of instrumenting the whole globe with a unified sensing and computing environment prevent progress in this area. Alternative approaches must be considered.

In the last few years there has been a significant evolution in the mobile devices hardware capabilities, this evolution is very important as it allows for more complex applications and services to be developed for this type of devices. In this paper we describe the concepts and key issues that arise when developing an Augmented Reality system in a localization application for smartphones in general. WorldPlus presents solutions and implements these concepts using the Android smartphone as an example. In addition, WorldPlus allows programmers to develop their own content providers for both an online and an offline mode.

International Journal of Modern Trends in Engineering and Research, 2016

1,2,3,4,5 Dept. of Computer Engineering, Shree L.R.Tiwari College of Engineering Abstract— Indoor positioning systems help to localize objects and spaces inside a building, where Global Positioning System (GPS) don't work effectively including cellular networks. But since the localization technologies incur great costs, a need for simulating localization indoors becomes essential. With this application we attempt to demonstrate, one such use case where we simulate indoor positioning system by rendering relevant 3D graphics and relevant location information on the mobile display. Localization is achieved by creating a location API simulator and using the orientation sensor in phone and tablet. Relevant graphical information based on the users context and selection, is rendered using OpenGLES on top of the live camera stream. Our attempt is to demonstrate through our application the strong untapped potential in augmented reality techniques in the context of indoor. The application...