Academia.eduAcademia.edu

Outline

Title
Abstract
Key Takeaways
Figures
Introduction
Gyroscope
Conclusion
References
All Topics
Computer Science
Computer Vision

Mobile Phone Sensing using the Built-in Camera

Profile image of Norliza KatukNorliza Katuk

2019, International Journal of Interactive Mobile Technologies

https://doi.org/10.3991/IJIM.V13I02.10166
visibility

…

description

13 pages

link

1 file

Abstract

Modern mobile phones or smartphones have multipurpose functions apart from being used as a device for voice and text communications. They are also embedded with many useful sensors, including camera, barometer, ac-celerometer, and digital compass. Unlike other types of sensor, the smartphone camera has been underutilized. This paper aims to fill the gap by analyzing and reviewing the hardware and software components of smartphones and highlighting the potential uses of the smartphone camera to support human daily life activities. A simple search of research papers indexed in Google Scholar was carried out using guided terms. The papers were filtered to match the research questions for this study. Only relevant papers were analyzed and reviewed. The results of the analysis suggested that the rapid development in the smartphone hardware has extended the use of the smartphone cameras beyond personal and social photography. Consequently, applications (apps) based on smartphone cameras emerge, such as barcode readers, document digitizing tools, augmented reality, translation tools, and indoor positioning device. These apps benefit users and facilitate them in their daily life activities.

Key takeaways
sparkles

AI

  1. Smartphone cameras can significantly enhance daily life through various innovative applications beyond photography.
  2. The paper reviews the components and potential uses of smartphone cameras, addressing an underutilized resource.
  3. Smartphones integrate 11 hardware components including processors, sensors, and a digital camera for diverse functionalities.
  4. Smartphone cameras facilitate barcode scanning, document digitization, translation, augmented reality, and health monitoring.
  5. In 2017, an estimated 1.2 trillion digital photos were taken, with 85% captured using smartphones.
Figures (5)
Fig. 1. The hardware components of smartphones [9]. internal memory, data transfer interface, 3/4G network interface, GPS module, sensors power management, external memory, SIM, touch display, and a speaker module.
Fig. 1. The hardware components of smartphones [9]. internal memory, data transfer interface, 3/4G network interface, GPS module, sensors power management, external memory, SIM, touch display, and a speaker module.
Table 1. The components of modern smartphones and their functions.
Table 1. The components of modern smartphones and their functions.
Fig. 2. Types of sensors embedded in a smartphone [9]. Su, et al. [11] classified the smartphone sensors into ten types of sensors namely accelerometer, ambient temperature sensor, gravity sensor, light sensor, linear acceler- ation, magnetometer, barometer, proximity sensor, humidity sensor, and gyroscope. On the other hand, another review by Daponte, et al. [9] also specified ten types of sensors that are classified into five categories namely optical, thermal, acoustics, magnetic, and mechanical. The sensors include a camera and video camera, barometer, gyroscope, proximity, digital compass, temperature, microphone, red-green-blue (RGB) light, ac- celerometer, and GPS as illustrated in Fig. 2. Table 2 summarizes the functions of the individual sensors classified by Daponte et al. [9].
Fig. 2. Types of sensors embedded in a smartphone [9]. Su, et al. [11] classified the smartphone sensors into ten types of sensors namely accelerometer, ambient temperature sensor, gravity sensor, light sensor, linear acceler- ation, magnetometer, barometer, proximity sensor, humidity sensor, and gyroscope. On the other hand, another review by Daponte, et al. [9] also specified ten types of sensors that are classified into five categories namely optical, thermal, acoustics, magnetic, and mechanical. The sensors include a camera and video camera, barometer, gyroscope, proximity, digital compass, temperature, microphone, red-green-blue (RGB) light, ac- celerometer, and GPS as illustrated in Fig. 2. Table 2 summarizes the functions of the individual sensors classified by Daponte et al. [9].
Table 2. Built-in sensors in modern smartphones [9, 11].
Table 2. Built-in sensors in modern smartphones [9, 11].
Table 3. The possible uses of smartphone cameras to support daily life activities. The modern smartphone cameras can be used as a portable barcode reader for scan- ning and translating the barcode image into the corresponding item or product identi- fier. Barcode is a common way of identifying items and products at the supermarkets, shopping malls, and grocery stores. It has been used widely since more than a couple of decades ago and demonstrates a well-established industrial standard [40]. The bar- code system can be integrated with smartphone technology enabling more useful ser- vices for the users [22]. The use of smartphone cameras for barcode scanning is becom- ing widespread as a result of the successful implementation of e-commerce services [41]. Mobile apps developed for a barcode scanner are programmed to interpret the barcode images and generate the barcode value which is used to identify the product from the database [21]. The operational procedure for barcode scanning apps is very straightforward. The users can simply turn the apps on and hold the smartphone camera over the barcode of the product [23]. The smartphone cameras will detect the barcode area and scan the barcode image. Then, barcode localization algorithms will decode the captured barcode images and produced the binary number of the barcode [40]. The barcode allows additional information about the product or items that can be retrieved from other connected electronic systems and databases [21]. The barcode scanning apps in smartphones provide automatic and precise input data of products [20] which conse- quently speeds the up searching process and minimize manual input errors. Barcode scanning using the smartphone cameras will be discussed in the subsequent section. ly we 4 i “fay ‘mess Gay ae a
Table 3. The possible uses of smartphone cameras to support daily life activities. The modern smartphone cameras can be used as a portable barcode reader for scan- ning and translating the barcode image into the corresponding item or product identi- fier. Barcode is a common way of identifying items and products at the supermarkets, shopping malls, and grocery stores. It has been used widely since more than a couple of decades ago and demonstrates a well-established industrial standard [40]. The bar- code system can be integrated with smartphone technology enabling more useful ser- vices for the users [22]. The use of smartphone cameras for barcode scanning is becom- ing widespread as a result of the successful implementation of e-commerce services [41]. Mobile apps developed for a barcode scanner are programmed to interpret the barcode images and generate the barcode value which is used to identify the product from the database [21]. The operational procedure for barcode scanning apps is very straightforward. The users can simply turn the apps on and hold the smartphone camera over the barcode of the product [23]. The smartphone cameras will detect the barcode area and scan the barcode image. Then, barcode localization algorithms will decode the captured barcode images and produced the binary number of the barcode [40]. The barcode allows additional information about the product or items that can be retrieved from other connected electronic systems and databases [21]. The barcode scanning apps in smartphones provide automatic and precise input data of products [20] which conse- quently speeds the up searching process and minimize manual input errors. Barcode scanning using the smartphone cameras will be discussed in the subsequent section. ly we 4 i “fay ‘mess Gay ae a

Related papers

Mobile Phone Sensing Systems: A Survey
wazir khan

IEEE Communications Surveys & Tutorials, 2013

Mobile phone sensing is an emerging area of interest for researchers as smart phones are becoming the core communication device in people's everyday lives. Sensor enabled mobile phones or smart phones are hovering to be at the center of a next revolution in social networks, green applications, global environmental monitoring, personal and community healthcare, sensor augmented gaming, virtual reality and smart transportation systems. More and more organizations and people are discovering how mobile phones can be used for social impact, including how to use mobile technology for environmental protection, sensing, and to leverage just-in-time information to make our movements and actions more environmentally friendly. In this paper we have described comprehensively all those systems which are using smart phones and mobile phone sensors for humans good will and better human phone interaction.

View PDFchevron_right
Assessment of a smartphone-based monitoring system and its application
chuluong choi

Korean Journal of Remote Sensing, 2014

Ubiquitous monitoring is the process of collecting and assimilating vast amounts of data from numerous electronic mobile sensory devices. The concept of ubiquitous monitoring was established as "the use of pervasive devices for the continuous collection of data in an Intelligent Pervasive Space (IPS) or other ubiquitous environments" by Moran (2010). Digital smart cameras are enabling precise and ubiquitous monitoring approaches with data forms, expanding

View PDFchevron_right
Using camera-equipped mobile phones for interacting with real-world objects
Michael Rohs

2004

The idea described in this paper is to use the built-in cameras of consumer mobile phones as sensors for 2-dimensional visual codes. Such codes can be attached to physical objects in order to retrieve object-related information and functionality. They are also suitable for display on electronic screens. The proposed visual code system allows the simultaneous detection of multiple codes, introduces a position-independent coordinate system, and provides the phone's orientation as a parameter. The ability to detect objects in the user's vicinity offers a natural way of interaction and strengthens the role of mobile phones in a large number of application scenarios. We describe the hardware requirements, the design of a suitable visual code, a lightweight recognition algorithm, and present some example applications.

View PDFchevron_right
Experimental evaluation of mobile phone sensors
Yuansong Qiao

24th IET Irish Signals and Systems Conference (ISSC 2013), 2013

̶ Smart phone has become an important part of people's daily life. Most of current smart phone are equipped with a rich set of built-in sensors. The mobile applications such as geo-location based video annotation and indoor positioning require precise measurements from sensors. In addition, understanding the sensing performance of a smart phone device is helpful for implementing a mobile application that needs sensor data. This paper presents an experimental evaluation of key sensors in a state of the art smart phone -Google Nexus 4. The sensors chosen in the paper are accelerometer, gyroscope, magnetometer and GPS. Substantial tests have been executed to evaluate the sensors' accuracy, precision, maximum sampling frequency, sampling period jitter, energy consumption.

View PDFchevron_right
Employing Smartphone and Compact Camera in Building Measurements
Haval Sadeq

Eurasian Journal of Science and Engineering, 2018

This paper investigates the possibility of implementing images from smartphones and compact cameras for building measurement, such as archaeological buildings, for documentation purposes based on point cloud produced via photogrammetric technique. Images of the object are first captured from different positions. Then, the images are processed for the interior and exterior orientations to produce point cloud. For object registration, one distance is measured at the site, which is assigned to the model and used for scaling. The generated point cloud is subsequently exported into various software, such as AutoCAD for the purpose of taking measurements or for any architectural studies. Two types of smartphone with different camera resolutions and two types of compact camera are used in the test. Results are validated by comparing several real measurements from the site. The quality of the data is proven to be accurate up to centimetre accuracy.

View PDFchevron_right
Analysis of built-in mobile phone sensors for supporting interactions with the real world
Karin Bee

2005

There is currently a lot of research going on in the field of mobile interaction with the real world. So far, the environment where the mobile phone is used is mainly perceived as an unpleasant and disturbing factor. Therefore it has rarely been used as a part of the interaction. But on the other hand there is a huge potential for new kinds of the interactions and novel services. Until now, mostly sophisticated and novel hardware has been used for the development of prototypes. In this paper we investigate which sensors are already built-in in modern mobile phones and analyze how they can be employed in real world interactions. Our focus is on investigating how mobile phone sensors can be accessed using the J2ME platform. We analyze the performance and quality of the recorded media data, and where it can be processed. Finally, we conclude with a discussion on what can already be accomplished with today's mobile phones and which new functions are potentially desired.

View PDFchevron_right
A New Method for Recognizing Objects in Photos Taken by Smart Phones
Silvana Trimi, Jaegeol Yim, Jaehun Joo

With the advances in computing power and storage capacity of smart phones, cloud computing and wireless networks, new apps and services are being developed and offered to the users of smart phones. One of these new services is the mobile augmented reality system (MARS). MARS integrates virtual information into the physical environment where a smart phone is located, allowing smart phone users to receive virtual information as if it is part of their physical surroundings. Several studies have suggested techniques/methods to match the best relevant information with the physical surrounding/object. Most of them identify the objects on the photo based on image comparison of the photo taken by a smart phone with images stored in a database. This method however is slow, as it takes time to do the image comparison. In this study we propose a new method, which can identify objects in a smart phone photo much faster and with a higher degree of accuracy, by using the phone's sensor data and electronic maps.

View PDFchevron_right
EVALUATION OF METRIC PERFORMANCE OF MOBILE PHONE CAMERAS
Devrim Akca

International Calibration and Orientation Workshop EuroCOW 2008, Castelldefels, Spain, January 30 - February 1 (only on CD-ROM)., 2008

ABSTRACT: This paper examines the potential of mobile phones to be used as a front-end sensor for photogrammetric procedures and applications. For this purpose we are calibrating two mobile phones (Sony Ericsson K750i and Nokia N93) over our indoor 3D testfield, using self-calibration. Using the same testfield we are performing accuracy tests in order to evaluate the metric performance and comparing them with respect to two off-the-shelf digital still video cameras (Sony DSC W100 and Sony DSC F828). In some systems we have diagnosed substantial systematic errors. We find that the JPEG compression does not significantly influence the errors. We are currently also in the process of checking the stability of the interior orientation over time. This paper reports about our experiences in calibration and accuracy validation of mobile phone cameras. We believe that with a proper performance these devices can be used for many photogrammetric tasks in the future. KEY WORDS: Mobile phone cameras, self-calibration, accuracy potential, JPEG test, stability test.

View PDFchevron_right
Feasibility of Using Data From Sensors Embedded in Smartphones to Measure Angles and Distances
Livia Sampaio

Revista Brasileira de Cartografia, 2022

View PDFchevron_right
Sensors and Mobile Phones: Evolution and State-of-the-Art
Shah Khusro

Pakistan journal of science

Sensors can be found virtually in all fields of applications for automatic real-world data acquisition for using in plethora of decision making processes. Recent advancements have turned mobile phones from simple communication devices into complete computing devices, leveraging novel systems and services. Most of the systems have used sensors for automatic data acquisition and have gained high levels of successes. Due to the increasing use of sensors in mobile phones, today’s mobile phones come with a number of sensors while experiencing the integration of new sensors in the near future. Sensors and mobile phones integration can be attributed to plenty of reasons including easy usage, cost reductions, and high productivity etc. This paper gives a comprehensive overview of sensors integration in mobile phones, sensors classification, identifies a number of available and emerging sensors in mobile phones, and outlines a number of limitations and recommendations for the research commun...

View PDFchevron_right

References (50)

  1. V. Persson and J. Nouri, "A Systematic Review of Second Language Learning with Mobile Technologies," International Journal of Emerging Technologies in Learning (iJET), vol. 13, pp. 188-210, 2018. https://doi.org/10.3991/ijet.v13i02.8094
  2. H. M. Alfawareh and S. Jusoh, "The Use and Effects of Smartphones in Higher Education," International Journal of Interactive Mobile Technologies (iJIM), vol. 11, pp. 103-111, 2017. https://doi.org/10.3991/ijim.v11i6.7453
  3. N. D. Lane, E. Miluzzo, H. Lu, D. Peebles, T. Choudhury, and A. T. Campbell, "A survey of mobile phone sensing," IEEE Communications Magazine, vol. 48, pp. 140-150, 2010. https://doi.org/10.1109/MCOM.2010.5560598
  4. E. Koukoumidis, M. Martonosi, and L. S. Peh, "Leveraging smartphone cameras for collab- orative road advisories," IEEE Transactions on Mobile Computing, vol. 11, pp. 707-723, 2012. https://doi.org/10.1109/TMC.2011.275
  5. R. Hildebrand, J. L. Hoffmann, E. Gillich, H. Dörksen, and V. Lohweg, "Smartphones as smart cameras-is it possible?," in Colloquium on Image Processing in Automation, Institute Industrial IT, 2012, pp. 1-8.
  6. W. Koo, "Usage of Smartphone Applications: A Descriptive Study of Top 100 US Retail- ers," International Journal of Interactive Mobile Technologies (iJIM), vol. 10, pp. 54-58, 2016. https://doi.org/10.3991/ijim.v10i3.5827
  7. S. Kanchi, M. I. Sabela, P. S. Mdluli, and K. Bisetty, "Smartphone based bioanalytical and diagnosis applications: A review," Biosensors and Bioelectronics, vol. 102, pp. 136-149, 2018. https://doi.org/10.1016/j.bios.2017.11.021
  8. T. Brinda and F. Braun, "Which Computing-Related Conceptions Do Learners Have About the Design and Operation of Smartphones? Results of an Interview Study," in Proceedings of the 12th Workshop on Primary and Secondary Computing Education, 2017, pp. 73-81. https://doi.org/10.1145/3137065.3137075
  9. P. Daponte, L. De Vito, F. Picariello, and M. Riccio, "State of the art and future develop- ments of measurement applications on smartphones," Measurement: Journal of the Interna- tional Measurement Confederation, vol. 46, pp. 3291-3307, 2013. https://doi.org/10.10 16/j.measurement.2013.05.006
  10. S. A. Hoseini-Tabatabaei, A. Gluhak, and R. Tafazolli, "A survey on smartphone-based sys- tems for opportunistic user context recognition," ACM Computing Surveys (CSUR), vol. 45, p. 27, 2013. https://doi.org/10.1145/2480741.2480744
  11. X. Su, H. Tong, and P. Ji, "Activity recognition with smartphone sensors," Tsinghua Science and Technology, vol. 19, pp. 235-249, 2014. https://doi.org/10.1109/TST.2014.6838194
  12. V. Kulyukin and T. Zaman, "Vision-based localization and scanning of 1D UPC and EAN barcodes with relaxed pitch, roll, and yaw camera alignment constraints," International Jour- nal of Image Processing (IJIP), vol. 8, pp. 355-383, 2014.
  13. R. F. Rahmat, F. Akbar, M. F. Syahputra, M. A. Budiman, and A. Hizriadi, "An Interactive Augmented Reality Implementation of Hijaiyah Alphabet for Children Education," in Jour- nal of Physics: Conference Series, 2018.
  14. Y. Li, Z. Ghassemlooy, X. Tang, B. Lin, and Y. Zhang, "A VLC Smartphone Camera based Indoor Positioning System," IEEE Photonics Technology Letters, 2018. https://doi.org/10.1109/LPT.2018.2834930
  15. W. Elloumi, K. Guissous, A. Chetouani, R. Canals, R. Leconge, B. Emile, et al., "Indoor navigation assistance with a smartphone camera based on vanishing points," in International Conference on Indoor Positioning and Indoor Navigation (IPIN), 2013. https://doi.org/10.1109/IPIN.2013.6817911
  16. K. Sankaran, M. Zhu, X. F. Guo, A. L. Ananda, M. C. Chan, and L.-S. Peh, "Using mobile phone barometer for low-power transportation context detection," in Proceedings of the 12th ACM Conference on Embedded Network Sensor Systems, 2014, pp. 191-205. https://doi.org/10.1145/2668332.2668343
  17. D. A. Johnson and M. M. Trivedi, "Driving style recognition using a smartphone as a sensor platform," in Intelligent Transportation Systems (ITSC), 2011 14th International IEEE Con- ference on, 2011, pp. 1609-1615. https://doi.org/10.1109/ITSC.2011.6083078
  18. T. Kindberg, M. Spasojevic, R. Fleck, and A. Sellen, "The ubiquitous camera: An in-depth study of camera phone use," IEEE Pervasive Computing, vol. 4, pp. 42-50, 2005. https://doi.org/10.1109/MPRV.2005.42
  19. F. Richter. (2017). Digital Photography: Smartphones Cause Photography Boom. Available: https://www.statista.com/chart/10913/number-of-photos-taken-worldwide/
  20. K. Dorman, M. Yahyanejad, A. Nahapetian, M. K. Suh, M. Sarrafzadeh, W. McCarthy, et al., "Nutrition monitor: A food purchase and consumption monitoring mobile system," in Mobile Computing, Applications, and Services, ed Berlin Heidelberg: Springer, 2009, pp. 1-11.
  21. D. Chai and F. Hock, "Locating and decoding EAN-13 barcodes from images captured by digital cameras," in 2005 Fifth International Conference on Information, Communications and Signal Processing, 2005, pp. 1595-1599. https://doi.org/10.1109/ICICS.2005.1689328
  22. E. Y. Daraghmi, C. F. Lin, and S. M. Yuan, "Mobile Phone Enabled Barcode Recognition for Preferences Monitoring," in Advances in Computer Science and Education Applications, ed Berlin Springer 2011, pp. 297-302.
  23. E. Dunford, H. Trevena, C. Goodsell, K. H. Ng, J. Webster, A. Millis, et al., "FoodSwitch: a mobile phone app to enable consumers to make healthier food choices and crowdsourcing of national food composition data," JMIR mHealth and uHealth, vol. 2, p. e37, 2014. https://doi.org/10.2196/mhealth.3230
  24. O. Gallo and R. Manduchi, "Reading 1D barcodes with mobile phones using deformable templates2011," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, pp. 1834-1843.
  25. D. Doermann, J. Liang, and H. Li, "Progress in camera-based document image analysis," in Document Analysis and Recognition, 2003. Proceedings. Seventh International Conference on, 2003, pp. 606-616. https://doi.org/10.1109/ICDAR.2003.1227735
  26. J. Liang, D. Doermann, and H. Li, "Camera-based analysis of text and documents: a survey," International Journal of Document Analysis and Recognition (IJDAR), vol. 7, pp. 84-104, 2005.
  27. F. Chen, S. Carter, L. Denoue, and J. Kumar, "SmartDCap: semi-automatic capture of higher quality document images from a smartphone," in Proceedings of the 2013 international conference on Intelligent user interfaces, 2013, pp. 287-296. https://doi.org/10.1145/2449396.2449433
  28. N. Nayef, M. M. Luqman, S. Prum, S. Eskenazi, J. Chazalon, and J. M. Ogier, "SmartDoc- QA: A dataset for quality assessment of smartphone captured document images-single and multiple distortions," in 2015 13th International Conference on Document Analysis and Recognition (ICDAR), 2015, pp. 1231-1235. https://doi.org/10.1109/I CDAR.2015.7333960
  29. F. Asad, A. Ul-Hasan, F. Shafait, and A. Dengel, "High Performance OCR for Camera- Captured Blurred Documents with LSTM Networks," in 2016 12th IAPR Workshop on Document Analysis Systems (DAS), 2016, pp. 7-12. https://doi.org/10.1109/DAS.2016.69
  30. P. Ye and D. Doermann, "Document image quality assessment: A brief survey," in 2013 12th International Conference on Document Analysis and Recognition (ICDAR), 2013, pp. 723-727. https://doi.org/10.1109/ICDAR.2013.148
  31. J. Du, Q. Huo, L. Sun, and J. Sun, "Snap and translate using windows phone," in 2011 International Conference on Document Analysis and Recognition (ICDAR), 2011, pp. 809- 813.
  32. M. Lee, Kim, S. H., G. Lee, S. H. Kim, and H. J. Yang, "Correction for Misrecognition of Korean Texts in Signboard Images using Improved Levenshtein Metric," TIIS, vol. 6, pp. 722-733, 2012. https://doi.org/10.3837/tiis.2012.02.016
  33. F. Lamberti, F. Manuri, A. Sanna, G. Paravati, P. Pezzolla, and P. Montuschi, "Challenges, Opportunities, and Future Trends of Emerging Techniques for Augmented Reality-Based Maintenance," IEEE Transactions on Emerging Topics in Computing, vol. 2, p. 2, 2014. https://doi.org/10.1109/TETC.2014.2368833
  34. M. Werner, M. Kessel, and C. Marouane, "Indoor positioning using smartphone camera," in IPIN, 2011, pp. 1-6.
  35. Y. S. Kuo, P. Pannuto, K. J. Hsiao, and P. Dutta, "Luxapose: Indoor positioning with mobile phones and visible light," in Proceedings of the 20th annual international conference on Mobile computing and networking, 2014, pp. 447-458. https://doi.org/10.1145/2639108.2639109
  36. E. J. Wang, W. Li, D. Hawkins, T. Gernsheimer, C. Norby-Slycord, and S. N. Patel, "HemaApp: noninvasive blood screening of hemoglobin using smartphone cameras," in Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 2016, pp. 593-604. https://doi.org/10.1145/2971648.2971653
  37. E. J. Wang, W. Li, J. Zhu, R. Rana, and S. N. Patel, "Noninvasive hemoglobin measurement using unmodified smartphone camera and white flash," in Engineering in Medicine and Biology Society (EMBC), 2017 39th Annual International Conference of the IEEE, 2017, pp. 2333-2336. https://doi.org/10.1109/EMBC.2017.8037323
  38. F. Lamonaca, G. Polimeni, K. Barbé, and D. Grimaldi, "Health parameters monitoring by smartphone for quality of life improvement," Measurement, vol. 73, pp. 82-94, 2015. https://doi.org/10.1016/j.measurement.2015.04.017
  39. N. Kumar, M. Khunger, A. Gupta, and N. Garg, "A content analysis of smartphone-based applications for hypertension management," Journal of the American Society of Hypertension, vol. 9, pp. 130-136, 2015.
  40. O. Gallo and R. Manduchi, "Reading 1D barcodes with mobile phones using deformable templates," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, pp. 1834-1843, 2011. https://doi.org/10.1109/TPAMI.2010.229
  41. G. Sörös and C. Flörkemeier, "Blur-resistant joint 1D and 2D barcode localization for smartphones," in The 12th International Conference on Mobile and Ubiquitous Multimedia 2013, pp. 11-19. https://doi.org/10.1145/2541831.2541844
  42. D. Wang, Z. Xiang, and D. R. Fesenmaier, "Smartphone use in everyday life and travel," Journal of Travel Research, vol. 55, pp. 52-63, 2016. https://doi.org/10. 1177/0047287514535847
  43. V. Fragoso, S. Gauglitz, S. Zamora, J. Kleban, and M. Turk, "TranslatAR: A mobile augmented reality translator," in Applications of Computer Vision (WACV), 2011 IEEE Workshop on, 2011, pp. 497-502. https://doi.org/10.1109/WACV.2011.5711545
  44. A. Kroulek. (2018). 15 Powerful Translation Apps and Devices for Travelers in 2018. Available: http://www.k-international.com/blog/translation-apps-2016/
  45. A. Syrkett. (2017). Ikea and Apple team up on augmented reality home design app: The 'Ikea Place' app lets shoppers virtually test drive furniture. Available: https://www.curbed.com/2017/9/12/16297382/apple-ikea-place-augmented-reality-home- design
  46. W. Viyanon, T. Songsuittipong, P. Piyapaisarn, and S. Sudchid, "AR Furniture: Integrating Augmented Reality Technology to Enhance Interior Design using Marker and Markerless tracking," in Proceedings of the 2nd International Conference on Intelligent Information Processing, 2017, p. 32. https://doi.org/10.1145/3144789.3144825
  47. S. G. Dacko, "Enabling smart retail settings via mobile augmented reality shopping apps," Technological Forecasting and Social Change, vol. 124, pp. 243-256, 2017. https://doi.org/10.1016/j.techfore.2016.09.032
  48. CorfuAR. (2018). Welcome to CorfuAR website! Available: http://www.corfuar.com/
  49. R. Leeming. (2017). Ten retail indoor positioning projects you need to know. Available: http://luxreview.com/article/2017/03/ten-retail-indoor-positioning-projects-you-need-to- know
  50. D. Croce, L. Giarré, F. La Rosa, E. Montana, and I. Tinnirello, "Enhancing tracking performance in a smartphone-based navigation system for visually impaired people," in Control and Automation (MED), 2016 24th Mediterranean Conference on, 2016, pp. 1355- 1360. https://doi.org/10.1109/MED.2016.7535871

Related papers

Camera phone based motion sensing
Shumin Zhai

Proceedings of the 19th annual ACM symposium on User interface software and technology - UIST '06, 2006

This paper presents TinyMotion, a pure software approach for detecting a mobile phone user's hand movement in real time by analyzing image sequences captured by the built-in camera. We present the design and implementation of Ti-nyMotion and several interactive applications based on TinyMotion. Through both an informal evaluation and a formal 17-participant user study, we found that 1. TinyMotion can detect camera movement reliably under most background and illumination conditions. 2. Target acquisition tasks based on TinyMotion follow Fitts' law and Fitts' law parameters can be used for TinyMotion based pointing performance measurement. 3. The users can use Vision Tilt-Text, a TinyMotion enabled input method, to enter sentences faster than MultiTap with a few minutes of practicing. 4. Using camera phone as a handwriting capture device and performing large vocabulary, multilingual real time handwriting recognition on the cell phone are feasible. 5. TinyMotion based gaming is enjoyable and immediately available for the current generation camera phones. We also report user experiences and problems with TinyMotion based interaction as resources for future design and development of mobile interfaces.

View PDFchevron_right
A survey of mobile phone sensing
Emiliano Miluzzo

Communications …, 2010

View PDFchevron_right
A sensor-centric survey on the development of smartphone measurement and sensing systems
Marco Grossi

Measurement, 2019

Modern mobile phones, featuring high performance microprocessors, rich set of sensors and internet connectivity are largely diffused all over the world and are ideal devices for the development of low-cost sensing systems, in particular for low-income developing countries and rural areas that lack the access to diagnostic laboratories and expensive instrumentation. In the design of a smartphone based sensing system different elements must be taken in consideration such as sensors performance, acquisition rate and privacy preserving strategies when personal data must be shared in the cloud. In this paper a sensor-centric survey on smartphone based sensing systems is presented, covering different fields of application. Two different development approaches will be discussed: 1) the exploitation of the large number of sensors embedded in modern smartphones (high-resolution camera, microphone, accelerometer, gyroscope, magnetometer, GPS); 2) the interfacing with external sensors that communicate with the smartphone by the embedded wireless or wired communication technology.

View PDFchevron_right
Camera phone based motion sensing: interaction techniques, applications and performance study
John Canny

2006

Abstract This paper presents TinyMotion, a pure software approach for detecting a mobile phone user's hand movement in real time by analyzing image sequences captured by the built-in camera. We present the design and implementation of TinyMotion and several interactive applications based on TinyMotion. Through both an informal evaluation and a formal 17-participant user study, we found that 1. TinyMotion can detect camera movement reliably under most background and illumination conditions. 2.

View PDFchevron_right
EVALUATION OF THE METRIC PERFORMANCE OF MOBILE PHONE CAMERAS
Devrim Akca

6th International ARIDA (Association for Real Time Imaging and Dynamic Analysis) Workshop "Innovation in 3D measurement, modeling and visualization", Trento, Italy, February 25-26 (only on CD-ROM)., 2008

With the availability of very affordable and good resolution CCD/CMOS cameras and other off-the-shelf devices, including compact computers (of laptop type) the potential of building efficient mobile, low-cost, high-performance systems has substantially improved. Among various hardware and software components mobile phones constitute an interesting component for image data acquisition for obvious reasons: They are inexpensive, light and handy and have CMOS cameras integrated of currently up to 10 Mpixels image format. Their usability for many applications has recently been realized. Some of the most prominent applications are the character/text recognition, facial animation, human face identification, image-based context awareness, content providing to Information Systems. In spite of the availability of a broad diversity of applications, the metric capabilities and characteristics of mobile phone cameras have not been investigated so far. In 2004, Sharp Corporation developed a 2 Mpixel CCD camera module with 2X optical zoom and auto-focus function (Figure 1a) intended for use in mobile phones. In 2005, they released two new camera modules (Figure 1b) with a 3 Mpixel CCD chip. One year after, Samsung announced a 10 Mpixel camera phone (Figure 1c) at CeBIT exhibition in Hannover. These examples show the rapid progress in the technology of mobile phone cameras.

View PDFchevron_right

Related topics

  • Barcode Detection
  • Barcode Technology
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved