Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Participants
Discussion Process
Related Work
Materials for Integration
Challenge #4: Designing Integrated
Designing Implicit Interaction
Designing for Variable Agency
Conclusion
References

Next Steps for Human-Computer Integration

Profile image of Stefan GreuterStefan Greuter

2020, Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

https://doi.org/10.1145/3313831.3376242
visibility

…

description

15 pages

link

1 file

Abstract

Figure 1. Exemplars of Human-Computer Integration: extending the body with additional robotic arms; [70] embedding computation into the body using electric muscle stimulation to manipulate handwriting [48]; and, a tail extension controlled by body movements [86].

Related papers

Body-Borne Computers as Extensions of Self
Sang-won Leigh

Computers, 2017

The opportunities for wearable technologies go well beyond always-available information displays or health sensing devices. The concept of the cyborg introduced by Clynes and Kline, along with works in various fields of research and the arts, offers a vision of what technology integrated with the body can offer. This paper identifies different categories of research aimed at augmenting humans. The paper specifically focuses on three areas of augmentation of the human body and its sensorimotor capabilities: physical morphology, skin display, and somatosensory extension. We discuss how such digital extensions relate to the malleable nature of our self-image. We argue that body-borne devices are no longer simply functional apparatus, but offer a direct interplay with the mind. Finally, we also showcase some of our own projects in this area and shed light on future challenges.

View PDFchevron_right
Introduction to Special Issue “Human Enhancement Technologies and Our Merger with Machines”
SAYOKO BLODGETT-FORD

2021

We are pleased to introduce the authors and papers which form the Special Issue “Human Enhancement Technologies and Our Merger with Machines” [...]

View PDFchevron_right
Multimodal input for computer access and augmentative communication
Patrick Demasco

Proceedings of the second annual ACM conference on Assistive technologies - Assets '96, 1996

This paper describes the overall goals of a project that focuses on multimodal input for computer access and Augmentative and Alternative Communication (AAC) systems. In particular the project explores the integration of speech recognition with headpointing. The first part of this project addresses the use of speech and head-pointing to replace the traditional keyboard and mouse. While either of these technologies can emulate both keyboard and mouse functions, it is hypothesized that the most advantageous use of each technology will come from integration such that each device's strength is utilized appropriately. To test this hypothesis, a series of experiments are planned. The first experiment compares (quantitatively and qualitatively) each technology in the context of text generation. The second experiment looks at typical pointing tasks (e.g., dragging) for each technology. The third experiment will look at the technologies in an integrated context. Because each of the technologies are themselves highly complex, significant time and effort has been devoted to pilot testing. Those results and the implications on our research methodology are presented in this paper.

View PDFchevron_right
Adding momentum to human abilities: lessons from research into computer-based systems for people with physical impairments
Eds Alme

1993

The goal of developing completely autonomous systems, which exhibit complex behaviour and which are robust in their encounters with the real world, is an ambitious one which may not be realised totally. However, powerful and useful systems can be developed which, although requiring continuous human intervention, magnify human abilities significantly. One area in which we might look to find guidelines for following this approach to augmenting human abilities is in the development of technical systems to assist people with physical and mental impairments. Research in this area is producing a number of examples of human-machine symbiosis which are instructive. A number of such prototype systems are described

View PDFchevron_right
Advances in Human Computer Interaction
Shane Pinder

2008

holds a BSc in Mechanical Engineering from the Royal Military College of Canada and an MSc in Aerospace Engineering from Carleton University. His doctoral studies involved the development of a GPSbased takeoff performance monitor at the University of Saskatchewan. He is a former Lieutenant in the Canadian Forces. It is an impossible task to bring together, under a single cover, the many facets of humancomputer interaction. After all, we have come a long way in the past several decades, to a point where we consider not only what may be intuitive to the designer, but rather the user, the environment, and the intent of our efforts. No single person can claim expertise across the entire field, which now brings together professions that formerly did not share the same vocabulary and still, in many cases, do not share the same philosophy. It is only appropriate that the study of human-machine interaction reveals a greater complexity within humanto-human interaction. In these 34 chapters, we survey the broad disciplines that loosely inhabit the study and practice of human-computer interaction. Our authors are passionate advocates of innovative applications, novel approaches, and modern advances in this exciting and developing field. It is our wish that the reader consider not only what our authors have written and the experimentation they have described, but also the examples they have set. This book brings together the work of experts around the world who have used their expertise to overcome barriers in language, culture, and abilities, to name only a few challenges. The editors would like to thank the authors, who have committed so much effort to the publication of this work.

View PDFchevron_right
Muscle Contraction: The Subtle Way of Human Computer Interaction
Rubana chowdhury

Research Journal of Applied Sciences, Engineering and Technology, 2013

The advent of new technology has opened opportunities to the computer users to consider alternate ways for humans to interface with machines. Research groups are looking to use computer interfaces that can allow users to communicate with devices in a subtle way and allow virtual reality environments to create an immersing experience. Electromyography based wearable input device can interface with mobile devices in a subtle way. Electromyography can also be used for interactive computer gaming as well as to control flights through virtual joysticks and controllers. This study provides a brief review on various ways for humans electromyography (EMG) signal to interface with machines. Therefore, the crux of this study is to overview the up to date developments and research related to the EMG interface with the wearable devices. This study further opens up a passage for researchers and end users to advocate an excellent understanding of EMG interfacing with mechanical devices.

View PDFchevron_right
Cutting Edge & Future Visionary Human-Machine Interfaces
Rebecca Grier

aptima.com

Traditionally Human-Machine Interfaces (HMI) have been limited in the utilization of human modalities; machines have displayed information to the human's eyes and ears and humans have controlled the machine with their hands. Interacting in this manner is both artificial and limiting of the bandwidth between the human and the machine. There are currently a number of innovative new HMI that are receiving a great deal of attention, including virtual reality, speech control, eye-gaze control, 3D audio displays, Helmet Mounted Displays (HMDs) and Heads up Displays (HUDs). A large number of the "new" technologies coming down the pike are really just minor improvements to existing display modalities (with respect to their impact on human performance and ergo mission performance). For example, novel breakthroughs in flat panel plasma displays, large screen displays, and heliodisplays (display presented on breathable air) are still "just" display monitors; there may be little remarkable beyond the technical hardware aspects.

View PDFchevron_right
Beyond Teleoperation: Exploiting Human Motor Skills with MARIOnET
Peter Stone

ABSTRACT Although machine learning has improved the rate and accuracy at which robots are able to learn, there still exist tasks for which humans can improve performance significantly faster and more robustly than computers. While some ongoing work considers the role of human reinforcement in intelligent algorithms, the burden of learning is often placed solely on the computer. These approaches neglect the expressive capabilities of humans, especially regarding our ability to quickly refine motor skills.

View PDFchevron_right
Editorial: Biomechatronics: Harmonizing Mechatronic Systems With Human Beings
Venketesh Dubey

Frontiers in Neuroscience

View PDFchevron_right
Human computer confluence applied in healthcare and rehabilitation
Alois Ferscha

Studies in health technology and informatics, 2012

Human computer confluence (HCC) is an ambitious research program studying how the emerging symbiotic relation between humans and computing devices can enable radically new forms of sensing, perception, interaction, and understanding. It is an interdisciplinary field, bringing together researches from horizons as various as pervasive computing, bio-signals processing, neuroscience, electronics, robotics, virtual & augmented reality, and provides an amazing potential for applications in medicine and rehabilitation.

View PDFchevron_right

References (100)

  1. Yomna Abdelrahman, Eduardo Velloso, Tilman Dingler, Albrecht Schmidt, and Frank Vetere. 2017. Cognitive heat: exploring the usage of thermal imaging to unobtrusively estimate cognitive load. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 33.
  2. Ehud Ahissar and Eldad Assa. 2016. Perception as a closed-loop convergence process. eLife 5, MAY2016 (2016). DOI:http://dx.doi.org/10.7554/eLife.12830
  3. Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbaek, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand Challenges in Shape-Changing Interface Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 299, 14 pages. DOI: http://dx.doi.org/10.1145/3173574.3173873
  4. Susan M Andersen and Serena Chen. 2002. The relational self: an interpersonal social-cognitive theory. Psychological review 109, 4 (2002), 619.
  5. Josh Andres, Julian de Hoog, and Florian'Floyd' Mueller. 2018. I had super-powers when eBike riding Towards Understanding the Design of Integrated Exertion. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. ACM, 19-31.
  6. W Ross Ashby. 1961. An introduction to cybernetics. Chapman & Hall Ltd.
  7. Nicholas J Belkin. 2008. Some (what) grand challenges for information retrieval. In ACM SIGIR Forum, Vol. 42. ACM, 47-54.
  8. Joanna Bergstrom-Lehtovirta, Sebastian Boring, and Kasper Hornbaek. 2017. Placing and Recalling Virtual Items on the Skin. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1497-1507. DOI:http://dx.doi.org/10.1145/3025453.3026030
  9. Joanna Bergstrom-Lehtovirta, David Coyle, Jarrod Knibbe, and Kasper Hornbaek. 2018. I Really Did That: Sense of Agency with Touchpad, Keyboard, and On-skin Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 378, 8 pages. DOI:http://dx.doi.org/10.1145/3173574.3173952
  10. Mason Bretan and Gil Weinberg. 2017. Integrating the Cognitive with the Physical: Musical Path Planning for an Improvising Robot.. In AAAI. 4371-4377.
  11. Taylor Carman. 1999. The Body in Husserl and Merleau-Ponty. Philosophical topics 27, 2 (1999), 205-226.
  12. Min Chen, Sergio Gonzalez, Athanasios Vasilakos, Huasong Cao, and Victor C. Leung. 2011. Body Area Networks: A Survey. Mob. Netw. Appl. 16, 2 (April 2011), 171-193. DOI: http://dx.doi.org/10.1007/s11036-010-0260-8
  13. Andy Clark. 2001. Natural-born cyborgs? In Cognitive technology: Instruments of mind. Springer, 17-24.
  14. David Coyle, James Moore, Per Ola Kristensson, Paul Fletcher, and Alan Blackwell. 2012. I Did That! Measuring Users' Experience of Agency in Their Own Actions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2025-2034. DOI: http://dx.doi.org/10.1145/2207676.2208350
  15. Amy JC Cuddy, Susan T Fiske, and Peter Glick. 2008. Warmth and competence as universal dimensions of social perception: The stereotype content model and the BIAS map. Advances in experimental social psychology 40 (2008), 61-149.
  16. Margo DeMello. 2007. Encyclopedia of body adornment. ABC-CLIO.
  17. Henry Dreyfuss, Henry Dreyfuss Associates, and Alvin R Tilley. 1993. The measure of man and woman: human factors in design. Whitney Library of Design.
  18. Douglas C Engelbart. 2001. Augmenting human intellect: a conceptual framework (1962). PACKER, Randall and JORDAN, Ken. Multimedia. From Wagner to Virtual Reality. New York: WW Norton & Company (2001), 64-90.
  19. Umer Farooq and Jonathan Grudin. 2016. Human-computer integration. interactions 23, 6 (2016), 26-32.
  20. Umer Farooq, Jonathan Grudin, Ben Shneiderman, Pattie Maes, and Xiangshi Ren. 2017. Human Computer Integration versus Powerful Tools. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 1277-1282. DOI: http://dx.doi.org/10.1145/3027063.3051137
  21. Umer Farooq and Jonathan T. Grudin. 2017. Paradigm Shift from Human Computer Interaction to Integration. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 1360-1363. DOI: http://dx.doi.org/10.1145/3027063.3049285
  22. Pablo Gallego Cascón, Denys J.C. Matthies, Sachith Muthukumarana, and Suranga Nanayakkara. 2019. ChewIt. An Intraoral Interface for Discreet Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 326, 13 pages. DOI: http://dx.doi.org/10.1145/3290605.3300556
  23. Ashok K Goel and Spencer Rugaber. 2015. Interactive meta-reasoning: Towards a CAD-like environment for designing game-playing agents. In Computational creativity research: Towards creative machines. Springer, 347-370.
  24. Amal Graafstra, Katina Michael, and MG Michael. 2010. Social-technical issues facing the humancentric RFID implantee sub-culture through the eyes of Amal Graafstra. In 2010 IEEE International Symposium on Technology and Society. IEEE, 498-516.
  25. Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark patterns in proxemic interactions: a critical perspective. In Proceedings of the 2014 conference on Designing interactive systems. ACM, 523-532.
  26. Mariam Hassib, Stefan Schneegass, Philipp Eiglsperger, Niels Henze, Albrecht Schmidt, and Florian Alt. 2017. EngageMeter: A system for implicit audience engagement sensing using electroencephalography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5114-5119.
  27. Kayla J. Heffernan, Frank Vetere, and Shanton Chang. 2016. You Put What, Where?: Hobbyist Use of Insertable Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1798-1809. DOI:http://dx.doi.org/10.1145/2858036.2858392
  28. Christian Holz, Tovi Grossman, George Fitzmaurice, and Anne Agur. 2012. Implanted User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 503-512. DOI: http://dx.doi.org/10.1145/2207676.2207745
  29. Sarah Homewood and Clint Heyer. 2017. Turned On / Turned Off: Speculating on the Microchip-based Contraceptive Implant. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 339-343. DOI: http://dx.doi.org/10.1145/3064663.3064726
  30. Don Ihde. 1990. Technology and the lifeworld : from garden to earth. Indiana University Press. 226 pages.
  31. Somayeh Imani, Amay J Bandodkar, AM Vinu Mohan, Rajan Kumar, Shengfei Yu, Joseph Wang, and Patrick P Mercier. 2016. A wearable chemical-electrophysiological hybrid biosensing system for real-time health and fitness monitoring. Nature communications 7 (2016), 11650.
  32. Wendy Ju. 2015. The design of implicit interactions. Synthesis Lectures on Human-Centered Informatics 8, 2 (2015), 1-93.
  33. Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly Prototyping On-skin User Interfaces Using Skin-friendly Materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, New York, NY, USA, 16-23. DOI: http://dx.doi.org/10.1145/2971763.2971777
  34. Shunichi Kasahara, Jun Nishida, and Pedro Lopes. 2019. Preemptive Action: Accelerating Human Reaction Using Electrical Muscle Stimulation Without Compromising Agency. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 643, 15 pages. DOI:http://dx.doi.org/10.1145/3290605.3300873
  35. Paul G Keil. 2015. Human-Sheepdog Distributed Cognitive Systems: An Analysis of Interspecies Cognitive Scaffolding in a Sheepdog Trial. Journal of Cognition and Culture 15, 5 (2015), 508-529.
  36. Kevin Kelly. 2009. Out of control: The new biology of machines, social systems, and the economic world. Hachette UK.
  37. Aniket Kittur, Jeffrey V Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The future of crowd work. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 1301-1318.
  38. Jarrod Knibbe, Paul Strohmeier, Sebastian Boring, and Kasper Hornbaek. 2017. Automatic calibration of high density electric muscle stimulation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 68.
  39. Marion Koelle, Matthias Kranz, and Andreas Möller. 2015. Don'T Look at Me That Way!: Understanding User Attitudes Towards Data Glasses Usage. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 362-372. DOI: http://dx.doi.org/10.1145/2785830.2785842
  40. Marion Koelle, Katrin Wolf, and Susanne Boll. 2018. Beyond LED Status Lights -Design Requirements of Privacy Notices for Body-worn Cameras. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 177-187. DOI: http://dx.doi.org/10.1145/3173225.3173234
  41. Zhuying Li, Felix Brandmueller, Stefan Greuter, and Florian Mueller. 2018a. The Guts Game: Designing Playful Experiences for Ingestible Devices. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article VS12, 1 pages. DOI: http://dx.doi.org/10.1145/3170427.3186604
  42. Zhuying Li, Rakesh Patibanda, Felix Brandmueller, Wei Wang, Kyle Berean, Stefan Greuter, and Florian Mueller. 2018b. The Guts Game: Towards Designing Ingestible Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '18). ACM, New York, NY, USA, 271-283. DOI: http://dx.doi.org/10.1145/3242671.3242681
  43. Joseph CR Licklider. 1960. Man-computer symbiosis. IRE transactions on human factors in electronics 1 (1960), 4-11.
  44. Joanne Lo, Doris Jung Lin Lee, Nathan Wong, David Bui, and Eric Paulos. 2016. Skintillates: Designing and Creating Epidermal Interactions. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 853-864. DOI: http://dx.doi.org/10.1145/2901790.2901885
  45. Pedro Lopes and Patrick Baudisch. 2017. Interactive Systems Based on Electrical Muscle Stimulation. Computer 50, 10 (2017), 28-35. DOI: http://dx.doi.org/10.1109/MC.2017.3641627
  46. Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI â Ȃ Ź15). Association for Computing Machinery, New York, NY, USA, 939â Ȃ Ş948. DOI: http://dx.doi.org/10.1145/2702123.2702461
  47. Pedro Lopes, Ryan Lavoie, Rishi Faldu, Nick Aquino, Jason Barron, Mohamed Kante, Basel Magfory, and Waleed Meleis. 2012. Eye-Controed Robotic Feeding Arm Technology. (2012).
  48. Pedro Lopes, Doga Yüksel, François Guimbretière, and Patrick Baudisch. 2016. Muscle-plotter: An interactive system based on electrical muscle stimulation that produces spatial output. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 207-217.
  49. Eric MacDonald and Ryan Wicker. 2016. Multiprocess 3D printing for increasing component functionality. Science 353, 6307 (2016). DOI: http://dx.doi.org/10.1126/science.aaf2093
  50. Steve Mann. 2001. Wearable computing: Toward humanistic intelligence. IEEE Intelligent Systems 16, 3 (2001), 10-15.
  51. Denys JC Matthies, Bodo Urban, Katrin Wolf, and Albrecht Schmidt. 2019. Reflexive Interaction - Extending the concept of Peripheral Interaction. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction (OZCHI'19). ACM. DOI: http://dx.doi.org/10.1145/3369457.3369478
  52. Maryse Maurel. 2009. The explicitation interview: examples and applications. Journal of Consciousness Studies 16, 10-11 (2009), 58-89.
  53. Alexis McCrossen. 2013. Marking Modern Times: A History of Clocks, Watches, and Other Timekeepers in American Life. University of Chicago Press.
  54. Aske Mottelson and Kasper Hornbaek. 2016. An Affect Detection Technique Using Mobile Commodity Sensors in the Wild. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 781-792. DOI: http://dx.doi.org/10.1145/2971648.2971654
  55. Aske Mottelson, Jarrod Knibbe, and Kasper Hornbaek. 2018. Veritaps: Truth Estimation from Mobile Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18).
  56. ACM, New York, NY, USA, Article 561, 12 pages. DOI: http://dx.doi.org/10.1145/3173574.3174135
  57. Florian 'Floyd' Mueller and Sarah Jane Pell. 2016. Technology Meets Adventure: Learnings from an Earthquake-interrupted Mt. Everest Expedition. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 817-828. DOI:http://dx.doi.org/10.1145/2971648.2971683
  58. Jun Nishida, Soichiro Matsuda, Mika Oki, Hikaru Takatori, Kosuke Sato, and Kenji Suzuki. 2019. Egocentric Smaller-Person Experience through a Change in Visual Perspective. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Article Paper 696, 12 pages. DOI:http://dx.doi.org/10.1145/3290605.3300926
  59. Aditya Shekhar Nittala, Anusha Withana, Narjes Pourjafarian, and Jürgen Steimle. 2018. Multi-Touch Skin: A Thin and Flexible Multi-Touch Sensor for On-Skin Input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 33, 12 pages. DOI:http://dx.doi.org/10.1145/3173574.3173607
  60. Marianna Obrist, Carlos Velasco, Chi Vi, Nimesha Ranasinghe, Ali Israr, Adrian Cheok, Charles Spence, and Ponnampalam Gopalakrishnakone. 2016. Sensing the future of HCI: touch, taste, and smell user interfaces. interactions 23, 5 (2016), 40-49.
  61. Simon Olberding, Nan-Wei Gong, John Tiab, Joseph A. Paradiso, and Jürgen Steimle. 2013. A Cuttable Multi-touch Sensor. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 245-254. DOI: http://dx.doi.org/10.1145/2501988.2502048
  62. Abdenbi Mohand Ousaid, Dogan Sinan Haliyo, Stephane Regnier, and Vincent Hayward. 2015. A Stable and Transparent Microscale Force Feedback Teleoperation System. IEEE/ASME Transactions on Mechatronics 20, 5 (2015), 2593-2603. DOI: http://dx.doi.org/10.1109/TMECH.2015.2423092
  63. Abdenbi Mohand Ousaid, Guillaume Millet, Sinan Haliyo, Stéphane Régnier, and Vincent Hayward. 2014. Feeling what an insect feels. PLoS ONE 9, 10 (2014), e108895. DOI: http://dx.doi.org/10.1371/journal.pone.0108895
  64. Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K. Kane. 2016. The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4884-4895. DOI: http://dx.doi.org/10.1145/2858036.2858130
  65. Halley P. Profita, Abigale Stangl, Laura Matuszewska, Sigrunn Sky, Raja Kushalnagar, and Shaun K. Kane. 2018. "Wear It Loud": How and Why Hearing Aid and Cochlear Implant Users Customize Their Devices. ACM Trans. Access. Comput. 11, 3, Article 13 (Sept. 2018), 32 pages. DOI:http://dx.doi.org/10.1145/3214382
  66. Howard Rheingold. 2013. Mind Amplifier: Can Our Digital Tools Make Us Smarter?. Ted Conferences.
  67. Giuseppe Riva, Monica Bacchetta, Margherita Baruffi, and Enrico Molinari. 2001. Virtual reality-based multidimensional therapy for the treatment of body image disturbances in obesity: a controlled study. Cyberpsychology & behavior 4, 4 (2001), 511-526.
  68. Joseph M. Romano and Katherine J. Kuchenbecker. 2012. Creating realistic virtual textures from contact acceleration data. IEEE Transactions on Haptics 5, 2 (2012), 109-119. DOI: http://dx.doi.org/10.1109/TOH.2011.38
  69. Himanshu Sahni, Abdelkareem Bedri, Gabriel Reyes, Pavleen Thukral, Zehua Guo, Thad Starner, and Maysam Ghovanloo. 2014. The Tongue and Ear Interface: A Wearable System for Silent Speech Recognition. In Proceedings of the 2014 ACM International Symposium on Wearable Computers (ISWC '14). ACM, New York, NY, USA, 47-54. DOI: http://dx.doi.org/10.1145/2634317.2634322
  70. MHD Yamen Saraiji, Tomoya Sasaki, Kai Kunze, Kouta Minamizawa, and Masahiko Inami. 2018. MetaArms: Body Remapping Using Feet-Controlled Artificial Arms. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). Association for Computing Machinery, New York, NY, USA, 65-74. DOI: http://dx.doi.org/10.1145/3242587.3242665
  71. Tomoya Sasaki, MHD Yamen Saraiji, Charith Lasantha Fernando, Kouta Minamizawa, and Masahiko Inami. 2017. MetaLimbs: Multiple Arms Interaction Metamorphism. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH '17). ACM, New York, NY, USA, Article 16, 2 pages. DOI: http://dx.doi.org/10.1145/3084822.3084837
  72. Edward Sazonov and Michael R Neuman. 2014. Wearable Sensors: Fundamentals, implementation and applications. Elsevier.
  73. Valentin Schwind, Jens Reinhardt, Rufat Rzayev, Niels Henze, and Katrin Wolf. 2018. Virtual Reality on the Go?: A Study on Social Acceptance of VR Glasses. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '18). ACM, New York, NY, USA, 111-118. DOI: http://dx.doi.org/10.1145/3236112.3236127
  74. Caitlyn Seim, John Chandler, Kayla DesPortes, Siddharth Dhingra, Miru Park, and Thad Starner. 2014. Passive haptic learning of Braille typing. In Proceedings of the 2014 ACM International Symposium on Wearable Computers. ACM, 111-118.
  75. Roy Shilkrot, Jochen Huber, Wong Meng Ee, Pattie Maes, and Suranga Chandima Nanayakkara. 2015. FingerReader: A Wearable Device to Explore Printed Text on the Go. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2363-2372. DOI:http://dx.doi.org/10.1145/2702123.2702421
  76. Ben Shneiderman, Catherine Plaisant, Maxine Cohen, Steven Jacobs, Niklas Elmqvist, and Nicholoas Diakopoulos. 2016. Grand challenges for HCI researchers. interactions 23, 5 (2016), 24-25.
  77. Garrett J Soler, Mengdi Bao, Devina Jaiswal, Hitten P Zaveri, Michael L DiLuna, Ryan A Grant, and Kazunori Hoshino. 2018. Focus: Medical Technology: A Review of Cerebral Shunts, Current Technologies, and Future Endeavors. The Yale Journal of Biology and Medicine 91, 3 (2018), 313.
  78. Charles Spence, Marianna Obrist, Carlos Velasco, and Nimesha Ranasinghe. 2017. Digitizing the chemical senses: possibilities & pitfalls. International Journal of Human-Computer Studies 107 (2017), 62-74.
  79. Thad Starner. 2001. The challenges of wearable computing: Part 2. Ieee Micro 21, 4 (2001), 54-67.
  80. Jürgen Steimle. 2015. Printed Electronics for Human-computer Interaction. interactions 22, 3 (April 2015), 72-75. DOI:http://dx.doi.org/10.1145/2754304
  81. Jürgen Steimle. 2016. Skin-The Next User Interface. Computer 49, 4 (2016), 83-87.
  82. Stelarc. 1993. Stomach Sculpture. (1993). https://stelarc.org/?catID=20349 Accessed: 2018-09-19.
  83. Stelarc. 96. Ping Body. (96). http://v2.nl/events/ping-body
  84. Paul Strohmeier, Sebastian Boring, and Kasper Hornbaek. 2018. From Pulse Trains to "Coloring with Vibrations": Motion Mappings for Mid-Air Haptic Textures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 65, 13 pages. DOI: http://dx.doi.org/10.1145/3173574.3173639
  85. Paul Strohmeier, Cedric Honnet, and Samppa Von Cyborg. 2016. Developing an Ecosystem for Interactive Electronic Implants. Proc. Living Machines 2016 (2016). DOI:http://dx.doi.org/10.1007/978-3-319-42417-0
  86. Ivan E Sutherland. 1965. The ultimate display. Multimedia: From Wagner to virtual reality (1965), 506-508.
  87. Dag Svanaes and Martin Solheim. 2016. Wag Your Tail and Flap Your Ears: The Kinesthetic User Experience of Extending Your Body. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3778-3779.
  88. Milos Taborsky, Tomas Skala, Martin Kocher, Marian Fedorco, and others. 2018. Extraction of a dislocated leadless pacemaker in a patient with infective endocarditis and repeated endocardial and epicardial pacing system infections. (2018).
  89. Henri Tajfel. 1974. Social identity and intergroup behaviour. Information (International Social Science Council) 13, 2 (1974), 65-93.
  90. Adriana Tapus, Maja J Mataric, and Brian Scassellati. 2007. Socially assistive robotics [grand challenges of robotics]. IEEE Robotics & Automation Magazine 14, 1 (2007), 35-42.
  91. Katia Vega and Hugo Fuks. 2013. Beauty Technology As an Interactive Computing Platform. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, New York, NY, USA, 357-360. DOI: http://dx.doi.org/10.1145/2512349.2512399
  92. Carlos Velasco, Marianna Obrist, Olivia Petit, and Charles Spence. 2018. Multisensory technology for flavor augmentation: a mini review. Frontiers in psychology 9 (2018), 26.
  93. Peter-Paul Verbeek. 2005. What Things Do: Philosophical Reflections on Technology, Agency and Design. Pennsylvania State University Press, Pennsylvania.
  94. Aaron I Vinik, A Gordon Smith, J Robinson Singleton, Brian Callaghan, Barry I Freedman, Jaakko Tuomilehto, Lyse Bordier, Bernard Bauduceau, and Frederic Roche. 2016. Normative values for electrochemical skin conductances and impact of ethnicity on quantitative assessment of sudomotor function. Diabetes technology & therapeutics 18, 6 (2016), 391-398.
  95. Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2991-3000. DOI: http://dx.doi.org/10.1145/2702123.2702391
  96. Martin Weigel, Aditya Shekhar Nittala, Alex Olwal, and Jürgen Steimle. 2017. SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3095-3105. DOI: http://dx.doi.org/10.1145/3025453.3025704
  97. Mark Weiser. 1991. The Computer for the 21 st Century. Scientific american 265, 3 (1991), 94-105.
  98. Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 365-378. DOI: http://dx.doi.org/10.1145/3242587.3242645
  99. Katrin Wolf and Timm Bäder. 2015. Illusion of surface changes induced by tactile and visual touch feedback. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1355-1360.
  100. Xiuxiu Yuan. 2018. User specific assistive technology: hand mounted switch control platform design. Ph.D. Dissertation. Georgia Institute of Technology.

Related papers

Human–Computer Integration: Towards Integrating the Human Body with the Computational Machine
Rakesh Patibanda

Foundations and Trends® in Human-Computer Interaction

Human-Computer Integration (short: HInt) is an emerging new paradigm in the humancomputer interaction (HCI) field. Its goal is to integrate the human body and the computational machine. This article presents two key dimensions of Human-Computer Integration (bodily agency and bodily ownership) and proposes a set of challenges that we believe need to be resolved in order to bring the paradigm forward. Ultimately, our work aims to facilitate a more structured investigation into human body and computational machine integration.

View PDFchevron_right
Human-computer integration
Umer Farooq

Interactions, 2016

View PDFchevron_right
The human-robot merger
Tim Lueth

2012 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2012

In this presentation a practical look is taken at how the use of implant and electrode technology can be employed to create biological brains for robots, to enable human enhancement and to diminish the effects of certain neural illnesses. In all cases the end result is to increase the range of abilities of the recipients. An indication is given of a number of areas in which such technology has already had a profound effect, a key element being the need for a clear interface linking a biological brain directly with computer technology. The emphasis is clearly placed on experimental scientific studies that have been and are being undertaken and reported on. The area of focus is notably the need for a biological/technological connection, where a link is made directly with the cerebral cortex and/or nervous system. The presentation will consider the future in which robots have biological, or part-biological, brains and in which neural implants link the human nervous system bi-directionally with technology and the internet.

View PDFchevron_right
SIGHInt: Special Interest Group for Human-Computer Integration
Rakesh Patibanda

Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 2021

Human-Computer Integration (HInt) is a growing paradigm within HCI which seeks to understand how humans can, and already are, merging with computational machines. HInt's recent inception and evolution has seen much discussion in a variety of symposiums, workshops, and publications for HCI. This has enabled a democratized and decentralised emergence of its core concepts. While this has allowed for rapid growth in our understanding of HInt, there is some discrepancy in how the proponents of this movement might describe its principles, motivations, definitions, and ultimate goals, with many offshoot concepts of HInt beginning to emerge. SIGHint aims to provide a platform to facilitate high level discussion and collation of information between researchers and designers seeking to learn from and contribute to the development of Human-Computer Integration. It is our intention that through this SIG we may better understand how new and emerging, diverging ideas, and perspectives within Human-Computer Integration relate to each other, ultimately facilitating a mapping of the paradigm and a synthesis of its concepts.

View PDFchevron_right
Do Cyborgs dream of Electric Limbs? Experiential Factors in Human-Computer Integration Design and Evaluation
Sang-won Leigh

Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

While many systems have successfully demonstrated functional integration of humans and technology, little attention has been paid to how technologies might experientially integrate to feel as part of humans. Our aim is to shed light on the importance of experiential integration and provide researchers with a scientifically driven foundation for future designs and investigations. The workshop will consist of hands-on experiments with novel body-illusions, discussions on experiential integration, and instructor-guided sessions Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

View PDFchevron_right

Cited by

Unpacking Non-Dualistic Design: The Soma Design Case
Pedro Sanches

ACM Transactions on Computer-Human Interaction

We report on a somaesthetic design workshop and the subsequent analytical work aiming to demystify what is entailed in a non-dualistic design stance on embodied interaction and why a first-person engagement is crucial to its unfoldings. However, as we will uncover through a detailed account of our process, these first-person engagements are deeply entangled with second- and third-person perspectives, sometimes even overlapping. The analysis furthermore reveals some strategies for bridging the body-mind divide by attending to our inner universe and dissolving or traversing dichotomies between inside and outside ; individual and social ; body and technology . By detailing the creative process, we show how soma design becomes a process of designing with and through kinesthetic experience, in turn letting us confront several dualisms that run like fault lines through HCI’s engagement with embodied interaction.

View PDFchevron_right
Do Cyborgs dream of Electric Limbs? Experiential Factors in Human-Computer Integration Design and Evaluation
Sang-won Leigh

Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

While many systems have successfully demonstrated functional integration of humans and technology, little attention has been paid to how technologies might experientially integrate to feel as part of humans. Our aim is to shed light on the importance of experiential integration and provide researchers with a scientifically driven foundation for future designs and investigations. The workshop will consist of hands-on experiments with novel body-illusions, discussions on experiential integration, and instructor-guided sessions Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

View PDFchevron_right
Immersive Inclusivity at CHI: Design and Creation of Inclusive User Interactions Through Immersive Media
Mark Billinghurst

Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 2021

Figure 1: (a) Proposed immersive inclusive design placement in relation the felds of Human-Computer Interaction, immersive media, and accessibility. (b, c) Examples of immersive inclusive design applications: (b) using a wheelchair remotely controlled through Virtual Reality (VR) telepresence interface for assistance [3], (c) applying a headworn hair clip for translation of auditory signals into haptic vibration [4]

View PDFchevron_right
Machine In The Middle: Exploring Dark Patterns of Emotional Human-Computer Integration Through Media Art
rod Dickinson

CHI Conference on Human Factors in Computing Systems Extended Abstracts

As our relationship with machines becomes evermore intimate, we observe increasing efforts in the quantification of human emotion, which has historically generated unintended consequences. We acknowledge an amplification of this trend through recent technological developments that aim toward human-computer integration, and explore the dark patterns that may arise for integrating emotions with machinic processes through "machine_in_the_middle". Machine_in_the_middle is an interactive system in which a participant wears an electroencephalographic headset, and their neural activity is analysed to ascertain an approximation of their emotional state. Using electrical muscle stimulation their face is animated into an expression that corresponds with the output of the emotional recognition system. Through our work, we contribute the insight of three possible dark patterns that might emerge from emotional integration, including: reductionism of human emotion, disruptions of agency, and parasitic symbiosis. We hope that these insights inspire researchers and practitioners to approach human-computer integration more cautiously.

View PDFchevron_right
On Eliciting a Sense of Self when Integrating with Computers
Sang-won Leigh

Augmented Humans 2022

Figure 1: We argue that eliciting a sense of self allows for user experiences such as "I did that (with my body)", going beyond "I made the machine do that (for me)" and "The machine did that (for me)", which is often the current approach when it comes to physical integration of computer systems.

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved