Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Throwing Motion as a Case Study
Related Work
System Design
Overview of the System Design
User Study and Results
User Study 1: With Aiming at the Target
Results of User Study 1
Participants
Procedure
Qualitative Findings
User Study 2: Without Aiming at the Target
Results of User Study 2
Findings from the Demonstration
Discussion and Limitation
Future Work
Conclusion
References
All Topics
Computer Science

Dynamic Motor Skill Synthesis with Human-Machine Mutual Actuation

Profile image of Daisuke UriuDaisuke Uriu

Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

https://doi.org/10.1145/3313831.3376705
visibility

…

description

12 pages

link

1 file

Abstract

This paper presents an approach for coupling robotic capability with human ability in dynamic motor skills, called "Human-Machine Mutual Actuation (HMMA)." We focus specifically on throwing motions and propose a method to control the release timing computationally. A system we developed achieves our concept, HMMA, by a robotic handheld device that acts as a release controller. We conducted user studies to validate the feasibility of the concept and clarify related technical issues to be tackled. We recognized that the system successfully performs on throwing according to the target while it exploits human ability. These empirical experiments suggest that robotic capability can be embedded into the users' motions without losing their senses of control. Throughout the user study, we also revealed several issues to be tackled in further research contributing to HMMA.

Related papers

Skill learning based catching motion control
Haşmet Gürçay

Computer Animation and Virtual Worlds, 2015

In real world, it is crucial to learn biomechanical strategies that prepare the body in kinematics and kinetics terms during the interception tasks, such as kicking, throwing and catching. Based on this, we presents a real-time physics-based approach that generate natural and physically plausible motions for a highly complex task-ball catching. We showed that ball catching behavior as many other complex tasks, can be achieved with the proper combination of rather simple motor skills, such as standing, walking, reaching. Since learned biomechanical strategies can increase the conscious in motor control, we concerned several issues that needs to be planned. Among them, we intensively focus on the concept of timing. The character learns some policies to know how and when to react by using reinforcement learning in order to use time accurately. We demonstrate the effectiveness of our method by presenting some of the catching animation results executed in different catching strategies.In each simulation, the balls were projected randomly, but within a interval of limits, in order to obtain different arrival flight time and height conditions.

View PDFchevron_right
FauxThrow: Exploring the Effects of Incorrect Point of Release in Throwing Motions
Göksu Yamaç

ACM Symposium on Applied Perception 2022

Our aim is to develop a better understanding of how the Point of Release (PoR) of a ball affects the perception of animated throwing motions. We present the results of a perceptual study where participants viewed animations of a virtual human throwing a ball, in which the point of release was modified to be early or late. We found that errors in overarm throws with a late PoR are detected more easily than an early PoR, while the opposite is true for underarm throws. The viewpoint and the distance the ball travels also have an effect on perceived realism. The results of this research can help improve the plausibility of throwing animations in interactive applications such as games or VR.

View PDFchevron_right
Robotics-based Synthesis of Human Motion
Emel Demircan

The synthesis of human motion is a complex procedure that involves accurate reconstruction of movement sequences, modeling of musculoskeletal kinematics, dynamics and actuation, and characterization of reliable performance criteria. Many of these processes have much in common with the problems found in robotics research. Task-based methods used in robotics may be leveraged to provide novel musculoskeletal modeling methods and physiologically accurate performance predictions. In this paper, we present (i) a new method for the real-time reconstruction of human motion trajectories using direct marker tracking, (ii) a task-driven muscular effort minimization criterion and (iii) new human performance metrics for dynamic characterization of athletic skills. Dynamic motion reconstruction is achieved through the control of a simulated human model to follow the captured marker trajectories in real-time. The operational space control and real-time simulation provide human dynamics at any configuration of the performance. A new criteria of muscular effort minimization has been introduced to analyze human static postures. Extensive motion capture experiments were conducted to validate the new minimization criterion. Finally, new human performance metrics were introduced to study in details an athletic skill. These metrics include the effort expenditure and the feasible set of operational space accelerations during the performance of the skill. The dynamic characterization takes into account skeletal kinematics as well as muscle routing kinematics and force generating capacities. The developments draw upon an advanced musculoskeletal modeling platform and a task-oriented framework for the effective integration of biomechanics and robotics methods.

View PDFchevron_right
Robotics of human movements
Markus Grebenstein

Journal of Physiology-Paris, 2009

The construction of robotic systems that can move the way humans do, with respect to agility, stability and precision, is a necessary prerequisite for the successful integration of robotic systems in human environments. We explain human-centered views on robotics, based on the three basic ingredients (1) actuation; (2) sensing; and (3) control, and formulate detailed examples thereof.

View PDFchevron_right
Human-Robotic Collaborative Intelligent Control for Reaching Performance
Rodolphe Gentili

Lecture Notes in Computer Science, 2013

In most human-robot interfaces, the user completely controls the robot that operates as a passive tool without adaptation capabilities. However, a synergetic human-robot interface where both agents collaborate could improve the user's performance while reducing the cognitive and physical workload. Specifically, when considering this framework applied to rehabilitation, we examined a shared collaborative control between a human user and an adaptive biologically inspired neurocontroller in order to perform reaching movements with a simulated prosthetic arm. When this neurocontroller was enabled, it progressively learned from the user to control the prosthetic arm, increasing its role in the shared performance and facilitating the user's reaching movements. This resulted in the user's performance enhancement and in a reduction of his/her cognitive workload. The long term goal of this work is to contribute to the development of the next generation of intelligent human-robotic interfaces for rehabilitation.

View PDFchevron_right
Scalable, Intuitive Human to Robot Skill Transfer with Wearable Human Machine Interfaces: On Complex, Dexterous Tasks
Minas Liarokapis

IEEE/RSJ International Conference on Intelligent Robots and Systems, 2023

The advent of collaborative industrial and household robotics has blurred the demarcation between the human and robot workspace. The capability of robots to function efficiently alongside humans requires new research to be conducted in dynamic environments as opposed to the traditional wellstructured laboratory. In this work, we propose an efficient skill transfer methodology comprising intuitive interfaces, efficient optical tracking systems, and compliant control of robotic armhand systems. The lightweight wearable interfaces mounted with robotic grippers and hands allow the execution of dexterous activities in dynamic environments without restricting human dexterity. The fiducial and reflective markers mounted on the interfaces facilitate the extraction of positional and rotational information allowing efficient trajectory tracking. As the tasks are performed using the mounted grippers and hands, gripper state information can be directly transferred. The hardware-agnostic nature and efficiency of the proposed interfaces and skill transfer methodology are demonstrated through the execution of complex tasks that require increased dexterity, writing and drawing.

View PDFchevron_right
Supplementary Material for Characterizing Input Methods for Human-to-Robot Demonstrations
Michael Gleicher

2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2019

Human demonstrations are important in a range of robotics applications, and are created with a variety of input methods. However, the design space for these input methods has not been extensively studied. In this paper, focusing on demonstrations of hand-scale object manipulation tasks to robot arms with two-finger grippers, we identify distinct usage paradigms in robotics that utilize human-to-robot demonstrations, extract abstract features that form a design space for input methods, and characterize existing input methods as well as a novel input method that we introduce, the instrumented tongs. We detail the design specifications for our method and present a user study that compares it against three common input methods: free-hand manipulation, kinesthetic guidance, and teleoperation. Study results show that instrumented tongs provide high quality demonstrations and a positive experience for the demonstrator while offering good correspondence to the target robot.

View PDFchevron_right
HANDS.DVI: A DeVice-Independent Programming and Control Framework for Robotic HANDS
edoardo farnioli

Springer Tracts in Advanced Robotics, 2014

The scientific goal of HANDS.DVI consists of developing a common framework to programming robotic hands independently from their kinematics, mechanical construction, and sensor equipment complexity. Recent results on the organization of the human hand in grasping and manipulation are the inspiration for this experiment. The reduced set of parameters that we effectively use to control our hands is known in the literature as the set of synergies. The synergistic organization of the human hand is the theoretical foundation of the innovative approach to design a unified framework for robotic hands control. Theoretical tools have been studied to design a suitable mapping function of the control action (decomposed in its elemental action) from a human hand model domain onto the articulated robotic hand co-domain. The developed control framework has been applied on an experimental set up consisting of two robotic hands with dissimilar kinematics grasping an object instrumented with force sensors.

View PDFchevron_right
Characterizing Input Methods for Human-to-Robot Demonstrations
Michael Gleicher

2019

Human demonstrations are important in a range of robotics applications, and are created with a variety of input methods. However, the design space for these input methods has not been extensively studied. In this paper, focusing on demonstrations of hand-scale object manipulation tasks to robot arms with two-finger grippers, we identify distinct usage paradigms in robotics that utilize human-to-robot demonstrations, extract abstract features that form a design space for input methods, and characterize existing input methods as well as a novel input method that we introduce, the instrumented tongs. We detail the design specifications for our method and present a user study that compares it against three common input methods: free-hand manipulation, kinesthetic guidance, and teleoperation. Study results show that instrumented tongs provide high quality demonstrations and a positive experience for the demonstrator while offering good correspondence to the target robot.

View PDFchevron_right
A Modular Approach to the Embodiment of Hand Motions from Human Demonstrations
Manuela Uliano

arXiv (Cornell University), 2022

Manipulating objects with robotic hands is a complicated task. Not only the fingers of the hand, but also the pose of the robot's end effector need to be coordinated. Using human demonstrations of movements is an intuitive and data-efficient way of guiding the robot's behavior. We propose a modular framework with an automatic embodiment mapping to transfer recorded human hand motions to robotic systems. In this work, we use motion capture to record human motion. We evaluate our approach on eight challenging tasks, in which a robotic hand needs to grasp and manipulate either deformable or small and fragile objects. We test a subset of trajectories in simulation and on a real robot and the overall success rates are aligned.

View PDFchevron_right

References (49)

  1. Ismail Ben Abdallah, Yassine Bouteraa, and Chokri Rekik. 2017. Design and development of 3D printed myoelectric robotic exoskeleton for hand rehabilitation. International Journal on Smart Sensing & Intelligent Systems 10, 2 (2017).
  2. Lung-Pan Cheng, Patrick Lühne, Pedro Lopes, Christoph Sterz, and Patrick Baudisch. 2014. Haptic turk: a motion platform based on people. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3463-3472. DOI: http://dx.doi.org/10.1145/2556288.2557101
  3. Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Mutual human actuation. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 797-805. DOI: http://dx.doi.org/10.1145/3126594.3126667
  4. Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch. 2015. Turkdeck: Physical virtual reality based on people. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 417-426. DOI:http://dx.doi.org/10.1145/2807442.2807463
  5. Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's hammer: An ungrounded force feedback device utilizing propeller-induced propulsive force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 525. DOI: http://dx.doi.org/10.1145/3173574.3174099
  6. Jon Hore and Sherry Watts. 2011. Skilled throwers use physics to time ball release to the nearest millisecond. Journal of Neurophysiology 106, 4 (2011), 2024-2033. DOI:http://dx.doi.org/10.1152/jn.00059.2011
  7. Yuuki Horiuchi, Yasutoshi Makino, and Hiroyuki Shinoda. 2017. Computational foresight: forecasting human body motion in real-time for reducing delays in interactive system. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. ACM, 312-317. DOI: http://dx.doi.org/10.1145/3132272.3135076
  8. Jian Huang, Weiguang Huo, Wenxia Xu, Samer Mohammed, and Yacine Amirat. 2015. Control of upper-limb power-assist exoskeleton using a human-robot interface based on motion intention recognition. IEEE transactions on automation science and engineering 12, 4 (2015), 1257-1270. DOI: http://dx.doi.org/10.1109/TASE.2015.2466634
  9. Yuta Itoh, Jason Orlosky, Kiyoshi Kiyokawa, and Gudrun Klinker. 2016. Laplacian vision: Augmenting motion prediction via optical see-through head-mounted displays. In Proceedings of the 7th Augmented Human International Conference 2016. ACM, 16. DOI: http://dx.doi.org/10.1145/2875194.2875227
  10. Urs Keller, Hubertus JA van Hedel, Verena Klamroth-Marganska, and Robert Riener. 2016. ChARMin: The first actuated exoskeleton robot for pediatric arm rehabilitation. IEEE/ASME Transactions on Mechatronics 21, 5 (2016), 2201-2213. DOI: http://dx.doi.org/10.1109/TMECH.2016.2559799
  11. Jinsoo Kim, Giuk Lee, Roman Heimgartner, Dheepak Arumukhom Revi, Nikos Karavas, Danielle Nathanson, Ignacio Galiana, Asa Eckert-Erdheim, Patrick Murphy, David Perry, and others. 2019. Reducing the metabolic rate of walking and running with a versatile, portable exosuit. Science 365, 6454 (2019), 668-672. DOI: http://dx.doi.org/10.1126/science.aav7536
  12. Jan Koprnickỳ, Petr Najman, and Jiří Šafka. 2017. 3D printed bionic prosthetic hands. In 2017 IEEE International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM). IEEE, 1-6. DOI: http://dx.doi.org/10.1109/ECMSM.2017.7945898
  13. Benjamin Lafreniere, Tovi Grossman, Fraser Anderson, Justin Matejka, Heather Kerrick, Danil Nagy, Lauren Vasey, Evan Atherton, Nicholas Beirne, Marcelo H Coelho, and others. 2016. Crowdsourced fabrication. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 15-28. DOI: http://dx.doi.org/10.1145/2984511.2984553
  14. Ian Lenz, Honglak Lee, and Ashutosh Saxena. 2015. Deep learning for detecting robotic grasps. The International Journal of Robotics Research 34, 4-5 (2015), 705-724. DOI: http://dx.doi.org/10.1177/0278364914549607
  15. Baldin Llorens-Bonilla, Federico Parietti, and H Harry Asada. 2012. Demonstration-based control of supernumerary robotic limbs. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 3936-3942. DOI: http://dx.doi.org/10.1109/IROS.2012.6386055
  16. Sebastian Madgwick. 2010. An efficient orientation filter for inertial and inertial/magnetic sensor arrays. Report x-io and University of Bristol (UK) 25 (2010), 113-118.
  17. Azumi Maekawa, Seito Matsubara, Atsushi Hiyama, and Masahiko Inami. 2019a. PickHits: hitting experience generation with throwing motion via a handheld mechanical device. In ACM SIGGRAPH 2019 Emerging Technologies. ACM, 20. DOI: http://dx.doi.org/10.1145/3305367.3327996
  18. Azumi Maekawa, Shota Takahashi, MHD Saraiji, Sohei Wakisaka, Hiroyasu Iwata, and Masahiko Inami. 2019b. Naviarm: Augmenting the Learning of Motor Skills using a Backpack-type Robotic Arm System. In Proceedings of the 10th Augmented Human International Conference 2019. ACM, 38.
  19. Julieta Martinez, Michael J Black, and Javier Romero. 2017. On Human Motion Prediction Using Recurrent Neural Networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 4674-4683. DOI: http://dx.doi.org/10.1109/CVPR.2017.497
  20. Kenichi Murakami, Yuji Yamakawa, Taku Senoo, and Masatoshi Ishikawa. 2015. Motion planning for catching a light-weight ball with high-speed visual feedback. In 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 339-344. DOI: http://dx.doi.org/10.1109/ROBIO.2015.7418790
  21. Jun Nishida, Shunichi Kasahara, and Kenji Suzuki. 2017. Wired muscle: generating faster kinesthetic reaction by inter-personally connecting muscles. In ACM SIGGRAPH 2017 Emerging Technologies. ACM, 26. DOI:http://dx.doi.org/10.1145/3084822.3084844
  22. Kei Nitta, Keita Higuchi, and Jun Rekimoto. 2014. HoverBall: augmented sports with a flying ball. In Proceedings of the 5th Augmented Human International Conference. ACM, 13. DOI: http://dx.doi.org/10.1145/2582051.2582064
  23. Kei Nitta, Keita Higuchi, Yuichi Tadokoro, and Jun Rekimoto. 2015. Shepherd pass: ability tuning for augmented sports using ball-shaped quadcopter. In Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology. ACM, 11. DOI:http://dx.doi.org/10.1145/2832932.2832950
  24. Takuya Nojima, Dairoku Sekiguchi, Masahiko Inami, and Susumu Tachi. 2002. The SmartTool: A system for augmented reality of haptics. In Proceedings IEEE Virtual Reality 2002. IEEE, 67-72. DOI: http://dx.doi.org/10.1109/VR.2002.996506
  25. Tomoya Ohta, Shumpei Yamakawa, Takashi Ichikawa, and Takuya Nojima. 2014. TAMA: development of trajectory changeable ball for future entertainment. In Proceedings of the 5th Augmented Human International Conference. ACM, 50. DOI: http://dx.doi.org/10.1145/2582051.2582101
  26. Federico Parietti, Kameron Chan, and H Harry Asada. 2014. Bracing the human body with supernumerary robotic limbs for physical assistance and load reduction. In 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 141-148. DOI: http://dx.doi.org/10.1109/ICRA.2014.6906601
  27. Luka Peternel, Tadej Petriˇ c. c, Erhan Oztop, and Jan Babiˇ 2014. Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach. Autonomous robots 36, 1-2 (2014), 123-136. DOI: http://dx.doi.org/10.1007/s10514-013-9361-0
  28. Domenico Prattichizzo, Monica Malvezzi, Irfan Hussain, and Gionata Salvietti. 2014. The sixth-finger: a modular extra-finger to enhance human hand capabilities. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 993-998. DOI:http://dx.doi.org/10.1109/ROMAN.2014.6926382
  29. RJ Rajesh and P Kavitha. 2015. Camera gimbal stabilization using conventional PID controller and evolutionary algorithms. In 2015 International Conference on Computer, Communication and Control (IC4). IEEE, 1-6. DOI: http://dx.doi.org/10.1109/IC4.2015.7375580
  30. Robert Riener. 2016. The Cybathlon promotes the development of assistive technology for people with physical disabilities. Journal of neuroengineering and rehabilitation 13, 1 (2016), 49. DOI: http://dx.doi.org/10.1186/s12984-016-0157-2
  31. Alec Rivers, Ilan E Moyer, and Frédo Durand. 2012. Position-correcting tools for 2D digital fabrication. ACM Transactions on Graphics (TOG) 31, 4 (2012), 88. DOI: http://dx.doi.org/10.1145/2185520.2185584
  32. Mark Rober. 2017. Automatic Bullseye, MOVING DARTBOARD. https://www.youtube.com/watch?v=MHTizZ_XcUM. (2017). Accessed: 2019-09-10.
  33. MHD Saraiji, Tomoya Sasaki, Kai Kunze, Kouta Minamizawa, and Masahiko Inami. 2018a. MetaArmS: Body remapping using feet-controlled artificial arms. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 65-74. DOI: http://dx.doi.org/10.1145/3242587.3242665
  34. MHD Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami. 2018b. Fusion: full body surrogacy for collaborative communication. In ACM SIGGRAPH 2018 Emerging Technologies. ACM,
  35. DOI:http://dx.doi.org/10.1145/3214907.3214912
  36. Koya Sato, Yuji Sano, Mai Otsuki, Mizuki Oka, and Kazuhiko Kato. 2019. Augmented Recreational Volleyball Court: Supporting the Beginners' Landing Position Prediction Skill by Providing Peripheral Visual Feedback. In Proceedings of the 10th Augmented Human International Conference 2019. ACM, 15. DOI: http://dx.doi.org/10.1145/3311823.3311843
  37. Taku Senoo, Yuuki Horiuchi, Yoshinobu Nakanishi, Kenichi Murakami, and Masatoshi Ishikawa. 2016. Robotic pitching by rolling ball on fingers for a randomly located target. In 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 325-330. DOI: http://dx.doi.org/10.1109/ROBIO.2016.7866343
  38. Taku Senoo, Akio Namiki, and Masatoshi Ishikawa. 2004. High-speed batting using a multi-jointed manipulator. In IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA'04. 2004, Vol. 2. IEEE, 1191-1196. DOI: http://dx.doi.org/10.1109/ROBOT.2004.1307986
  39. Taku Senoo, Akio Namiki, and Masatoshi Ishikawa. 2006. Ball control in high-speed batting motion using hybrid trajectory generator. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006. IEEE, 1762-1767. DOI: http://dx.doi.org/10.1109/ROBOT.2006.1641961
  40. Taku Senoo, Akio Namiki, and Masatoshi Ishikawa. 2008. High-speed throwing motion based on kinetic chain approach. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 3206-3211. DOI: http://dx.doi.org/10.1109/IROS.2008.4651142
  41. Tatsuya Teramae, Koji Ishihara, Jan Babič, Jun Morimoto, and Erhan Oztop. 2018. Human-in-the-loop control and task learning for pneumatically actuated muscle based robots. Frontiers in neurorobotics 12 (2018). DOI: http://dx.doi.org/10.3389/fnbot.2018.00071
  42. Junichi Yamaoka and Yasuaki Kakehi. 2013. dePENd: augmented handwriting system using ferromagnetism of a ballpoint pen. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 203-210. DOI: http://dx.doi.org/10.1145/2501988.2502017
  43. Hiroaki Yano, Masayuki Yoshie, and Hiroo Iwata. 2003. Development of a non-grounded haptic interface using the gyro effect. In 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings. IEEE, 32-39. DOI: http://dx.doi.org/10.1109/HAPTIC.2003.1191223
  44. Hong Kai Yap, Jeong Hoon Lim, Fatima Nasrallah, James CH Goh, and Raye CH Yeow. 2015. A soft exoskeleton for hand assistive and rehabilitation application using pneumatic actuators with variable stiffness. In 2015 IEEE international conference on robotics and automation (ICRA). IEEE, 4967-4972. DOI:http://dx.doi.org/10.1109/ICRA.2015.7139889
  45. Hironori Yoshida, Takeo Igarashi, Yusuke Obuchi, Yosuke Takami, Jun Sato, Mika Araki, Masaaki Miki, Kosuke Nagata, Kazuhide Sakai, and Syunsuke Igarashi. 2015. Architecture-scale human-assisted additive manufacturing. ACM Transactions on Graphics (TOG) 34, 4 (2015), 88. DOI: http://dx.doi.org/10.1145/2766951
  46. Andy Zeng, Shuran Song, Kuan-Ting Yu, Elliott Donlon, Francois R Hogan, Maria Bauza, Daolin Ma, Orion Taylor, Melody Liu, Eudald Romo, and others. 2018. Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching. In 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 1-8. DOI: http://dx.doi.org/10.1109/ICRA.2018.8461044
  47. Juanjuan Zhang, Pieter Fiers, Kirby A Witte, Rachel W Jackson, Katherine L Poggensee, Christopher G Atkeson, and Steven H Collins. 2017. Human-in-the-loop optimization of exoskeleton assistance during walking. Science 356, 6344 (2017), 1280-1284. DOI: http://dx.doi.org/10.1126/science.aal5054
  48. Amit Zoran and Joseph A Paradiso. 2013. FreeD: a freehand digital sculpting tool. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2613-2616. DOI: http://dx.doi.org/10.1145/2470654.2481361
  49. Amit Zoran, Roy Shilkrot, and Joseph Paradiso. 2013. Human-computer interaction for hybrid carving. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 433-440. DOI:http://dx.doi.org/10.1145/2501988.2502023

Related papers

A Framework to Describe, Analyze and Generate Interactive Motor Behaviors
Etienne Burdet

PLoS ONE, 2012

While motor interaction between a robot and a human, or between humans, has important implications for society as well as promising applications, little research has been devoted to its investigation. In particular, it is important to understand the different ways two agents can interact and generate suitable interactive behaviors. Towards this end, this paper introduces a framework for the description and implementation of interactive behaviors of two agents performing a joint motor task. A taxonomy of interactive behaviors is introduced, which can classify tasks and cost functions that represent the way each agent interacts. The role of an agent interacting during a motor task can be directly explained from the cost function this agent is minimizing and the task constraints. The novel framework is used to interpret and classify previous works on human-robot motor interaction. Its implementation power is demonstrated by simulating representative interactions of two humans. It also enables us to interpret and explain the role distribution and switching between roles when performing joint motor tasks.

View PDFchevron_right
Equifinal Throwing Movements – Computational Approach, Mechanical Implementation, and Learning Intervention
Heiko Maurer

BIO Web of Conferences, 2011

Whenever high target accuracy is a limiting factor of motor performance, as in goal-oriented throwing tasks, equifinal movement techniques can be used to reduce the influence of inherent biological variability on the task result. In throwing movements, for instance, these techniques are characterized by a specific spatio-temporal organization of the movement trajectory that allows several moments of release that lead to a target hit. Throwing experts (e.g. darts or boule players) with the experience of several ten thousand practice trials show equifinal movements, but also throwing novices can learn to use equifinality after at least 1000 trials of practice. Here, we present a study that aims to scrutinize how the acquisition of equifinal throwing movements can be improved and accelerated. Mechanical guidance was used as intervention method. Determination and mechanical implementation of an equifinal technique in a virtual goal-oriented throwing task as well as results of a four-day intervention experiment are presented. Results confirm that the approaches to compute an equifinal movement trajectory and to implement mechanical guidance are appropriate to support acquisition of error tolerant movement strategies.

View PDFchevron_right
Throwing Skill Optimization through Synchronization and Desynchronization of Degree of Freedom
Yukie Nagai

Lecture Notes in Computer Science, 2013

Humanoid robots have a large number of degrees of freedom (DoFs), therefore motor learning by such robots which explore the optimal parameters of behaviors is one of the most serious issues in humanoid robotics. In contrast, it has been suggested that humans can solve such a problem by synchronizing many body parts in the early stage of learning, and then desynchronizing their movements to optimize a behavior for a task. This is called as "Freeze and Release." We hypothesize that heuristic exploration through synchronization and desynchronization of DoFs accelerates motor learning of humanoid robots. In this paper, we applied this heuristic to a throwing skill learning in soccer. First, all motors related to the skill are actuated in a synchronized manner, thus the robot explores optimal timing of releasing a ball in one-dimensional search space. The DoFs are released gradually, which allows to search for the best timing to actuate the motors of all joints. The real robot experiments showed that the exploration method was fast and practical because the solution in low-dimensional subspace was approximately optimum.

View PDFchevron_right
Beyond Teleoperation: Exploiting Human Motor Skills with MARIOnET
Peter Stone

ABSTRACT Although machine learning has improved the rate and accuracy at which robots are able to learn, there still exist tasks for which humans can improve performance significantly faster and more robustly than computers. While some ongoing work considers the role of human reinforcement in intelligent algorithms, the burden of learning is often placed solely on the computer. These approaches neglect the expressive capabilities of humans, especially regarding our ability to quickly refine motor skills.

View PDFchevron_right
Minimum jerk based prediction of user actions for a ball catching task
Henrik Christensen

2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007

The present paper examines minimum jerk models for human kinematics as a tool to predict user input in teleoperation with significant dynamics. Predictions of user input can be a powerful tool to bridge time-delays and to trigger autonomous sub-sequences. In this paper an example implementation is presented, along with the results of a pilot experiment in which a virtual reality simulation of a teleoperated ball-catching scenario is used to test the predictive power of the model. The results show that delays up to 100 ms can potentially be bridged with this approach.

View PDFchevron_right

Related topics

  • Computer Science

    • Cited by

    The Tight Game: Implicit Force Intervention in Inter-personal Physical Interactions on Playing Tug of War
    Daisuke Uriu

    ACM SIGGRAPH 2020 Emerging Technologies

    View PDFchevron_right
    Cyborgs, Human Augmentation, Cybernetics, and JIZAI Body
    Daisuke Uriu

    Augmented Humans 2022

    Figure 1: Visionary images of the JIZAI Body. Left: A ballerina beautifully moves her body, Center and Right: An augmented ballerina moves her body and wearable robotic arms as she wishes in every situation.

    View PDFchevron_right
    Machine-Mediated Teaming: Mixture of Human and Machine in Physical Gaming Experience
    Daisuke Uriu

    CHI Conference on Human Factors in Computing Systems

    View PDFchevron_right
    STAMPER: Human-machine Integrated Drumming
    Daisuke Uriu

    Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

    STAMPER enables drummers to generate innovative performances by controlling multiple bass drums. STAMPER consists of several "Actuated Pedals (APs)," bass drum pedals embedded with an EC motor, paired with bass drums, and a machine vision system. The APs are used both as input and output. One AP in input mode senses the position of the pedal being used by the drummer. Other APs in actuated mode respond to the input mode AP's motion. Machine vision is used to monitor the drummer's movements to control the behavior of the actuated APs. In this paper, we describe the current prototype of STAMPER and what kind of drum performances can be achieved with the system by reporting a study conducted with an experienced drummer. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI).

    View PDFchevron_right
    Social Digital Cyborgs: The Collaborative Design Process of JIZAI ARMS
    Daisuke Uriu

    Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

    Half a century since the concept of a cyborg was introduced, digital cyborgs, enabled by the spread of wearable robotics, are the focus of much research in recent times. We introduce JIZAI ARMS, a supernumerary robotic limb system consisting of a wearable base unit with six terminals and detachable robot arms controllable by This work is licensed under a Creative Commons Attribution International 4.0 License.

    View PDFchevron_right
    580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved