Forming Human-Robot Teams Across Time and Space
2012
Abstract
NASA pushes telerobotics to distances that span the Solar System. At this scale, time of flight for communication is limited by the speed of light, inducing long time delays, narrow bandwidth and the real risk of data disruption. NASA also supports missions where humans are in direct contact with robots during extravehicular activity (EVA), giving a range of zero to hundreds of millions of miles for NASA's definition of "tele". Another temporal variable is mission phasing. NASA missions are now being considered that combine early robotic phases with later human arrival, then transition back to robot only operations. Robots can preposition, scout, sample or construct in advance of human teammates, transition to assistant roles when the crew are present, and then become caretakers when the crew returns to Earth. This paper will describe advances in robot safety and command interaction approaches developed to form effective human-robot teams, overcoming challenges of time delay and adapting as the team transitions from robot only to robots and crew. The work is predicated on the idea that when robots are alone in space, they are still part of a human-robot team acting as surrogates for people back on Earth or in other distant locations. Software, interaction modes and control methods will be described that can operate robots in all these conditions. A novel control mode for operating robots across time delay was developed using a graphical simulation on the human side of the communication, allowing a remote supervisor to drive and command a robot in simulation with no time delay, then monitor progress of the actual robot as data returns from the round trip to and from the robot. Since the robot must be responsible for safety out to at least the round trip time period, the authors developed a multi layer safety system able to detect and protect the robot and people in its workspace. This safety system is also running when humans are in direct contact with the robot, so it involves both internal fault detection as well as force sensing for unintended external contacts. The designs for the supervisory command mode and the redundant safety system will be described. Specific implementations were developed and test results will be reported. Experiments were conducted using terrestrial analogs for deep space missions, where time delays were artificially added to emulate the longer distances found in space.
References (23)
- Hokayem, P.F., Spong, M.W.. Bilateral teleoperation: An historical survey, AutomaticaVolume 42, Issue 12, December 2006, Pages 2035-2057.
- Hambuchen, K., W. Bluethmann, S.M. Goza, R. Ambrose, K. Rabe, M. Allan, "Supervising Remote Humanoids Across Intermediate Time Delay," Proceedings of the 2006 IEEE-RAS International Conference on Humanoid Robots, Genoa, Italy, December 4-6, 2006.
- Maimone, M., A. Johnson, Y. Cheng, R. Willson, and L. Matthies, Autonomous navigation results from the Mars Exploration Rover (MER) mission, Proceedings, International Symposium on Experimental Robotics (ISER), Singapore. June 2004.
- Imaida, T., Y. Yokokohji, T. Doi, M. Oda, T. Yoshikawa. 2004. Ground-Space Bilateral Teleoperation of ETS-VII Robot Arm by Direct Bilateral Coupling Under 7-s Time Delay Condition. IEEE Transactions on Robotics and Automation. Vol 20, No. 3, June 2004.
- Ferrell, W.R., T.B. Sheridan. Supervisory control of remote manipulation. IEEE Spectrum 4, no. 10, October 1967. pp 81-88.
- Sheridan, T.B. Human supervisory control of robot systems. In Proceedings of IEEE Conference on Robotics and Automation, Vol. 3, pp 808-812, April 1986.
- Sheridan, T. B. Telerobotics, automation, and human supervisory control. MIT Press, Cambridge, MA. 1992.
- Frohlich, J., R. Dillman. Interactive Robot Control System for Teleoperation. In Proceedings of 24 th International Symposium on Industrial Robotics, Tokyo, Japan 1993.
- Xiong, Y., S. Li, M. Xie. 2006. Predictive display and interaction of telerobots based on augmented reality. Robotica, Vol. 24, Issue 4, pp 447-453, July 2006.
- Cheng, C.C. Predictor displays: theory, development and application to towed submersibles. Sc.D. thesis, MIT, Cambridge, MA. June 1991.
- Cobzas, D., M. Jagersand, H. Zhang. A Panoramic Model for Remote Robot Environment Mapping and Predictive Display. International Journal of Robotics and Automation, Vol. 20, No. 1, pp 25-34.
- Schreckenghost, D., T. Ngo, R. Burridge, L. Wang, M. Izygon. Remote Task-Level Commanding of Centaur over Time Delay. Proceedings, Space Technologies and Applications International Forum, Albuquerque, NM, Feb. 2008.
- Torres, R. J., Allan, M., Hirsh, R., Wallick, M.N. RAPID: Collaboration Results from Three NASA Centers in Commanding/Monitoring Lunar Assets. In Proceedings of IEEE Aerospace Conference, Big Sky, Montana. March, 2009.
- Enigma, Software Package, Version 13.1, NASA/Johnson Space Center, Integrated Graphics Operations and Analysis Laboratory, Contact: Sharon.P.Goza@nasa.gov, (281) 483-8451 or
- David.L.Shores@nasa.gov, (281) 483-1586.
- Mehling, J.S., P. Strawser, L. Bridgwater, W.K. Verdeyen, R. Rovekamp. Centaur: NASA's Mobile Humanoid Designed for Field Work. In Proceedings of 2007 IEEE International Conference on Robotics and Automation, pp 2928-2933, Rome, Italy, April 2007.
- Harrison, D., Ambrose, R., Bluethmann, W., Junkin, L. 2008. Next Generation Rover for Lunar Exploration. Proceedings, IEEE Aerospace Conference, Big Sky, MT, Mar. 2008, pp. 1-14.
- Bluethmann, B., E. Herrera, A. Hulse, J. Figuered, L. Junkin, M. Markee, R. O. Ambrose. An Active Suspension System for Lunar Crew Mobility. In Proceedings of the IEEE Aerospace Conference, Big Sky, Montana. March, 2010.
- M.A. Diftler, Mehling, J.S, Abdallah, M.E., Radford, N.A., Bridgwater, L.B., Sanders, A.M., Askew, R.S., Linn, D.M., Yamokoski, J.D., Permenter, F.A., Hargrave, B.K., Platt, R., Savely, R.T., Ambrose, R.O. Robonaut 2 -The First Humanoid Robot in Space. In Proceedings of 2011 International Conference on Robotics and Automation. May, 2011.
- M. A. Diftler, Ahlstrom, T. D., Ambrose, R. O., Radford, N. A., Joyce, C.A., De La Pena, N., Parsons, A.H., Noblitt, A.L. Robonaut 2 -Initial Activities On- Board the ISS. In Proceedings of the IEEE Aerospace Conference, Big Sky, Montana. March, 2012.
- Rochlis, J., F. Delgado, J. Graham. Science crew operations and utility testbed. Industrial Robot: An International Journal, 33(6), pp 443-450, 2006.
- Wilcox, B. H., Litwin, T., Biesiadecki, J., Matthews, J., Heverly, M., Morrison, J., Townsend, J., Ahmad, N., Sirota, A., and Cooper, B. 2007. ATHLETE: A Cargo Handling and Manipulation Robot for the Moon. Journal of Field Robotics [online journal], Vol. 24, No. 5, URL: http://www3.interscience.wiley.com/journal/114211098 /issue, Wiley Periodicals, May 2007, pp. 421-434.
- Fong, T. W., Allan, M. B., Bouyssounouse, X., Bualat, M. G., Deans, M. C., Edwards, L., Flückiger, L., Keely, L., Lee, S. Y., Lees, D., To, V., and Utz, H. 2008. Robotic Site Survey at Haughton Crater, Proceedings of the 9th International Symposium on Artificial Intelligence, Robotics, and Automation in Space, Jet Propulsion Laboratory, Pasadena, CA, Feb. 2008.