Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Experimental Results
Related Work
Conclusions
References
All Topics
Engineering
Control and Systems Engineering

Adaptive behavior navigation of a mobile robot

Profile image of Mariano José BallMariano José Ball

2002, IEEE Transactions on Systems, Man, and Cybernetics

https://doi.org/10.1109/3468.995537
visibility

…

description

49 pages

link

1 file

Abstract

Describes a neural network model for the reactive behavioral navigation of a mobile robot. From the information received through the sensors the robot can elicit one of several behaviors (e.g., stop, avoid, stroll, wall following), through a competitive neural network. The robot is able to develop a control strategy depending on sensor information and learning operation. Reinforcement learning improves the navigation of the robot by adapting the eligibility of the behaviors and determining the linear and angular robot velocities

Related papers

Development of behavior-based reactive navigation system for mobile robot
Mohd Ghazali Mohd Hamami

2013

Robotics technology has been evolved rapidly these last two decades especially in autonomous mobile robots development. One of the most important issues that related to autonomous mobile robots is it navigation systems. Deliberative navigation and reactive navigation are two types of navigation in mobile robot navigations. Reactive navigation in unknown and changing territories without prior knowledge to the environment is one of the most challenging problems in robotics, thus has been investigated by researchers for many years. Previous researchers gave particular attention to local minimum and multiple minimum problems which trap the robot into an infinite loop during its navigation. This could ruin the objective of good local navigation which a good local navigation should able the robot to navigate the unknown environment safety without having collision with the available obstacles. To solve the problems and achieve the above objective, a new behavior-based reactive navigation s...

View PDFchevron_right
Mobile Robot Navigation Using Reinforcement Learning Based on Neural Network with Short Term Memory
Artem Lenskiy, Andrey Gavrilov

Lecture Notes in Computer Science, 2011

In this paper we propose a novel bio-inspired model of a mobile robot navigation system. The novelty of our work consists in combining short term memory and online neural network learning using history of events stored in this memory. The neural network is trained with a modified error back propagation algorithm that utilizes reward and punishment principal while interacting with the environment.

View PDFchevron_right
Learning to Avoid Collisions: A Reinforcement Learning Paradigm for Mobile Robot Navigation
Joris van Dam, Ben Kröse

Artificial Intelligence in Real-Time Control 1992, 1993

The paper describes a self-learning control system for a mobile robot. Based on sensor information the control system has to provide a steering signal in such a way that collisions are avoided. Since in our case no`examples' are available, the system learns on the basis of an external reinforcement signal which is negative in case of a collision and zero otherwise. We describe the adaptive algorithm which is used for a discrete coding of the state space, and the adaptive algorithm for learning the correct mapping from the input (state) vector to the output (steering) signal.

View PDFchevron_right
Mobile Robots Adaptive Control Using Neural Networks
Monica Dragoicea

ArXiv, 2015

The paper proposes a feed-forward control strategy for mobile robot control that accounts for a non-linear model of the vehicle with interaction between inputs and outputs. It is possible to include specific model uncertainties in the dynamic model of the mobile robot in order to see how the control problem should be addressed taking into consideration the complete dynamic mobile robot model. By means of a neural network feed-forward controller a real non-linear mathematical model of the vehicle can be taken into consideration. The classical velocity control strategy can be extended using artificial neural networks in order to compensate for the modelling uncertainties. It is possible to develop an intelligent strategy for mobile robot control.

View PDFchevron_right
An artificial neural network structure able to obstacle avoidance behavior used in mobile robots
Luis Zarate

IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02, 2002

This article presents an artificial neural network (ANN) structure applied to control a mobile robot movement in dynamically changing environments (environments wirh mobile obstacles), The proposed structure is a backward neural one. So, ir is based on past andfihrre positions, and on a optimal pre-established parh. The past pasirions provide rhe ANN with memory of the mobile robot previous positions. On the other hand, rhe future positions provide rhe ANN with a goal, i.e., where the robot shouldgo. Basedon this information, the robot da nor lose ifs goal, even (f if has to avoid an obstacle. The results show the eflciency ofthe ANXin aform ofsimulations

View PDFchevron_right
Reactive Navigation of Autonomous Mobile Robot Using Neuro- Fuzzy System
Maulin Joshi

Neuro-fuzzy systems have been used for robot navigation applications because of their ability to exert human like expertise and to utilize acquired knowledge to develop autonomous navigation strategies. In this paper, neuro-fuzzy based system is proposed for reactive navigation of a mobile robot using behavior based control. The proposed algorithm uses discrete sampling based optimal training of neural network. With a view to ascertain the efficacy of proposed system; the proposed neuro-fuzzy system's performance is compared to that of neural and fuzzy based approaches. Simulation results along with detailed behavior analysis show effectiveness of our algorithm in all kind of obstacle environments.

View PDFchevron_right
Reactive navigation under a fuzzy rules-based scheme and reinforcement learning for mobile robots
Elsa Rubio

PeerJ Computer Science

Robot navigation allows mobile robots to navigate among obstacles without hitting them and reaching the specified goal point. In addition to preventing collisions, it is also essential for mobile robots to sense and maintain an appropriate battery power level at all times to avoid failures and non-fulfillment with their scheduled tasks. Therefore, selecting the proper time to recharge the batteries is crucial to address the navigation algorithm design for the robot’s prolonged autonomous operation. In this paper, a machine learning algorithm is used to ensure the extended robot autonomy based on a reinforcement learning method combined with a fuzzy inference system. The proposal enables a mobile robot to learn whether to continue through its path toward the destination or modify its course on the fly, if necessary, to proceed toward the battery charging station, based on its current state. The proposal performs a flexible behavior to choose an action that allows a robot to move from...

View PDFchevron_right
Neural Network Controller Design for a Mobile Robot Navigation; a Case Study
yurni oktarina

Proceeding of the Electrical Engineering Computer Science and Informatics, 2017

Mobile robot are widely applied in various aspect of human life. The main issue of this type of robot is how to navigate safely to reach the goal or finish the assigned task when applied autonomously in dynamic and uncertain environment. The application of artificial intelligence, namely neural network, can provide a "brain" for the robot to navigate safely in completing the assigned task. By applying neural network, the complexity of mobile robot control can be reduced by choosing the right model of the system, either from mathematical modeling or directly taken from the input of sensory data information. In this study, we compare the presented methods of previous researches that applies neural network to mobile robot navigation. The comparison is started by considering the right mathematical model for the robot, getting the Jacobian matrix for online training, and giving the achieved input model to the designed neural network layers in order to get the estimated position of the robot. From this literature study, it is concluded that the consideration of both kinematics and dynamics modeling of the robot will result in better performance since the exact parameters of the system are known. Index Terms-Dynamics modeling; kinematics modeling; mobile robot navigation; neural network controller.

View PDFchevron_right
Adaptive Neural Control for Mobile Robots Autonomous Navigation
Monica Dragoicea

ArXiv, 2015

This paper presents a combined strategy for tracking a non-holonomic mobile robot which works under certain operating conditions for system parameters and disturbances. The strategy includes kinematic steering and velocity dynamics learning of mobile robot system simultaneously. In the learning controller (neural network based controller) the velocity dynamics learning control takes part in tracking of the reference velocity trajectory by learning the inverse function of robot dynamics while the reference velocity control input plays a role in stabilizing the kinematic steering system to the desired reference model of kinematic system even without using the assumption of perfect velocity tracking.

View PDFchevron_right
Intelligent adaptive mobile robot navigation
Samia Nefti, Karim Djouani

Journal of Intelligent & …, 2001

This paper deals with the application of a neuro-fuzzy inference system to a mobile robot navigation in an unknown, or partially unknown environment. The final aim of the robot is to reach some pre-defined goal. For this purpose, a sort of a co-operation between three main sub-modules is performed. These sub-modules consist in three elementary robot tasks: following a wall, avoiding an obstacle and running towards the goal. Each module acts as a Sugeno-Takagi fuzzy controller where the inputs are the different sensor information and the output corresponds to the orientation of the robot. The rule-base is generated by the controller after some learning process based on a neural architecture close to that used by Wang and Menger. This leads to adaptive neuro-fuzzy inference systems (ANFIS) (one for each module). The adaptive navigation system (ANFIS), based on integrated reactive-cognitive parts, learns and generates the required knowledge for achieving the desired task. However, the generated rule-base suffers from redundancy and abundance of data, most of which are less useful. This makes the assignment of a linguistic label to the associated variable difficult and sometimes counter-intuitive. Consequently, a simplification phase allowing elimination of redundancy is required. For this purpose, an algorithm based on the class of fuzzy c-means algorithm introduced by Bezdek and we have developed an inclusion structure. Experimental results confirm the meaningfulness of the elaborated methodology when dealing with navigation of a mobile robot in unknown, or partially unknown environment.

View PDFchevron_right

References (23)

  1. Richard S. Sutton and Andrew G. Barto, Toward a modern theory of adaptive networks: Expectation and prediction," Psychological R eview, v ol. 88, pp. 135 170, 1981.
  2. E. Thorndike, Animal Intelligence, Hafner, Darien, C.T., 1911.
  3. P. Maes, Robotics and autonomous systems," Situated A gents Can Have Goals, v ol. 6, pp. 49 70, 1990.
  4. S. Mahadevan and J. Connell, Automatic programing of behavior-based robots using reinforcement learning," in Proceedings of the Ninth National Conference o n A rti cial Intelligence AAAI'91, pp. 768 773. Ananheim, CA, 1991.
  5. M. Asada, S. Noda, S. Tawaratsumida, and K. Hosoda, Vision-based reinforcement learning for purposive behavior acquisition," in Proceedings of the IEEE International Conference o n R obotics and Automation, pp. 146 153. 1995.
  6. T Kohonen, The self-organizing map," in Proc. of the IEEE, 78, 9. 1990, pp. 1464 1480, Piscataway, NJ: IEEE Service Center.
  7. S. Grossberg, Contour enhancement, short-term memory, and constancies in reverberating neural networks," Studies in Applied Mathematics, v ol. 52, pp. 217 257, 1973.
  8. P. Gaudiano, E. Zalama, Carolina Chang, and J. L opez Coronado, A model of operant conditioning for adaptive obstacle avoidance," in From Animals to Animats 4: Proceedings of the Fourth International Con- ference on Simulation of Adaptive Behavior, The MIT Press Bradford Books, Ed., Cape Cod, Masachussets, USA, 1996.
  9. D. Bullock and S. Grossberg, The VITE model: A neural command circuit for generating arm and articulator trajectories," Dynamic Patterns In Complex Systems, pp. 305 326, 1988.
  10. A. Baloch and A. Waxman, Visual learning, adaptive expectations, and behavioral conditioning of the mobile robot MAVIN," Neural Networks, v ol. 4, pp. 271 302, 1991.
  11. E. Zalama, P. Gaudiano, and J. L opez-Coronado, A real-time, unsupervised neural network for the low level control of a mobile robot in a nonstationary environment," Neural Networks, v ol. 8, pp. 103 123, 1995.
  12. A. Bl uhlmeier, H.R. Everett, and L. Feng, Operant conditioning in robotics," in Neural Systems for Robotics, O. Omidvar and P. V and der Smagt, Eds., pp. 195 225. 1997.
  13. P.F.M.J. Verschure and A.C.C. Coolen, Adaptive elds: Distributed representations of clasically conditioned associations," Network, v ol. 2, pp. 189 217, 1991.
  14. P.F.M.J. Verschure and R. Pfeifer, Categorization, representations, and the dynamics of system-environment interaction," in Proceedings of the Second International Conference on Simulation of Adaptive Behavior, J.A. Meyer, H. Roitblat, and S. Wilson, Eds., pp. 210 217. Cambridge, MA: MIT Press, 1992.
  15. R. Pfeifer and P. V erschure, Distributed adaptive control: a paradigm for designing autonomous agents," in Toward a p r actice of autonomous systems, F.J. Varela and P. Bourgine, Eds., pp. 21 30. 1992.
  16. U. Nehmozow, Flexible control of mobile robot through autonomous competence adquisition," Mesurement and Control, v ol. 282, 1995.
  17. DRAFT April 25, 2001
  18. A. Kurz, Constructing maps for mobile robot navigation based on ultrasonic range data," IEEE Transaction on System Man and Cybernetics, v ol. 26, no. 2, pp. 433 441, 1996.
  19. H.R. Beom and H.S. Cho, A sensor based navigation for a mobile robot using fuzzy logic and reinforcing learning," IEEE Transaction on System Man and Cybernetics, v ol. 25, no. 3, pp. 464 477, 1995.
  20. D. Gachet, M. Moreno, and J. Pimentel, Learning emergent tasks for an autonomous mobile robot," in Pro- ceedings of the International Conference on Intelligent Robots and Systems IROS'94, pp. 290 297. Munich, Germany, 1994.
  21. J. Millan, Learning e cient reactive behavioral sequences from basic re exes in a goal-directed autonomous robot," in Proceedings of the Third Conference on Simulation of Adaptive Behavior, pp. 266 274. 1994.
  22. R. Sutton, Learning to predict by the methods of temporal di erences," Machine Learning, v ol. 3, pp. 9 44, 1988.
  23. A. Fagg, D. Lotspeich, and G. Bekey, A reinforcement-learning approach to reactive control policy design for autonomous robots," in Proceedings of the IEEE International Conference o n R obotics and Automation, pp. 39 44. 1994. April 25, 2001 DRAFT

Related papers

Neural Network for the Behavioral Navigation of a Mobile Robot
Eduardo Zalama

IFAC Proceedings Volumes, 1998

This paper describes a neural network model for the reactive navigation of a mobile robot. The system defines a series of reactive behaviors: stop, avoid , stroll , wall following, etc. depending on the information obtained from a set of proximity sensors distributed in the periphery of the robot. Reinforcing learning permits the adaptative navigation of the robot.

View PDFchevron_right
Neural Network Based Reactive Navigation for Mobile Robot in Dynamic Environment
Stanislav Vĕchet

Solid State Phenomena, 2013

When mobile robots are used among people, the best accepted motion related behavior is a human-like motion of the robot. Such behavior is difficult to obtain with commonly used finite state machine based planners, but can easily be evoked when human controls the robot. The paper presents the way of transforming such knowledge from human controller to reactive planner in the robot navigation module. Reactive planner is based on machine learning, neural networks in particular. The planner consists of two separate neural networks, one serving as predictor of dynamic obstacles behavior, second one serving as the reactive planner itself, producing desirable actions of the robot both in terms of velocity and direction. Planner was verified on real robot producing human-like behavior when used in real environment.

View PDFchevron_right
Design and Implementation of Neural Network Based Controller for Mobile Robot Navigation in Unknown Environments
M Usman Asad

International Journal of Computer and Electrical Engineering, 2014

In this paper, design of an intelligent autonomous vehicle is presented that can navigate in noisy and unknown environments without hitting the obstacles in its way. The vehicle is made intelligent with the help of two multilayer feed forward neural network controllers namely 'Hurdle Avoidance Controller' and 'Goal Reaching Controller' with back error propagation as training algorithm. Hurdle avoidance controller ensures collision free motion of mobile robot while goal reaching controller helps the mobile robot in reaching the destination. Both these controllers are trained offline with the data obtained during experimental run of the robot and implemented with low cost AT89C52 microcontrollers. The computational burden on microcontrollers is reduced by using piecewise linearly approximated version of tangent-sigmoid activation function of neurons. The vehicle with the proposed controllers is tested in outdoor complex environments and is found to reach the set targets successfully. I. INTRODUCTION Navigation is the ability of a mobile robot to reach the set targets by avoiding obstacles in its way. Thus essential behaviors for robot navigation are obstacle avoidance and goal reaching [1], [2]. Conventional control techniques can be used to build controllers for these behaviors; however, the environment uncertainty imposes a serious problem in developing the complete mathematical model of the system resulting in limited usability of these controllers. Thus some kind of intelligent controllers are required that can cope with the changing environment conditions. Amongst the various artificial intelligence techniques available in literature, neural networks offer promising solution to robot navigation problem because of their ability to learn complex non linear relationships between input sensor values and output control variables. This ability of neural networks has attracted many researchers across the globe in developing neural network based controllers for reactive navigation of mobile robots in indoor as well as outdoor environments. In [3], a collision free path between source and destination is constructed based on

View PDFchevron_right
An application of neural network to reactive control of a mobile robot
Krzysztof Jaskot

2002

View PDFchevron_right
Neuronal Architecture for Reactive and Adaptive Navigation of a Mobile Robot
Fulgencio Marín

Computational and …, 2007

A neural architecture that makes possible the integration of a kinematic adaptive neuro-controller for trajectory tracking and an obstacle avoidance adaptive neuro-controller is proposed for nonholonomic mobile robots. The kinematic adaptive neuro-controller is a real-time, unsupervised neural network that learns to control a nonholonomic mobile robot in a nonstationary environment, which is termed Self-Organization Direction Mapping Network (SODMN), and combines associative learning and Vector Associative Map (VAM) learning to generate transformations between spatial and velocity coordinates. The transformations are learned in an unsupervised training phase, during which the robot moves as a result of randomly selected wheel velocities. The robot learns the relationship between these velocities and the resulting incremental movements. The obstacle avoidance adaptive neuro-controller is a neural network that learns to control avoidance behaviors in a mobile robot based on a form of animal learning known as operant conditioning. Learning, which requires no supervision, takes place as the robot moves around an cluttered environment with obstacles. The neural network requires no knowledge of the geometry of the robot or of the quality, number, or configuration of the robot's sensors. The efficacy of the proposed neural architecture is tested experimentally by a differentially driven mobile robot.

View PDFchevron_right

Related topics

  • Engineering
  • Psychology
  • Reinforcement Learning
  • Adaptive behavior
  • Sensor Fusion
  • Mobile Robot
  • Obstacle Avoidance
  • Robot Navigation

    • Cited by

    Sensorimotor self-learning model based on operant conditioning for two-wheeled robot
    Xiaogang Ruan

    Journal of Shanghai Jiaotong University (Science), 2017

    Traditional control methods of two-wheeled robot are usually model-based and require the robot's precise mathematic model which is hard to get. A sensorimotor self-learning model named SMM TWR is presented in this paper to handle these problems. The model consists of seven elements: the discrete learning time set, the sensory state set, the motion set, the sensorimotor mapping, the state orientation unit, the learning mechanism and the model's entropy. The learning mechanism for SMM TWR is designed based on the theory of operant conditioning (OC), and it adjusts the sensorimotor mapping at every learning step. This helps the robot to choose motions. The leaning direction of the mechanism is decided by the state orientation unit. Simulation results show that with the sensorimotor model designed, the robot is endowed the abilities of self-learning and self-organizing, and it can learn the skills to keep itself balance through interacting with the environment.

    View PDFchevron_right
    Optimal Robot Path Planning with Cellular Neural Network
    Yongmin Zhong

    International Journal of Intelligent Mechatronics and Robotics, 2011

    This paper presents a new methodology based on neural dynamics for optimal robot path planning by drawing an analogy between cellular neural network (CNN) and path planning of mobile robots. The target activity is treated as an energy source injected into the neural system and is propagated through the local connectivity of cells in the state space by neural dynamics. By formulating the local connectivity of cells as the local interaction of harmonic functions, an improved CNN model is established to propagate the target activity within the state space in the manner of physical heat conduction, which guarantees that the target and obstacles remain at the peak and the bottom of the activity landscape of the neural network. The proposed methodology cannot only generate real-time, smooth, optimal, and collision-free paths without any prior knowledge of the dynamic environment, but it can also easily respond to the real-time changes in dynamic environments. Further, the proposed methodo...

    View PDFchevron_right
    580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved