Distributed Lazy Q-learning for Cooperative Mobile Robots - Archive ouverte HAL Access content directly
Journal Articles International Journal of Advanced Robotic Systems Year : 2004

Distributed Lazy Q-learning for Cooperative Mobile Robots

(1)
1
Claude Touzet

Abstract

Compared to single robot learning, cooperative learning adds the challenge of a much larger search space (combined individual search spaces), awareness of other team members, and also the synthesis of the individual behaviors with respect to the task given to the group. Over the years, reinforcement learning has emerged as the main learning approach in autonomous robotics, and lazy learning has become the leading bias, allowing the reduction of the time required by an experiment to the time needed to test the learned behavior performance. These two approaches have been combined together in what is now called lazy Q-learning, a very efficient single robot learning paradigm. We propose a derivation of this learning to team of robots : the «pessimistic» algorithm able to compute for each team member a lower bound of the utility of executing an action in a given situation. We use the cooperative multi-robot observation of multiple moving targets (CMOMMT) application as an illustrative example, and study the efficiency of the Pessimistic Algorithm in its task of inducing learning of cooperation.
Fichier principal
Vignette du fichier
Distributed_lazy_Q.pdf (360.84 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive
Loading...

Dates and versions

hal-01337605 , version 1 (27-06-2016)

Identifiers

Cite

Claude Touzet. Distributed Lazy Q-learning for Cooperative Mobile Robots. International Journal of Advanced Robotic Systems, 2004, 1, pp.5-13. ⟨10.5772/5614⟩. ⟨hal-01337605⟩
64 View
94 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More