Simultaneous adversarial multi-robot learning
- Michael Bowling, University of Alberta
- Manuela Veloso
Multi-robot learning faces all of the challenges of robot learning with all of the challenges of multiagent learning. There has been a great deal of recent research on multiagent reinforcement learning in stochastic games, which is the intuitive extension of MDPs to multiple agents. This recent work, although general, has only been applied to small games with at most hundreds of states. On the other hand robot tasks have continuous, and often complex, state and action spaces. Robot learning tasks demand approximation and generalization techniques, which have only received extensive attention in single-agent learning. In this paper we introduce GraWoLF, a general-purpose, scalable, multiagent learning algorithm. It combines gradient-based policy learning techniques with the WoLF (“Win or Learn Fast”) variable learning rate. We apply this algorithm to an adversarial multirobot task with simultaneous learning. We show results of learning both in simulation and on the real robots. These results demonstrate that GraWoLF can learn successful policies, overcoming the many challenges in multi-robot learning.
Citation
M. Bowling, M. Veloso. "Simultaneous adversarial multi-robot learning". International Joint Conference on Artificial Intelligence (IJCAI), Acapulco, Mexico, pp 699-704, August 2003.| Keywords: | machine learning |
| Category: | In Conference |
BibTeX
@incollection{Bowling+Veloso:IJCAI03,
author = {Michael Bowling and Manuela Veloso},
title = {Simultaneous adversarial multi-robot learning},
Pages = {699-704},
booktitle = {International Joint Conference on Artificial Intelligence
(IJCAI)},
year = 2003,
}Last Updated: April 24, 2007Submitted by William Thorne
