Not Logged In

First Results With Dyna: An Integrated Architecture for Learning, Planning, and Reacting

Dyna is an AI architecture that integrates learning, planning, and reactive execution. Learning methods are used in Dyna both for compiling planning results and for updating a model of the effects of the agent's actions on the world. Planning is incremental and can use the probabilistic and ofttimes incorrect world models generated by learning processes. Execution is fully reactive in the sense that no planning intervenes between perception and action. Dyna relies on machine learning methods for learning from examples---these are among the basic building blocks making up the architecture---yet is not tied to any particular method. This paper briefly introduces Dyna and discusses its strengths and weaknesses with respect to other architectures.

Citation

R. Sutton. "First Results With Dyna: An Integrated Architecture for Learning, Planning, and Reacting". Neural Networks for Control, (ed: Miller T, Sutton R. S., Werbos P.), pp 179-189, January 1990.

Keywords: integrated, architecture, machine learning
Category: In Journal

BibTeX

@article{Sutton:90,
  author = {Richard S. Sutton},
  title = {First Results With Dyna: An Integrated Architecture for Learning,
    Planning, and Reacting},
  Editor = {Miller T, Sutton R. S., Werbos P.},
  Pages = {179-189},
  journal = {Neural Networks for Control},
  year = 1990,
}

Last Updated: May 31, 2007
Submitted by Staurt H. Johnson

University of Alberta Logo AICML Logo