Introspective Agents: Confidence Measures for General Value Functions
Full Text: Sherstan2016_Chapter_IntrospectiveAgentsConfidenceM.pdf
Agents of general intelligence deployed in real-world scenarios must adapt to ever-changing environmental conditions. While such adaptive agents may leverage engineered knowledge, they will require the capacity to construct and evaluate knowledge themselves from their own experience in a bottom-up, constructivist fashion. This position paper builds on the idea of encoding knowledge as temporally extended predictions through the use of general value functions. Prior work has focused on learning predictions about externally derived signals about a task or environment (e.g. battery level, joint position). Here we advocate that the agent should also predict internally generated signals regarding its own learning process—for example, an agent’s confidence in its learned predictions. Finally, we suggest how such information would be beneficial in creating an introspective agent that is able to learn to make good decisions in a complex, changing world.
Citation
C. Sherstan, M. Machado, A. White, P. Pilarski. "Introspective Agents: Confidence Measures for General Value Functions". Artificial General Intelligence (AGI), New York, USA, (ed: Bas R. Steunebrink, Pei Wang, Ben Goertzel), pp 258-261, July 2016.| Keywords: | General Value Function, Introspective Agent, Confidence Measure, Learning Prediction, Ever-changing Environmental Conditions |
| Category: | In Conference |
| Web Links: | DOI |
BibTeX
@incollection{Sherstan+al:AGI16,
author = {Craig Sherstan and Marlos C. Machado and Adam White and Patrick M.
Pilarski},
title = {Introspective Agents: Confidence Measures for General Value
Functions},
Editor = {Bas R. Steunebrink, Pei Wang, Ben Goertzel},
Pages = {258-261},
booktitle = {Artificial General Intelligence (AGI)},
year = 2016,
}Last Updated: December 02, 2020Submitted by Sabina P
