Documentdetail
ID kaart
oai:arXiv.org:2410.18636
Onderwerp
Computer Science - Artificial Inte...Auteur
Meulemans, Alexander Kobayashi, Seijin von Oswald, Johannes Scherrer, Nino Elmoznino, Eric Richards, Blake Lajoie, Guillaume Arcas, Blaise Agüera y Sacramento, JoãoCategorie
Computer Science
Jaar
2024
vermelding datum
26-03-2025
Trefwoorden
self-interested learning-aware cooperation learningBeschrijving
Self-interested individuals often fail to cooperate, posing a fundamental challenge for multi-agent learning.
How can we achieve cooperation among self-interested, independent learning agents?
Promising recent work has shown that in certain tasks cooperation can be established between learning-aware agents who model the learning dynamics of each other.
Here, we present the first unbiased, higher-derivative-free policy gradient algorithm for learning-aware reinforcement learning, which takes into account that other agents are themselves learning through trial and error based on multiple noisy trials.
We then leverage efficient sequence models to condition behavior on long observation histories that contain traces of the learning dynamics of other agents.
Training long-context policies with our algorithm leads to cooperative behavior and high returns on standard social dilemmas, including a challenging environment where temporally-extended action coordination is required.
Finally, we derive from the iterated prisoner's dilemma a novel explanation for how and when cooperation arises among self-interested learning-aware agents.
Meulemans, Alexander,Kobayashi, Seijin,von Oswald, Johannes,Scherrer, Nino,Elmoznino, Eric,Richards, Blake,Lajoie, Guillaume,Arcas, Blaise Agüera y,Sacramento, João, 2024, Multi-agent cooperation through learning-aware policy gradients
Choice Between Partial Trajectories: Disentangling Goals from Beliefs
agents models aligned based bootstrapped learning reward function model return choice choices partial
Adverse and serious adverse events incidence of pharmacological interventions for managing chronic and episodic migraine in adults: a systematic review
aes medications bta incidence migraine drugs disorders
