Paper
Dota 2 with Large Scale Deep Reinforcement Learning
On April 13th, 2019, OpenAI Five became the first AI system to defeat the world champions at an esports game. The game of Dota 2 presents novel challenges for AI systems such as long time horizons, imperfect information, and complex, continuous state-action spaces, all challenges which will become increasingly central to more capable AI systems. OpenAI Five leveraged existing reinforcement learning techniques, scaled · Authors: OpenAI, :, Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung… · Published 2019-12-13 · arXiv:1912.06680
- Published
- 2019-12-13
- Authors
- 27
- arXiv
- 1912.06680
- Category
- cs.LG
Abstract
arXiv:1912.06680
OpenAI, :, Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung, Przemysław Dębiak, Christy Dennison, David Farhi, Quirin Fischer, Shariq Hashme, Chris Hesse…
On April 13th, 2019, OpenAI Five became the first AI system to defeat the world champions at an esports game. The game of Dota 2 presents novel challenges for AI systems such as long time horizons, imperfect information, and complex, continuous state-action spaces, all challenges which will become increasingly central to more capable AI systems. OpenAI Five leveraged existing reinforcement learning techniques, scaled to learn from batches of approximately 2 million frames every 2 seconds. We developed a distributed training system and tools for continual training which allowed us to train OpenAI Five for 10 months. By defeating the Dota 2 world champion (Team OG), OpenAI Five demonstrates that self-play reinforcement learning can achieve superhuman performance on a difficult task.
Related papers
40
-
Center for AI Safety
-
Center for AI Standards and Innovation
-
Co-affiliated with Carnegie Mellon University
-
UK Artificial Intelligence Security Institute
-
Shanghai Jiao Tong University
-
Agentrys
-
Brown University
-
California Institute of Technology
-
Carnegie Mellon University
-
Hewlett Packard Labs
-
New York University
-
Princeton University
-
Stanford University
-
University at Buffalo
-
University of California
-
University of Illinois Urbana-Champaign
-
University of Pennsylvania
-
University of Texas
-
MATS
-
New York University
-
University of Pennsylvania