Video games have increasingly been used as AI benchmarks. In contrast to classic board games, video games require more frequent decision making, often in real-time settings, and additionally define more complex state spaces. They may also have some combination of hidden information, stochasticity, complex interaction rules, and large branching factors. Modern video game-based AI benchmarks do not provide agents with processed representations of the environment. The agents have to act based on the raw pixels, i.