Reliability of Ranking Using Champion Challenge Format in Artificial Intelligence Tournament

Abstract

Working together with a Gothenburg-based company, Software Skills [8], a prototype of a multiplayer AI tournament format called champion challenge using multiplayer Elo rating [12, 6] was made. This experiment is to study the reliability of the prototype as well as comparing it to Software Skills’s old tournament format. Even though there was not enough evidence proving the reliability of the new tournament format, there are some interesting results in comparison to the old system.