Computer game bot Turing test: Difference between revisions

Revision as of 22:23, 5 July 2016

Revision as of 11:05, 25 October 2016

Line 9:

==Implementation==

The Computer Game Bot Turing Test was designed to test a bot's ability to interact with a game environment in comparison with a human player, simply 'winning' was insufficient. This evolved into a contest with a few important goals in mind:<ref name="turing"/>

* There are three participants: a human player, a computer-game bot, and a judge.

* The bot needs to appear more human-like than the human player. Judge scores are not bipolar — both human and bot can be scored anywhere on a scale from 1 to 5 (1=not humanlike, 5=human).

Line 21 ⟶ 22:

The first BotPrize Tournament was held in [[Perth]], [[Australia]], on 17 December 2008, as part of the 2008 IEEE Symposium on Computational Intelligence and Games.<ref name="BotPrize 2008"/><ref>http://www.csse.uwa.edu.au/cig08/</ref> Each competing team was given time to set up and adjust their bots to the modified game client, although no coding changes were allowed at that point. The tournament was run in rounds, each a 10-minute death match. Judges were the last to join the server and every judge observed every player and every bot exactly once, although the pairing of players and bots did change. When the tournament ended, no bot was rated as more human than any player.

In subsequent tournaments, run during 2009-20112009–2011,<ref>http://botprize.org/2009.html</ref><ref>http://botprize.org/2010.html</ref><ref>http://botprize.org/2011.html</ref> bots achieved scores that were increasingly human-like, but no contestant had won the BotPrize in any of these contests.

In 2012, the annual 2K BotPrize was held once again, and two teams programmed bots that achieved scores greater than those of human players.<ref name="BotPrize"/>

==Successful bots==

To date, there have been two successfully programmed bots that passed the Computer Game Bot Turing Test.:

* UT^2, a team from the [[University of Texas at Austin]], emphasized a bot that adjusted its behaviour based on previously observed human behaviour and [[neuroevolution]]. The team has made their bot available,<ref>http://nn.cs.utexas.edu/?ut2</ref> although a copy of [[Unreal Tournament 2004]] is required. A short video of their bot is available on YouTube.<ref>http://www.youtube.com/watch?v=VwIrZ3X4b6c</ref>

* Mihai Polceanu, a doctoral student from [[Romania]], focused on creating a bot that would mimic opponent reactions, in a sense 'borrowing' the human-like nature of the opponent.

Line 37 ⟶ 39:

==Contrasts to the Turing Test==

The Computer Game Bot Turing test differs from the traditional or generic [[Turing test]] in a number of ways.:<ref name="turing"/>

* Unlike the traditional Turing Test, for example the [[Chatterbot]]-style contest held annually by the [[Loebner Prize]] competition, the humans who played against the Computer Game Bots are not actively trying to convince judges they are the human; rather, they want to win the game (i.e., by achieving the highest kill score).

* Judges are not restricted to awarding only one participant in a match as the 'human' and the other as the 'non-human.' This emphasizes more qualitiative rather than polarized findings.

Line 47 ⟶ 50:

==See also==

* [[Virtual reality]]

* [[Turing test]]

* [[Graphics Turing Test]]

* The [[Loebner Prize]], a contest that implements the 'traditional' Turing Test

* [[Rog-O-Matic]], a 1984 bot that plays the 1980s dungeon crawler [[Rogue (video game)|Rogue]]

==References==