Computer game bot Turing test: Difference between revisions

Revision as of 11:56, 16 February 2023

Latest revision as of 03:02, 27 December 2024

(8 intermediate revisions by 7 users not shown)

Line 1:

{{short description|Variant of the Turing test}}

{{multiple|

{{Cleanup bare URLs|date=August 2022}}

{{primary sources|date=August 2017}}

}}

The '''computer game bot Turing test''' is a variant of the [[Turing test]], where a human judge viewing and interacting with a [[virtual world]] must distinguish between other humans and [[video game bot]]s, both interacting with the same virtual world. This variant was first proposed in 2008 by Associate Professor Philip Hingston<ref>{{Cite web|url=http://philiphingston.com/Homepage/Homepage.html|title=Philip Hingston &#124; Home}}</ref><ref name="turing">{{Cite journal|last=Hingston | publisherjournal=IEEE Transactions on Computational Intelligence and AI in Games|first=Philip | last=Hingston|title=A Turing Test for Game Bots | date=September 2009|doi=10.1109/TCIAIG.2009.2032534 |s2cid=13988179 |url=http://www.cs.ucf.edu/~gitars/cap6671-2010/Presentations/turing.pdf}}</ref> of [[Edith Cowan University]], and implemented through a tournament called the 2K BotPrize.<ref name="BotPrize">{{Cite web | url=http://botprize.org | title=The 2K Bot Prize : Home | archive-url=https://web.archive.org/web/20080913202526/http://botprize.org/ | archive-date=2008-09-13}}</ref>

[[File:UT^2 bot combats an opponent in the BotPrize.jpg|thumb|alt=The UT^2 bot combats an opponent in the BotPrize.|A bot combats a human opponent in the game ''[[Unreal Tournament 2004]]''.]]

Line 9 ⟶ 8:

The computer game bot Turing test was proposed to advance the fields of [[artificial intelligence]] (AI) and [[computational intelligence]] with respect to video games. It was considered that a poorly implemented bot implied a subpar game, so a bot that would be capable of passing this test, and therefore might be indistinguishable from a human player, would directly improve the quality of a game. It also served to debunk a flawed notion that "game AI is a solved problem."<ref name="turing"/>

Emphasis is placed on a game bot that interacts with other players in a [[Multiplayer video game|multiplayer]] environment. Unlike a bot that simply needs to make optimal human-like decisions to play or beat a game, this bot must make the same decisions while also convincing another in-game player of its human-likeness.{{cn|date=February 2023}}

==Implementation==

The computer game bot Turing test was designed to test a bot's ability to interact with a game environment in comparison with a human player,; simply 'winning' was insufficient. This evolved into a contest with a few important goals in mind:<ref name="turing"/>

* There are three participants: a human player, a computer-game bot, and a judge.

Line 21 ⟶ 20:

* Human participants were of a moderate skill range, with no participant either ignorant to the game or capable of playing at a professional level.

In 2008, the first 2K BotPrize tournament took place.<ref name="BotPrize 2008">{{Cite web |url=http://botprize.org/2008.html |title=Botprize : 2008 |access-date=2013-02-03 |archive-url=https://web.archive.org/web/20130225095014/http://botprize.org/2008.html |archive-date=2013-02-25 |url-status=dead }}</ref> The contest was held with the game ''[[Unreal Tournament 2004]]'' as the platform. Contestants created their bots in advance using the GameBots interface. GameBots had some modifications made so as to adhere to the above conditions, such as removing data about vantage points or weapon damage that unfairly informed the bots of relevant strengths/weaknessweaknesses that a human would otherwise need to learn.{{cn|date=November 2022}}

==Tournament==

The first BotPrize Tournament was held on 17 December 2008, as part of the 2008 IEEE Symposium on Computational Intelligence and Games in Australia.<ref name="BotPrize 2008"/><ref>{{Cite web|url=http://www.csse.uwa.edu.au/cig08/|title=2008 IEEE Symposium on Computational Intelligence and Games (CIG'08)}}</ref> Each competing team was given time to set up and adjust their bots to the modified game client, although no coding changes were allowed at that point. The tournament was run in rounds, each a 10-minute death match. Judges were the last to join the server and every judge observed every player and every bot exactly once, although the pairing of players and bots did change. When the tournament ended, no bot was rated as more human than any player.<ref>{{Cite web |last=Mer |first=Kold |title=New Round-Up 6 SB |url=https://www.academia.edu/30383516}}</ref>{{cn|date=November 2022}}

In subsequent tournaments, run during 2009–2011,<ref>{{Cite web |url=http://botprize.org/2009.html |title=Botprize : 2008 |access-date=2013-02-03 |archive-url=https://web.archive.org/web/20130226091236/http://botprize.org/2009.html |archive-date=2013-02-26 |url-status=dead }}</ref><ref>{{Cite web |url=http://botprize.org/2010.html |title=Botprize : 2010 |access-date=2013-02-03 |archive-url=https://web.archive.org/web/20121230045906/http://botprize.org/2010.html |archive-date=2012-12-30 |url-status=dead }}</ref><ref>{{Cite web |url=http://botprize.org/2011.html |title=Botprize : 2011 |access-date=2013-02-03 |archive-url=https://web.archive.org/web/20121229083121/http://www.botprize.org/2011.html |archive-date=2012-12-29 |url-status=dead }}</ref> bots achieved scores that were increasingly human-like, but no contestant had won the BotPrize in any of these contests.