Computer game bot Turing test: Difference between revisions

Revision as of 07:35, 27 June 2020

Revision as of 04:21, 27 July 2020

Line 23:

The first BotPrize Tournament was held in [[Perth]], [[Australia]], on 17 December 2008, as part of the 2008 IEEE Symposium on Computational Intelligence and Games.<ref name="BotPrize 2008"/><ref>http://www.csse.uwa.edu.au/cig08/</ref> Each competing team was given time to set up and adjust their bots to the modified game client, although no coding changes were allowed at that point. The tournament was run in rounds, each a 10-minute death match. Judges were the last to join the server and every judge observed every player and every bot exactly once, although the pairing of players and bots did change. When the tournament ended, no bot was rated as more human than any player.

In subsequent tournaments, run during 2009–2011,<ref>{{Cite web |url=http://botprize.org/2009.html |title=Archived copy |access-date=2013-02-03 |archive-url=https://web.archive.org/web/20130226091236/http://botprize.org/2009.html |archive-date=2013-02-26 |url-status=dead }}</ref><ref>{{Cite web |url=http://botprize.org/2010.html |title=Archived copy |access-date=2013-02-03 |archive-url=https://web.archive.org/web/20121230045906/http://botprize.org/2010.html |archive-date=2012-12-30 |url-status=dead }}</ref><ref>{{Cite web |url=http://botprize.org/2011.html |title=Archived copy |access-date=2013-02-03 |archive-url=https://web.archive.org/web/20121229083121/http://www.botprize.org/2011.html |archive-date=2012-12-29 |url-status=dead }}</ref> bots achieved scores that were increasingly human-like, but no contestant had won the BotPrize in any of these contests.

In 2012, the annual 2K BotPrize was held once again, and two teams programmed bots that achieved scores greater than those of human players.<ref name="BotPrize"/>

Line 35:

==Aftermath==

The outcome of a bot that appears more human-like than a human player is possibly overstated, since in the tournament in which the bots succeeded, the average 'humanness' rating of the human players was only 41.4%.<ref>{{Cite web |url=http://botprize.org/result.html |title=Archived copy |access-date=2013-02-04 |archive-url=https://web.archive.org/web/20130225095906/http://botprize.org/result.html |archive-date=2013-02-25 |url-status=dead }}</ref> This showcases some limits of this Turing Test, since the results demonstrate that human behaviour is more complicated and quantitative than was accounted for.<ref>{{Cite news|title=How did this game bot score higher than humans on a Turing Test?|date=October 1, 2012|last=Dvorsky|first=George|url=http://io9.com/5947796/how-can-a-game-bot-score-higher-than-humans-on-a-turing-test}}</ref> In light of this, the BotPrize competition organizers will increase the difficulty in upcoming years with new challenges, forcing competitors to improve their bots.<ref>{{Cite news|title=More human than human: AI game bots pass Turing Test|date=September 26, 2012|first=Darren|last=Quick|url=http://www.gizmag.com/turing-test-ut2004-botprize/24308/}}</ref>

It is also believed that methods and techniques developed for the Computer Game Bot Turing Test will be useful in fields other than video games, such as [[virtual training]] environments and in improving [[Human–robot interaction|robot-human interaction]].<ref>{{Cite news|title=Artificially Intelligent Game Bots Pass the Turing Test on Turing's Centenary|date=September 26, 2012|url=https://www.sciencedaily.com/releases/2012/09/120926133235.htm}}</ref>