Friendly artificial intelligence: Difference between revisions

Content deleted Content added
Citation bot (talk | contribs)
Alter: page. Add: pages, publisher. | Use this bot. Report bugs. | Suggested by BorgQueen | Category:Use mdy dates from October 2023 | #UCB_Category 640/839
mNo edit summary
Line 62:
 
Some philosophers claim that any truly "rational" agent, whether artificial or human, will naturally be benevolent; in this view, deliberate safeguards designed to produce a friendly AI could be unnecessary or even harmful.<ref>{{cite journal | last=Kornai | first=András | title=Bounding the impact of AGI | journal=Journal of Experimental & Theoretical Artificial Intelligence | publisher=Informa UK Limited | volume=26 | issue=3 | date=2014-05-15 | issn=0952-813X | doi=10.1080/0952813x.2014.895109 | pages=417–438 | s2cid=7067517 |quote=...the essence of AGIs is their reasoning facilities, and it is the very logic of their being that will compel them to behave in a moral fashion... The real nightmare scenario (is one where) humans find it advantageous to strongly couple themselves to AGIs, with no guarantees against self-deception.}}</ref> Other critics question whether it is possible for an artificial intelligence to be friendly. Adam Keiper and Ari N. Schulman, editors of the technology journal ''[[The New Atlantis (journal)|The New Atlantis]]'', say that it will be impossible to ever guarantee "friendly" behavior in AIs because problems of ethical complexity will not yield to software advances or increases in computing power. They write that the criteria upon which friendly AI theories are based work "only when one has not only great powers of prediction about the likelihood of myriad possible outcomes, but certainty and consensus on how one values the different outcomes.<ref>{{cite magazine |url=http://www.thenewatlantis.com/publications/the-problem-with-friendly-artificial-intelligence |first1=Adam |last1=Keiper |first2=Ari N. |last2=Schulman |title=The Problem with 'Friendly' Artificial Intelligence |journal=The New Atlantis |number=32 |date=Summer 2011 |page= |pages=80–89 |access-date=2012-01-16 |archive-date=2012-01-15 |archive-url=https://web.archive.org/web/20120115062805/http://www.thenewatlantis.com/publications/the-problem-with-friendly-artificial-intelligence |url-status=live }}</ref>
 
The inner workings of advanced AI systems may be complex and difficult to interpret, leading to concerns about transparency and accountability.<ref>{{Cite book |last=Norvig |first=Peter |title=Artificial Intelligence: A Modern Approach |last2=Russell |first2=Stuart |publisher=Pearson |year=2010 |isbn=978-0136042594 |edition=3rd}}</ref>
 
==See also==