Multi-agent system: Difference between revisions

Content deleted Content added
No edit summary
m Reverted edit by 88.245.196.48 (talk) to last version by MrOllie
 
(55 intermediate revisions by 30 users not shown)
Line 1:
{{Short description|Built of multiple interacting agents}}
{{Use mdy dates|date=October 2023}}
{{Multi-agent system}}
[[Image:IntelligentAgent-SimpleReflex.png|thumb|right|Simple reflex agent]]
[[Image:IntelligentAgent-Learning.pngsvg|thumb|right|Learning agent]]
A '''multi-agent system''' ('''MAS''' or "self-organized system") is a computerized system composed of multiple interacting [[intelligent agent]]s.<ref name="tro">HuYoav Shoham, JKevin Leyton-Brown.; Bhowmick''Multiagent Systems: Algorithmic, PGame-Theoretic, and Logical Foundations.;'' Cambridge University JangPress, I2009. http://www.masfoundations.org/</ref><ref name="uav">H. Pan; M. Arvin,Zahmatkesh; F. Rekabi-Bana; Lanzon,F. AArvin; J., Hu "[https://ieeexplore.ieee.org/stampdocument/stamp.jsp?tp=&arnumber=942397910965835 AT-STAR: DecentralizedTime-Optimal ClusterSwarm FormationTrajectory Containment FrameworkPlanning for MultirobotQuadrotor SystemsUnmanned Aerial Vehicles]" IEEE Transactions on RoboticsIntelligent Transportation Systems, 20212025.</ref> Multi-agent systems can solve problems that are difficult or impossible for an individual agent or a [[monolithic system]] to solve.<ref name="tcas">Hu, J.; Turgut, A.; Lennox, B.; Arvin, F., "[https://ieeexplore.ieee.org/abstract/document/9409965 Robust Formation Coordination of Robot Swarms with Nonlinear Dynamics and Unknown Disturbances: Design and Experiments]" IEEE Transactions on Circuits and Systems II: Express Briefs, 2021.</ref> Intelligence may include [[Scientific method|method]]ic, [[Function (computer science)|functional]], [[Algorithm|procedural]] approaches, [[algorithm]]ic [[search algorithm|search]] or [[reinforcement learning]].<ref name="tvt2">Hu,Stefano JV.; BhowmickAlbrecht, P.;Filippos LanzonChristianos, ALukas Schäfer. ''Multi-Agent Reinforcement Learning: Foundations and Modern Approaches.'' MIT Press, "[2024. https://ieeexplorewww.ieeemarl-book.orgcom/document</9468402ref> GroupWith Coordinatedadvancements Controlin of[[large Networkedlanguage Mobilemodel]]s Robots(LLMs), withLLM-based Applicationsmulti-agent tosystems Objecthave Transportation]"emerged IEEEas Transactionsa onnew Vehiculararea Technologyof research, 2021enabling more sophisticated interactions and coordination among agents.</ref><ref name=li2023>{{cite journal |hdl last =1874/20827Li | first =Guohao | title =Multi-agentCamel: reinforcementCommunicative learningagents for traffic"mind" lightexploration of large language model society control| journal =Machine Learning:Advances Proceedingsin ofNeural theInformation SeventeenthProcessing InternationalSystems Conference| volume (Icml'2000)|year=2000 36 | pages =1151–1158 51991–52008 |last1 year =Wiering 2023 |first1 url =M https://proceedings.neurips.cc/paper_files/paper/2023/file/a3621ee907def47c1b952ade25c67698-Paper-Conference.pdf A | arxiv = 2303.17760 | s2cid = 257900712}}</ref>
 
Despite considerable overlap, a multi-agent system is not always the same as an [[agent-based model]] (ABM). The goal of an ABM is to search for explanatory insight into the collective behavior of agents (which don'tdo not necessarily need to be "intelligent") obeying simple rules, typically in natural systems, rather than in solving specific practical or engineering problems. The terminology of ABM tends to be used more often in the science, and MAS in engineering and technology.<ref name="Niazi-Hussain">{{cite journal |first1=Muaz |last1=Niazi |first2=Amir |last2=Hussain |year=2011 |title=Agent-based Computing from Multi-agent Systems to Agent-Based Models: A Visual Survey |journal=Scientometrics |volume=89 |issue=2 |pages=479–499 |doi=10.1007/s11192-011-0468-9 |url=https://www.researchgate.net/publication/220365334 |format=PDF|arxiv=1708.05872 |hdl=1893/3378 |s2cid=17934527 }}</ref> Applications where multi-agent systems research may deliver an appropriate approach include online trading,<ref>{{cite journal |first1=Alex |last1=Rogers |first2=E. |last2=David |first3=J. |last3=Schiff |first4=N.R. |last4=Jennings |url=http://eprints.ecs.soton.ac.uk/12716/ |title=The Effects of Proxy Bidding and Minimum Bid Increments within eBay Auctions |journal=ACM Transactions on the Web |volume=1 |issue=2 |pages=9–es |year=2007 |doi=10.1145/1255438.1255441 |citeseerx=10.1.1.65.4539 |s2cid=207163424 |access-date=2008-03-18 |archive-date=2010-04-02 |archive-url=https://web.archive.org/web/20100402101304/http://eprints.ecs.soton.ac.uk/12716/ |url-status=dead }}</ref> disaster response,<ref>{{cite journalweb |first1=Nathan |last1=Schurr |first2=Janusz |last2=Marecki |first3=Milind |last3=Tambe |first4=Paul |last4=Scerri | first5=Nikhil |last5=Kasinadhuni |first6=J.P. |last6=Lewis |url=httphttps://teamcoreaaai.usc.eduorg/papers/2005/SS105SchurrN.pdf0002-ss05-01-002-the-future-of-disaster-response-humans-working-with-multiagent-teams-using-defacto |title=The Future of Disaster Response: Humans Working with Multiagent Teams using DEFACTO |year=2005 |access-date=8 January 2024 |archive-date=2013-06-03 |archive-url=https://web.archive.org/web/20130603165342/http://teamcore.usc.edu/papers/2005/SS105SchurrN.pdf| url-status=live}}</ref><ref>{{cite journalbook |last1=Genc|first1=Zulkuf |title=Intelligent Systems for Crisis Management |chapter=Agent-Based Information Infrastructure for Disaster Management |chapter-url=http://www.gdmc.nl/gi4dmdocs/Gi4DM_2012_Genc.pdf |title=Agent-based information infrastructure for disaster management |journal=Intelligent Systems for Crisis Management |pages=349–355 |date=2013|display-authors=etal|doi=10.1007/978-3-642-33218-0_26 |isbn=978-3-642-33217-3 |series=Lecture Notes in Geoinformation and Cartography }}</ref> target surveillance <ref>{{cite journal |last1=Hu |first1=Junyan |last2=Bhowmick |first2=Parijat|last3=Lanzon |first3=Alexander |title=Distributed Adaptive Time-Varying Group Formation Tracking for Multiagent Systems With Multiple Leaders on Directed Graphs |journal=IEEE Transactions on Control of Network Systems |date=2020 |volume=7 |pages=140–150 |doi=10.1109/TCNS.2019.2913619 |s2cid=149609966 |doi-access=free }}</ref> and social structure modelling.<ref>{{cite journal |first1=Ron |last1=Sun|author-link1=Ron Sun |first2=Isaac |last2=Naveh |url=http://jasss.soc.surrey.ac.uk/7/3/5.html |title=Simulating Organizational Decision-Making Using a Cognitively Realistic Agent Model |journal=Journal of Artificial Societies and Social Simulation|date=30 June 2004}}</ref>
 
== Concept ==
Line 78 ⟶ 79:
</ref>
* dependability and fault-tolerance
* robotics,<ref>{{citation|last1=Ahmed |first1=S. |pages=459 |last2=Karsiti |first2=M.N. |url=http://eprints.utp.edu.my/320/|title=2007 IEEE International Conference on Electro/Information Technology |year=2007|doi=10.1109/EIT.2007.4374547|contribution=A testbed for control schemes using multi agent nonholonomic robots |isbn=978-1-4244-0940-2 |s2cid=2734931 |url-access=subscription }}</ref> multi-robot systems (MRS), robotic clusters
* multi-agent systems also present possible applications in microrobotics,<ref>{{cite journal |last1=Yang |first1=Lidong |last2=Li |first2=Zhang |year=2021 |title=Motion control in magnetic microrobotics: From individual and multiple robots to swarms |journal=Annual Review of Control, Robotics, and Autonomous Systems |volume=4 |pages=509–534 |doi=10.1146/annurev-control-032720-104318|s2cid=228892228 }}</ref> where the physical interaction between the agents are exploited to perform complex tasks such as manipulation and assembly of passive components.
* language model-based multi-agent systems<ref name=li2023></ref>
 
== Frameworks ==
 
Frameworks have emerged that implement common standards (such as the [[Foundation for Intelligent Physical Agents|FIPA]] and [[Object Management Group|OMG]] MASIF standards).<ref>{{Cite web|url=https://www.omg.org/cgi-bin/doc?orbos/97-10-05|title=OMG Document – orbos/97-10-05 (Update of Revised MAF Submission)|website=www.omg.org|access-date=2019-02-19}}</ref> standards). These frameworks e.g. [[Java Agent Development Framework|JADE]], save time and aid in the standardization of MAS development.<ref name=DF_1>{{cite journalweb |first1=Salman |last1=Ahmed |first2=Mohd N. |last2=Karsiti |first3=Herman |last3=Agustiawan |title=A development framework for collaborative robots using feedback control| url=https://www.researchgate.net/publication/238431442| year=2007|citeseerx access-date=10.1.1.98.8798 January 2024}}</ref>
 
Currently though, no standard is actively maintained from FIPA or OMG. Efforts for further development of software agents in industrial context are carried out in [[Institute of Electrical and Electronics Engineers|IEEE]] IES technical committee on Industrial Agents.<ref>{{Cite web|url=https://tcia.ieee-ies.org/|title=IEEE IES Technical Committee on Industrial Agents (TC-IA)|website=tcia.ieee-ies.org|access-date=2019-02-19}}</ref>
 
With advancements in [[large language model]]s (LLMs) such as [[ChatGPT]], LLM-based multi-agent frameworks, such as [[Apache Camel|CAMEL]],<ref name="camel2023">{{Cite web |title=CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. |url=https://github.com/camel-ai/camel/ |website=[[GitHub]]}}</ref><ref name="li2023" /> have emerged as a new paradigm for developing multi-agent applications.
 
== Applications ==<!-- Although MAS is still strictly a research topic, many graphic computer games today are developed using MAS algorithms and MAS frameworks. -->
MAS have not only been applied in academic research, but also in industry.<ref>{{Cite book|title=Industrial agents : emerging applications of software agents in industry|others=Leitão, Paulo,, Karnouskos, Stamatis|isbn=978-0128003411|___location=Amsterdam, Netherlands|oclc=905853947|last1 = Leitão|first1 = Paulo|last2 = Karnouskos|first2 = Stamatis|date = 2015-03-26}}</ref> MAS are applied in the real world to graphical applications such as computer games. Agent systems have been used in films.<ref>{{cite web |publisher=[[Massive (software)|MASSIVE]] |url=http://www.massivesoftware.com/film.html |title=Film showcase|access-date=28 April 2012}}</ref> It is widely advocated for use in networking and mobile technologies, to achieve automatic and dynamic load balancing, high scalability and self-healing networks. They are being used for coordinated defence systems.
 
Other applications<ref>{{Cite journal|last1=Leitao|first1=Paulo|last2=Karnouskos|first2=Stamatis|last3=Ribeiro|first3=Luis|last4=Lee|first4=Jay|last5=Strasser|first5=Thomas|last6=Colombo|first6=Armando W.|date=2016|title=Smart Agents in Industrial Cyber–Physical Systems|journal=Proceedings of the IEEE|volume=104|issue=5|pages=1086–1101|doi=10.1109/JPROC.2016.2521931|s2cid=579475|issn=0018-9219|url=http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-128744|hdl=10198/15438|hdl-access=free}}</ref> include [[transportation]],<ref name="surtrac2012b">Xiao-Feng Xie, S. Smith, G. Barlow. [http://www.wiomax.com/team/xie/paper/ICAPS12.pdf Schedule-driven coordination for real-time traffic network control]. International Conference on Automated Planning and Scheduling (ICAPS), São Paulo, Brazil, 2012: 323–331.</ref> logistics,<ref name="compare">{{Cite journal | last1 = Máhr | first1 = T. S. | last2 = Srour | first2 = J. | last3 = De Weerdt | first3 = M. | last4 = Zuidwijk | first4 = R. | title = Can agents measure up? A comparative study of an agent-based and on-line optimization approach for a drayage problem with uncertainty | doi = 10.1016/j.trc.2009.04.018 | journal = Transportation Research Part C: Emerging Technologies | volume = 18 | pages = 99–119 | year = 2010 | issue = 1 | bibcode = 2010TRPC...18...99M | citeseerx = 10.1.1.153.770 }}</ref> graphics, manufacturing, [[power system]],<ref name="GEP_1">{{cite book| chapter=Generation Expansion Planning Considering Investment Dynamic of Market Participants Using Multi-agent System| -author1=Kazemi, IEEEHamidreza| Conferenceauthor2=Liasi, PublicationSahand| 2019">{{cite journalauthor3=Sheikh-El-Eslami, Mohammadkazem| title=Generation2018 ExpansionSmart PlanningGrid ConsideringConference Investment(SGC)| Dynamic of Market Participants Using Multichapter-agenturl=https://www.researchgate.net/publication/334765661| Systemdate=November - IEEE Conference Publication2018| pages=1–6| access-date=2019-12-178 January 2024| doi=10.1109/SGC.2018.8777904 | s2cidisbn=199058301 978-1-7281-1138-4}}</ref> [[smartgrids]],<ref name="Distributed Multi-Agent System-Based Load Frequency Control for Multi-Area Power System in Smart Grid - IEEE Journals & Magazine 2019"DMA_1>{{cite journal | title=Distributed Multi -Agent System- Based Load Frequency Control for Multi- Area Power System in Smart Grid| -author1=Singh, Vijay| author2=Samuel, Paulson| url=https://www.researchgate.net/publication/312304154| journal=IEEE JournalsTransactions &on MagazineIndustrial Electronics| volume=64| issue=6| pages=5151–5160| date=20196 June 2017| access-12-17date=8 January 2024| doi=10.1109/TIE.2017.2668983 | s2cid=31816181 }}</ref> and the [[Geographic information system|GIS]].
 
Also, [[Distributed artificial intelligence#Agents and Multi-agent systems|Multi-agent Systems Artificial Intelligence]] (MAAI) are used for simulating societies, the purpose thereof being helpful in the fields of climate, energy, [[epidemiology]], [[conflict management]], child abuse, ....<ref name="newscientist.com">{{Cite web|url=https://www.newscientist.com/article/mg24332500-800-ai-can-predict-your-future-behaviour-with-powerful-new-simulations/|title=AI can predict your future behaviour with powerful new simulations|website=New Scientist}}</ref>
 
Some organisations working on using multi-agent system models include Center for Modelling Social Systems,<ref>{{Cite web |title=Center for Modeling Social Systems - Norce |url=https://www.norceresearch.no/en/research-group/cmss |access-date=2025-04-13 |website=NORCE Norwegian Research Centre |language=en}}</ref> Centre for Research in Social Simulation,<ref>{{Cite web |title=Centre for Research in Social Simulation – A multidisciplinary centre bringing together the social sciences and agent-based modelling to promote and support the use of social simulation in research in the human sciences. |url=https://cress.soc.surrey.ac.uk/cresswp/ |access-date=2025-04-13 |language=en-GB}}</ref> Centre for Policy Modelling, Society for Modelling and Simulation International.<ref name="newscientist.com" />
 
Vehicular traffic with controlled autonomous vehicles can be modelling as a multi-agent system involving crowd dynamics.<ref name="Gong">{{cite journal |last1=Gong |first1=Xiaoqian |last2=Herty |first2=Michael |last3=Piccoli |first3=Benedetto |last4=Visconti |first4=Giuseppe |title=Crowd Dynamics: Modeling and Control of Multiagent Systems |journal=Annual Review of Control, Robotics, and Autonomous Systems |date=3 May 2023 |volume=6 |issue=1 |pages=261–282 |doi=10.1146/annurev-control-060822-123629 |language=en |issn=2573-5144|doi-access=free }}</ref>
 
Also, [[Distributed artificial intelligence#Agents and Multi-agent systems|Multi-agent Systems Artificial Intelligence]] (MAAI) are used for simulating societies, the purpose thereof being helpful in the fields of climate, energy, epidemiology, conflict management, child abuse, ....<ref name="newscientist.com">[https://www.newscientist.com/article/mg24332500-800-ai-can-predict-your-future-behaviour-with-powerful-new-simulations AI can predict your future behaviour with powerful new simulations]</ref> Some organisations working on using multi-agent system models include Center for Modelling Social Systems, Centre for Research in Social Simulation, Centre for Policy Modelling, Society for Modelling and Simulation International.<ref name="newscientist.com"/> Hallerbach et al. discussed the application of agent-based approaches for the development and validation of [[Vehicular automation|automated driving systems]] via a digital twin of the vehicle-under-test and microscopic traffic simulation based on independent agents.<ref>{{cite journal |last1=Hallerbach |first1=S. |last2=Xia |first2=Y. |last3=Eberle |first3=U. |last4=Koester |first4=F. |title=Simulation-Based Identification of Critical Scenarios for Cooperative and Automated Vehicles |journal=SAE International Journal of Connected and Automated Vehicles |volume=1 |issue=2 |page=93 |date=2018 |publisher=SAE International |doi=10.4271/2018-01-1066 |url=https://www.researchgate.net/publication/324194968}}</ref> [[Waymo]] has created a multi-agent simulation environment Carcraft to test algorithms for [[self-driving car]]s.<ref>{{cite news |last1=Madrigal |first1=Story by Alexis C. |title=Inside Waymo's Secret World for Training Self-Driving Cars |url=https://www.theatlantic.com/technology/archive/2017/08/inside-waymos-secret-testing-and-simulation-facilities/537648/ |access-date=14 August 2020 |work=The Atlantic}}</ref><ref>{{cite journal |last1=Connors |first1=J. |last2=Graham |first2=S. |last3=Mailloux |first3=L. |title=Cyber Synthetic Modeling for Vehicle-to-Vehicle Applications |journal=In International Conference on Cyber Warfare and Security |date=2018 |page=594-XI |publisher=Academic Conferences International Limited}}</ref> It simulates traffic interactions between human drivers, pedestrians and automated vehicles. People's behavior is imitated by artificial agents based on data of real human behavior.
 
== See also ==
Line 100 ⟶ 111:
* [[Artificial intelligence]]
* [[Artificial life]]
* [[Artificial life framework]]
* Artificial philosophy
* [[AI mayor]]
Line 160 ⟶ 170:
{{DEFAULTSORT:Multi-Agent System}}
[[Category:Multi-agent systems| ]]
[[Category:Multi-robotManagement systemstheory]]