Course of Action Display and Evaluation Tool: Difference between revisions

Content deleted Content added
Added {{Close paraphrasing}} tag
Cz13sz17 (talk | contribs)
Removed Close paraphrasing note, after review and concurrence of an editor.
 
(7 intermediate revisions by 4 users not shown)
Line 1:
{{Short description|Military planning system}}
{{Close paraphrasingOrphan|date=June 2025}}
 
 
{{Close paraphrasing|date=June 2025}}
<!-- Important, do not remove anything above this line before article has been created. -->
'''Course of Action Display and Evaluation Tool''' (CADET) was a research program, and the eponymous prototype software system, that applied knowledge-based techniques of Artificial Intelligence to the problem of battle planning. CADET was also known as Course of Action Display and Elaboration Tool.<ref name="Rasch-2003-Incorporating">Rasch, Robert, Alexander Kott, and Kenneth D. Forbus. "Incorporating AI into military decision making: an experiment." IEEE Intelligent Systems 18.4 (2003) pp. 18-26.</ref>
It was considered an early example of such systems<ref name="“SchusterSchuster-2018-When”When">Schuster, E. (2018). When Something Has to Give: The Intersection of Artificial Intelligence, Military Decision-Making and International Humanitarian Law. Thesis, Lund University, Sweden, 2018</ref> and was funded by the United States Army and by the [[Defense Advanced Research Projects Agency]] (DARPA). CADET influenced a later DARPA program called RAID<ref name="“KottKott-2005-Real-time”time">Kott, A., Real-time Adversarial Reasoning and Decision-making Program, Proceedings of the 10th ICCRT Symposium, McLean, Virginia, USA,13–16 June 2005. Online at http://www.dodccrp.org/events/10th_ICCRTS/CD/presentations/170.pdf </ref> which in turn produced a technology adopted by the United States Army and the United States Marine Corps.<ref name="“StevensStevens-2016-Training”Training">Stevens, Jonathan, Ms Latika Eifert, Stephen R. Serge, and Sean Mondesire. "Training Effectiveness Evaluation of Lightweight Game-based Constructive Simulation." Proceedings of the ModSim Conference, 2016. Online at
https://www.modsimworld.org/papers/2016/Training_Effectiveness_Evaluation_of_Lightweight_Game-based_Constructive_Simulation.pdf</ref><ref name="”BAE”BAE">{{cite web | url=https://militaryembedded.com/ai/machine-learning/bae-systems-prototype-selected-for-us-marine-corps-wargaming-and-analysis-center | title=BAE Systems' prototype selected for U.S. Marine Corps Wargaming and Analysis Center - Military Embedded Systems }}</ref>
 
== History ==
 
The development of Course of Action Display and Evaluation Tool (CADET) began in 1996, at the Carnegie Group, Inc.,<ref>Phillips, Eve Marie. If it works, it's not AI: a commercial look at artificial intelligence startups. Dissertation, Massachusetts Institute of Technology, 1999.</ref> Pittsburgh PA, funded under the [[Small Business Innovation Research]] (SBIR) program. The goal of the first phase SBIR project was to produce “...a live storyboard of [Course of Action] COA development, wargaming, animation, and assessment.”<ref name=“Ground"Ground-2002-Knowledge”Knowledge">Ground, Larry, Alexander Kott, and Ray Budd. A knowledge-based tool for planning of military operations: The coalition perspective. Technical Report, BBN Technologies, Pittsburgh PA, 2002. Online at https://apps.dtic.mil/sti/pdfs/ADA402533.pdf</ref>
 
In 1997, the United States Army awarded the Carnegie Group Inc. $750K for SBIR Phase II. The intent was to develop “...a war-gaming modeling and analysis Decision Support System (DSS), … CADET will consist of a combination of Knowledge-Based and decision analytic tools and technologies to provide fast nimble COA war-gaming modeling, simulation, and animation under direct control of the commander and staff. ...Phase II will result in an operations prototype (OP) suitable for use and evaluation in field exercises. A fully functional COA analyzer/wargaming DSS for the commander and staff would be developed in Phase III.”<ref>{{cite web | url=https://www.sbir.gov/awards/28447 | title=Award &#124; SBIR }}</ref>
 
In 2000, CADET was integrated and experimentally evaluated within the framework of the Integrated Course of Action Critiquing and Elaboration System (ICCES) experiment, conducted by the Battle Command Battle Laboratory – Leavenworth (BCBL-L) aswithin athe result of a TRADOC sponsoredprogram Concept Experimentation Program (CEP) sponsored by TRADOC.<ref name=“Rasch"Rasch-2002-AI”AI">Rasch, Robert, Alexander Kott, and Kenneth D. Forbus. "AI on the battlefield: An experimental exploration." In AAAI/IAAI, pp. 906-912. 2002. Online at https://www.qrg.northwestern.edu/papers/Files/AI_in_MDMP_IAAI02.pdf</ref>
 
In 2000-2002, DARPA applied CADET in the program titled Command Post of the Future ([[Command Post of the Future|CPoF]]) as a tool to providegenerate a maneuver course of action. Under the umbrella of the CPoF program, CADET was integrated with the FOX GA system to provide a detailed planner, coupled with COA generation capability. In the same period, Battle Command Battle Lab-Huachuca (BCBL-H) integratedperformed an integration CADET with the system called All Source Analysis System-Light (ASAS-L); tohere provideCADET awas plannerintended to generate plans for intelligence assets, and toconduct wargamewargames enemyof different COAs, againstenemy friendlyversus COAsfriendly.<ref name=“Ground"Ground-2002-Knowledge”Knowledge" /> <ref name=“Ruda"Ruda-2001-Distributed”Distributed">Ruda, Harald, Janet Burge, Peter Aykroyd, Jeffrey Sander, Dennis Okon, and Greg L. Zacharias. "Distributed course-of-action planning using genetic algorithms, XML, and JMS." In Battlespace Digitization and Network-Centric Warfare, vol. 4396, pp. 260-269. SPIE, 2001. </ref>
In 2000-2002, DARPA applied CADET in its Command Post of the Future ([[Command Post of the Future|CPoF]]) program
 
as a tool to provide a maneuver course of action. Under the umbrella of the CPoF program, CADET was integrated with the FOX GA system to provide a detailed planner, coupled with COA generation capability. In the same period, Battle Command Battle Lab-Huachuca (BCBL-H) integrated CADET with All Source Analysis System-Light (ASAS-L) to provide a planner for intelligence assets and to wargame enemy COAs against friendly COAs.<ref name=“Ground-2002-Knowledge” /> <ref name=“Ruda-2001-Distributed”>Ruda, Harald, Janet Burge, Peter Aykroyd, Jeffrey Sander, Dennis Okon, and Greg L. Zacharias. "Distributed course-of-action planning using genetic algorithms, XML, and JMS." In Battlespace Digitization and Network-Centric Warfare, vol. 4396, pp. 260-269. SPIE, 2001. </ref>
From 1996 through 2002, work on CADET was performed by the Carnegie Group, Inc., and supported by funding from the US Army [[CECOM]] (CADET SBIR Phase I, CADET SBIR Phase II and CADET Enhancements); DARPA (Command Post of the Future); and [[United States Army Training and Doctrine Command|TRADOC]] BCBL-H.<ref name=“Kott"Kott-2002-Toward”Toward">Kott, Alexander, Larry Ground, Ray Budd, Lakshmi Rebbapragada, and John Langston. "Toward practical knowledge-based tools for battle planning and scheduling." In Proceedings of AAAI/IAAI, pp. 894-899. 2002. Online at
https://www.aaai.org/Papers/IAAI/2002/IAAI02-132.pdf </ref>
 
From 1996 through 2002, work on CADET was performed by the Carnegie Group, Inc., and supported by funding from the US Army [[CECOM]] (CADET SBIR Phase I, CADET SBIR Phase II and CADET Enhancements); DARPA (Command Post of the Future); and [[United States Army Training and Doctrine Command|TRADOC]] BCBL-H.<ref name=“Kott-2002-Toward”>Kott, Alexander, Larry Ground, Ray Budd, Lakshmi Rebbapragada, and John Langston. "Toward practical knowledge-based tools for battle planning and scheduling." In Proceedings of AAAI/IAAI, pp. 894-899. 2002. Online at
https://www.aaai.org/Papers/IAAI/2002/IAAI02-132.pdf </ref>
== Operation ==
 
CADET was intended to be used by the [[Staff (military)|staff]] of the United States Army [[Brigade combat team|Brigade]], within the [[Military Decision Making Process]] (MDMP). In particular, CADET helped produce, automatically or semi-automatically, the products generated within the step of MDMP called Course of Action (COA) Development and the following step of MDMP called COA Analysis and [[Military_wargamingMilitary wargaming|Wargaming]].<ref name="Rasch-2003-Incorporating" />
 
CADET software resided on a laptop computer. Using the computer, the staff officers entered the input to CADET, or alternatively this input arrived toat CADET from upstream computer systems. The input consisted of:<ref name=“Ground"Ground-2000-CADET”CADET">Ground, Larry, and Alex Kott. CADET Enhancements. Technical Report. Logica Carnegie Group, Pittsburgh PA, 2000. Online at
https://apps.dtic.mil/sti/pdfs/ADA379957.pdf </ref>
 
# Order of Battle, i.e., the units constituting the friendly brigade and the enemy units participating in the battle, and their various characteristics;
Line 30 ⟶ 31:
# digital map of the region where the battle was to take place, including the digital description of significant features such as locations of friendly and enemy units, roads, assembly areas, objectives, and axes of attacks.
 
Taking this input, CADET automatically performed the following tasks (not sequentially):<ref name=“Ground"Ground-2000-CADET”CADET"/>Ground<ref name="Kott-2005-Building">Kott, Alexander, Ray Budd, Larry Ground, Lakshmi Rebbapragada, and AlexJohn KottLangston. CADET"Building Enhancements.a Technicaltool Report.for Logicabattle Carnegieplanning: Groupchallenges, Pittsburghtradeoffs, and experimental findings."Applied Intelligence PA23, 2000no. Online3 at(2005): 165-189.</ref>
https://apps.dtic.mil/sti/pdfs/ADA379957.pdf </ref><ref name=“Kott-2005-Building”>Kott, Alexander, Ray Budd, Larry Ground, Lakshmi Rebbapragada, and John Langston. "Building a tool for battle planning: challenges, tradeoffs, and experimental findings."Applied Intelligence 23, no. 3 (2005): 165-189. </ref>
 
* Planning and scheduling the detailedlow-level tasks requirednecessary tofor accomplisha the specifiedgiven COA
* Allocating tasks to thevarious diverseunits forcesand assets constituting the brigade
* Assigning suitable locations and routes
* Estimating friendly and enemythe battle losses (attrition) of friendly and enemy forces, and consumption of resources (e.g., fuel and ammunition)
* Predicting enemy actions or reactions.
 
CADET produced the following outputs:<ref name=“Ground"Ground-2000-CADET”CADET" />
 
# Synchronization matrix, directly editable and printable; synchronization matrix is a kind of Gantt chart that shows assignments of activities to units, to locations/routes and to time periods
Line 46:
# XML formally-encoded plan
# Textual Operation Plan ([[OPLAN]]) draft
# E-mail messages with attachments: XML and text versions of OPLAN
 
== Design ==
 
The core algorithm is a planning algorithm where CADET uses a knowledge-based approach of the hierarchical-task-network type. Each task class is associated with a model of more detailed subtasks that should be performed in order to accomplish the higher-level task. Algorithms selected (heuristically) a task and then decomposes it into subtasks.<ref name=“Ground"Ground-2000-CADET”CADET" />
 
Although similar to hierarchical-task-network planning algorithm, CADET’s algorithm includes elements of adversarial reasoning. After adding a subtask, the algorithm uses rules to determine the enemy’s probable actions and reactions as well as friendly counteractions This approximated the action-reaction-counteraction technique of manual wargaming used by the United States Army.<ref name=“Kott"Kott-2005-Building”Building" />
 
When a task involves movements of a unit, the algorithm performs routing, i.e., finds a route for the movement that minimizes the time required for the movement as well as exposure to the enemy attacks.<ref name=“Ground"Ground-2000-CADET”CADET" />
 
Each added tasks (subtask) normally requires a unit which would execute the task, and a time period when the task would be executed. Therefore, when a certain number of subtasks is added by the planning process, the algorithm also performs the allocation of the newly added subtasks to units and to time periods (i.e., scheduling). allocation and scheduling of tasks relies on both ___domain-specific and constraint-guided heuristics.<ref name=“Ground"Ground-2000-CADET”CADET" /> <ref name=“Kott"Kott-2005-Building”Building" />
 
A tasks may also require expenditures of fuel and ammunition. If the tasks involves engagement with the enemy, the performing units will experience lossesof personnel and weapon systems (attrition). CADET’s algorithm includes estimates of consumption of different types of consumables, and also attrition. Depending on the degree of attrition and consumption, CADET adds tasks that are needed to refuel or reconstitute the units.<ref name=“Ground"Ground-2000-CADET”CADET" />
 
The algorithm continually interleaves incremental steps of planning, routing, scheduling, and attrition and consumption estimates.<ref name=“Kott"Kott-2005-Building”Building" />
 
The algorithm continually interleaves incremental steps of planning, routing, scheduling, and attrition and consumption estimates.<ref name=“Kott-2005-Building” />
== Evaluation ==
 
Two evaluation experiments are described in literature. The first experiment called ICCES took three days. andThe involvedsubjects eightwere Army officers (majors and lieutenant colonels) from combat arms branches, with 11 to 23 years of active service, in the ranks of majors and lieutenant colonels, a total of 8. Each officersofficer was given 4 hours of training learning to operate CADET and related computer tools. Officers were divided into two groups and given a tactical scenario. One group (the control group) used the traditional, manual process; the other used the system called ICCES, the automated core of which was CADET. Each group deliveredproduced three COA sketches and statements and one COA synchronization matrix. Then, the experiment was repeated with another scenario but the control group became the automated group and vice versa. The users were generally satisfied with the quality of the planning products that ICCES -generated products. The group using ICCES made only a few changes to the product that was automatically generated product, indicating that they agreed with the majority of the plan that ICCES produced.<ref name="Rasch-2003-Incorporating" />
 
The second experiment was reminiscent of [[Turing test]]. The experiment involved one user, nine judges (active-duty officers, mainly colonels and lieutenant colonels), and five scenarios obtained from several US Army exercises. For each scenario, experimenters obtained synchronization matrices that were produced in earlier exercises, typically by a team of four to five officers in three to four hours, forspending a total of aboutapproximately 16 person-hours perin planning producttotal. Using these scenarios and COAs, the user had CADET generate automatically detailed plans and express them as synchronization matrices. The user, a retired US Army officer, reviewed and slightly edited the matrices. The entire process took less than two minutes of CADETcomputations executionby and approximately 20 minutes of review and post-editing, for a total of approximately 0.4 person-hour in total per product. The experimenters gave the resulting matrices the same visual style as thatthose ofproduced human-generatedby setshumans. The judges, who did not know whether a planning product was produceda bytraditional theproduct traditionalof manual processhumans, or with computerized aids, were asked to grade the products. The result was that the average grades for manual products and CADET-generated products were statistically indistinguishable, even though CADET-generated products required far less time to produce.<ref name=“Kott"Kott-2005-Building”Building" />
 
== Legacy ==
 
CADET served as “...an example of how even relatively basic AI systems can potentially affect the implementation of IHL during the military decision-making process.”<ref name=“Schuster"Schuster-2018-When”When" />
 
In early 2000s, CADET influenced the DARPA RAID program (started 2004).<ref name=“Kott"Kott-2005-Real-time”time" /> The RAID program in turn produced a technology adopted by the Army and the United Sattes Marine Corps.<ref name=“Stevens"Stevens-2016-Training”Training" /> <ref name=”BAE”"BAE" />
 
In early 2000s, CADET influenced the DARPA RAID program (started 2004).<ref name=“Kott-2005-Real-time” /> The RAID program in turn produced a technology adopted by the Army and the United Sattes Marine Corps.<ref name=“Stevens-2016-Training” /> <ref name=”BAE” />
== Criticisms ==
 
It was argued that in the CADET approach “...the decision-making of the process is obscured, and unaccountable,” and optimality of the planning process is traded for speed.<ref name=“Schuster"Schuster-2018-When”When" />
 
== References ==
 
{{reflist}}
 
[[Category:Artificial intelligence engineering]]
[[Category:Automated planning and scheduling]]
[[Category:Command and control]]
[[Category:Military exercises and wargames]]
[[Category:Military plans]]