Modality (human–computer interaction): Difference between revisions

Content deleted Content added
Added section on cooperation types for modalities
Added to a few sections including the Benefits of Multimodal Systems section
Line 2:
{{Unreferenced|date=December 2009}}
In the context of [[human–computer interaction]], a '''modality''' is the classification of a single independent channel of sensory [[input/output]] between a computer and a human.<ref name="HCI Overview2">{{cite journal|last1 = Karray|first1 = Fakhreddine|last2 = Alemzadeh|first2 = Milad|last3 = Saleh|first3 = Jamil Abou|last4 = Arab|first4 = Mo Nours|title = Human-Computer Interaction: Overview on State of the Art|journal = International Journal on Smart Sensing and Intelligent Systems|date = March 2008|volume = 1|issue = 1|url = http://www.s2is.org/issues/v1/n1/papers/paper9.pdf|accessdate = April 21, 2015}}</ref>
A system is designated unimodel if it has only one modality implemented, and multimodel if it has more than one.<ref name="HCI Overview2" /> When multiple modalities are available for some tasks or aspects of a task, the system is said to have overlapping modalities. If multiple modalities are available for a task, the system is said to have redundant modalities. Multiple modalities can be used in combination to provide complimentary methods that may be redundant but convey information more effectively.<ref>{{CitationCite neededbook|datetitle =April 2014Interactive Systems. Design, Specification, and Verification|last = Palanque|first = Philippe|publisher = Springer Science & Business Media|year = 2001|isbn = 9783540416630|___location = |pages = 43|last2 = Paterno|first2 = Fabio|url = https://books.google.com/books?id=RddIwyhAvDAC&dq=}}</ref> Modalities can be generally defined in two forms: human-computer and computer-human modalities.
Multiple modalities can be used in combination to provide complimentary methods that may be redundant but convey information more effectively.<ref>{{Cite book|title = Interactive Systems. Design, Specification, and Verification|last = Palanque|first = Philippe|publisher = Springer Science & Business Media|year = 2001|isbn = 9783540416630|___location = |pages = 43|last2 = Paterno|first2 = Fabio|url = https://books.google.com/books?id=RddIwyhAvDAC&dq=}}</ref> Modalities can be generally defined in two forms: human-computer and computer-human modalities.
==Computer–Human Modalities==
Any human sense can be used as a computer to human modality. The following are examples of modalities and their implementations through which a computer could send information to a human:
* Common modalities
Line 19 ⟶ 18:
** [[Equilibrioception]] (balance)
 
The modalities of [[visual perception|seeing]] and [[hearing (sense)|hearing]] are the most commonly employed since they are capable of transmitting more information at a higher speed than other modalities, 250 to 300<ref name=Ziefle98>{{cite journal|last1=Ziefle|first1=M|title=Effects of display resolution on visual performance.|journal=Human factors|date=December 1998|volume=40|issue=4|pages=554–68|pmid=9974229}}</ref> and 150–160150 to 160<ref>Williams, J. R. (1998). Guidelines for the use of multimedia in instruction, Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1447–1451</ref> [[words per minute]], respectively. Though uncommonlynot commonly implemented as computer-human modality, tactition can achieve an average of 125 wpm <ref>{{cite web|title=Braille|url=http://www.acb.org/node/67|website=ACB|publisher=American Council of the Blind|accessdate=21 April 2015}}</ref> through the use of a [[refreshable Braille display]].
==Human–Computer Modalities==
The computer can be equipped with various types of [[input devices]] and sensors to allow it to receive information from the human. Common input devices are often interchangeable if they have a standardized method of communication with the computer and afford practical adjustments to the user.
 
* Simple modalities
Line 35 ⟶ 34:
 
==Benefits of Multimodal Systems==
Multimodal systems give more [[affordance]] to users and can contribute to a more robust system. This also allows for greater accessibility for users who work more effectively with certain modalities.
 
There are six types of relations between modalities, and they help define how a combination or fusion of modalities cooperate to convey information more effectively.<ref>{{Cite book|title = Multimodal Human Computer Interaction and Pervasive Services|last = Grifoni|first = Patrizia|publisher = IGI Global|year = 2009|isbn = 9781605663876|___location = |pages = 37|url = https://books.google.com/books?id=O8CqMtIKSWwC&source=gbs_navlinks_s}}</ref>
* '''Equivalence:''' information is presented in multiple ways and can be interpreted as the same information