Modality (human–computer interaction): Difference between revisions

Revision as of 21:13, 16 November 2016

Revision as of 05:35, 5 January 2017

Line 7:

* Common modalities

** [[Visual perception|Vision]] -– computer graphics typically through a screen

** [[Hearing (sense)|Audition]] -– various audio outputs

** [[Haptic technology|Tactition]] -– vibrations or other movement

* Uncommon modalities

** [[Taste|Gustation]] (taste)

Line 17:

** [[Equilibrioception]] (balance)

Any human sense can be used as a computer to human modality. However, the modalities of [[visual perception|seeing]] and [[hearing (sense)|hearing]] are the most commonly employed since they are capable of transmitting information at a higher speed than other modalities, 250 to 300<ref name=Ziefle98>{{cite journal|last1=Ziefle|first1=M|title=Effects of display resolution on visual performance.|journal=Human factors|date=December 1998|volume=40|issue=4|pages=554–68|pmid=9974229}}</ref> and 150 to 160<ref>Williams, J. R. (1998). Guidelines for the use of multimedia in instruction, Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1447–1451</ref> [[words per minute]], respectively. Though not commonly implemented as computer-human modality, tactition can achieve an average of 125 wpm <ref>{{cite web|title=Braille|url=http://www.acb.org/node/67|website=ACB|publisher=American Council of the Blind|accessdate=21 April 2015}}</ref> through the use of a [[refreshable Braille display]]. Other more common forms of tactition are smartphone and game controller vibrations.

==Human–computer modalities==

Line 27:

** [[Touchscreen]]

* Complex modalities

** [[Computer Visionvision]]

** [[Speech Recognitionrecognition]]

** [[Accelerometer|Motion]]

** [[Orientation (geometry)|Orientation]]

With the increasing popularity of [[smartphones]], the general public are becoming more comfortable with the more complex modalities. Speech recognition was a major selling point of the [[iPhone 4S]] and following [[Apple Inc.|Apple]] products, with the introduction of [[Sirius|Siri]].<ref>{{Cite news|url = http://bgr.com/2011/11/02/siri-said-to-be-driving-force-behind-huge-iphone-4s-sales/|title = Siri said to be driving force behind huge iPhone 4S sales|last = Epstein|first = Zach|date = Nov 2, 2011|work = |access-date = April 21, 2015|via = }}</ref> This technology gives users an alternative way to communicate with computers when typing is less desirable. However, in a loud environment, the audition modality is not quite effective. This exemplifies how certain modalities have varying strengths depending on the situation.<ref>{{Cite book|title = Multimodality in Mobile Computing and Mobile Devices: Methods for Adaptable Usability|last = Kurkovsky|first = Stan|publisher = [[IGI Global]] |year = 2009|isbn = 9781605669793|___location = |pages = 210–211|url = https://books.google.com/books?id=kqxpqs32muQC&dq}}</ref> Other complex modalities such as computer vision in the form of [[Microsoft]]'s [[Kinect]] or other similar technologies can make sophisticated tasks easier to communicate to a computer especially in the form of three dimensional movement.<ref>{{Cite book|title = Human-Computer Interaction: Interaction Modalities and Techniques|last = Kurosu|first = Masaaki|publisher = Springer|year = 2013|isbn = 9783642393303|___location = |pages = 366|url = https://books.google.com/books?id=p5W6BQAAQBAJ&dq}}</ref>

==Using multiple modalities==

Line 49:

==See also==

* [[Multimodal interaction]]

* [[User-interface]]

* [[Multisensory integration]]

* [[User- interface]]

==References==