Modality (human–computer interaction): Difference between revisions

Content deleted Content added
repaired link(s) to disambiguation pages (you can help) - Haptic; fixed section capitalization
m Link, tidying
Line 31:
** [[Accelerometer|Motion]]
** [[Orientation (geometry)|Orientation]]
With the increasing popularity of [[smartphones]], the general public are becoming more comfortable with the more complex modalities. Speech recognition was a major selling point of the [[iPhone 4S]] and following [[Apple Inc.|Apple]] products, with the introduction of [[Sirius|Siri]].<ref>{{Cite news|url = http://bgr.com/2011/11/02/siri-said-to-be-driving-force-behind-huge-iphone-4s-sales/|title = Siri said to be driving force behind huge iPhone 4S sales|last = Epstein|first = Zach|date = Nov 2, 2011|work = |access-date = April 21, 2015|via = }}</ref> This technology gives users an alternative way to communicate with computers when typing is less desirable. However, in a loud environment, the audition modality is not quite effective. This exemplifies how certain modalities have varying strengths depending on the situation.<ref>{{Cite book|title = Multimodality in Mobile Computing and Mobile Devices: Methods for Adaptable Usability|last = Kurkovsky|first = Stan|publisher = [[IGI Global]] |year = 2009|isbn = 9781605669793|___location = |pages = 210–211|url = https://books.google.com/books?id=kqxpqs32muQC&dq}}</ref> Other complex modalities such as computer vision in the form of [[Microsoft]]'s [[Kinect]] or other similar technologies can make sophisticated tasks easier to communicate to a computer especially in the form of three dimensional movement.<ref>{{Cite book|title = Human-Computer Interaction: Interaction Modalities and Techniques|last = Kurosu|first = Masaaki|publisher = Springer|year = 2013|isbn = 9783642393303|___location = |pages = 366|url = https://books.google.com/books?id=p5W6BQAAQBAJ&dq}}</ref>
 
==Using multiple modalities==
Line 37:
 
There are six types of cooperation between modalities, and they help define how a combination or fusion of modalities work together to convey information more effectively.<ref name=":0">{{Cite book|title = Multimodal Human Computer Interaction and Pervasive Services|last = Grifoni|first = Patrizia|publisher = IGI Global|year = 2009|isbn = 9781605663876|___location = |pages = 37|url = https://books.google.com/books?id=O8CqMtIKSWwC&source=gbs_navlinks_s}}</ref>
 
* '''Equivalence:''' information is presented in multiple ways and can be interpreted as the same information
* '''Specialization:''' when a specific kind of information is always processed through the same modality
Line 43 ⟶ 44:
* '''Transfer: '''a modality produces information that another modality consumes
* '''Concurrency:''' multiple modalities take in separate information that is not merged
 
Complimentary-redundant systems are those which have multiple sensors to form one understanding or dataset, and the more effectively the information can be combined without duplicating data, the more effectively the modalities cooperate. Having multiple modalities for communication is common, particularly in smartphones, and often their implementations work together towards the same goal, for example gyroscopes and accelerometers working together to track movement.<ref name=":0"/>