Modality (human–computer interaction)

Not to be confused with Mode (computer interface).

In the context of human–computer interaction, a modality is the classification of a single independent channel of sensory input/output between a computer and a human.^[1] A system is designated unimodel if it has only one modality implemented, and multimodel if it has more than one.^[1] When multiple modalities are available for some tasks or parts of tasks, the system is said to have overlapping modalities. When multiple modalities are available for all tasks, the system is said to have redundant modalities.^{[citation needed]} Modalities can be generally defined in two forms: human-computer and computer-human modalities.

Computer–Human Modalities

Any human sense can used as a computer to human modality. The following are examples of modalities and their implementations through which a computer could send information to a human:

• Common modalities
  • Vision
  • Audition
  • Tactition

• Uncommon modalities
  • Gustation (taste)
  • Olfaction (smell)
  • Thermoception (heat)
  • Nociception (pain)
  • Equilibrioception (balance)

The modalities of seeing and hearing are the most commonly employed since they are capable of transmitting more information at a higher speed than other modalities, 250 to 300^[2] and 150–160^[3] words per minute, respectively. Though uncommonly implemented as computer-human modality, tactition can achieve average 125 wpm ^[4] through the use of a refreshable Braille display.

Human–Computer Modalities

The computer can be equipped with various types of input devices and sensors to allow it to receive information from the human.

• Simple modalities
  • Keyboard
  • Pointing device
  • Touchscreen

• Complex modalities
  • Computer Vision
  • Speech Recognition
  • Motion
  • Orientation

See also

• Multimodal interaction
• User-interface
• NCCR IM2: Swiss project on Multimodal interaction

1. Karray, Fakhreddine; Alemzadeh, Milad; Saleh, Jamil Abou; Arab, Mo Nours (March 2008). "Human-Computer Interaction: Overview on State of the Art" (PDF). International Journal on Smart Sensing and Intelligent Systems. 1 (1). Retrieved April 21, 2015.
2. Ziefle, M (December 1998). "Effects of display resolution on visual performance". Human factors. 40 (4): 554–68. PMID 9974229.
3. Williams, J. R. (1998). Guidelines for the use of multimedia in instruction, Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1447–1451
4. "Braille". ACB. American Council of the Blind. Retrieved 21 April 2015.