Surface computing: Difference between revisions

Revision as of 07:24, 22 April 2015

Latest revision as of 07:18, 21 July 2023

(28 intermediate revisions by 18 users not shown)

Line 1:

'''Surface computing''' is the use of a specialized [[computer]] [[GUI]] in which traditional GUI elements are replaced by intuitive, everyday objects. Instead of a [[Computer keyboard|keyboard]] and [[Mouse (computing)|mouse]], the user interacts directly with a surface. Typically the surface is a [[touchscreen|touch-sensitive screen]], though other surface types like non-flat three-dimensional objects have been implemented as well. It has been said that this more closely replicates the familiar hands-on experience of everyday object manipulation.<ref>[http://what-is-what.com/what_is/microsoft_surface.html{{Cite web |title=What is the Microsoft Surface? - What the Microsoft Surface computer is, and how it works]. |url=https://what-is-what.com/what_is/microsoft_surface.html |access-date=2022-09-22 |website=what-is-what.com}}</ref><ref>[http{{Cite web |last=Zibreg |first=Christian |date=2008-05-07 |title=Teenager Creates First OS X Multi-touch Table |url=https://www.tomshardware.com/news/apple-multitouch-laptop,5309.html Teenager|access-date=2022-09-22 Creates|website=Tom's FirstHardware OS X Multi-touch Table]|language=en}}</ref>

Early work in this area was done at the [[University of Toronto]], Alias Research, and MIT.<ref>{{Cite web |last=Buxton |first=Bill |date=2007-01-12 |title=Multi-Touch Systems that I Have Known and Loved |url=http://www.billbuxton.com/multitouchOverview.html |access-date=2022-09-22 |website=www.billbuxton.com}}</ref> Surface work has included customized solutions from vendors such as [http://LM3LABS.com LM3LABS] or GestureTek, Applied Minds for [[Northrop Grumman]].<ref>[http://www.is.northropgrumman.com/products/touchtable/index.html Applied Minds & Northrop Grumman]</ref> Major computer vendor platforms are in various stages of release: the iTable by PQLabs,<ref>[http://multi-touch-screen.net/ PQLabs]</ref> [[Linux MPX]],<ref>[http{{Cite web |date=2007-07-16 |title=Linux MPX Multi-touch Table May Become Alternative Microsoft Surface |url=https://gizmodo.com/gadgets/touch-me/linux-mpx-multi+-touch-table-may-become-freealternative-diymicr-microsoft278613 |access-surfacedate=2022-one09-day-278613.php22 Linux|website=Gizmodo MPX Multitouch]|language=en-us}}</ref> the [[Ideum]] [[MT-50 Multitouch Table|MT-50]], interactive bar by spinTOUCH, and [[Pixelsense|Microsoft PixelSense]] (formerly known as Microsoft Surface).

== Surface Typestypes ==

Surface computing employs the use of two broad categories of surface types, flat and non-flat. The distinction is made not only due to the physical dimensions of the surfaces, but also the methods of interaction.

==== Flat ====

Flat surface types refer to two-dimensional surfaces such as tabletops. This is the most common form of Surface Computing in the commercial space as seen by products like Microsoft’s PixelSense and  iTable. The aforementioned commercial products utilize a multi-touch LCD screen as a display, but other implementations use projectors. Part of the appeal of two-dimensional surface computing is the ease and reliability of interaction. Since the advent of tablet computing, a set of intuitive gestural interactions have been developed to compliment two-dimensional surfaces. However, the two-dimensional plane limits the range of interactions a user is able to perform. Furthermore, interactions are only detected when making direct contact with the surface. In order to afford the user a wider range of interaction, research has been done to augment the interaction schemes for two-dimensional surfaces. This research involves using the space above the screen as another dimension for interaction, so, for example, the height of a user’s hands above the surface becomes a meaningful distinction for interaction. This particular system would qualify as a hybrid that uses a flat surface, but a three-dimensional space for interaction.<ref name=":0">{{Cite web|url = http://research.microsoft.com/pubs/132463/hilliges2009uist.pdf|title = Interaction in the Air: Adding Further Depth to Interactive Tabletops|date = |accessdate = |website = |publisher = |last = |first = }}</ref>

Flat surface types refer to two-dimensional surfaces such as tabletops. This is the most common form of Surfacesurface Computingcomputing in the commercial space as seen by products like Microsoft’sMicrosoft's PixelSense and   iTable. The aforementioned commercial products utilize a multi-touch LCD screen as a display, but other implementations use projectors. Part of the appeal of two-dimensional surface computing is the ease and reliability of interaction. Since the advent of tablet computing, a set of intuitive gestural interactions have been developed to complimentcomplement two-dimensional surfaces. However, the two-dimensional plane limits the range of interactions a user is able to perform. Furthermore, interactions are only detected when making direct contact with the surface. In order to afford the user a wider range of interaction, research has been done to augment the interaction schemes for two-dimensional surfaces. This research involves using the space above the screen as another dimension for interaction, so, for example, the height of a user’suser's hands above the surface becomes a meaningful distinction for interaction. This particular system would qualify as a hybrid that uses a flat surface, but a three-dimensional space for interaction.<ref name=":0">{{Cite web|url = http://research.microsoft.com/pubs/132463/hilliges2009uist.pdf|title = Interaction in the Air: Adding Further Depth to Interactive Tabletops|date = 4 October 2009|accessdate = |website = |publisher = |last = |first = | pages=139–148 }}</ref>

==== Non-Flat ====

While most work with Surface Computing has been done with flat surfaces, non-flat surfaces have become an interest with researchers. The eventual goal of Surface Computing itself is tied to the notion of [[Ubiquitous Computing]] “where everyday surfaces in our environment are made interactive”.<ref name=":1" /> These everyday surfaces are often non-flat, so researchers have begun exploring curved and three-dimensional modes. Some of these include spherical, cylindrical and parabolic surfaces. Including a third dimension to Surface Computing presents both benefits and challenges. One of these benefits is an extra dimension of interaction. Unlike flat surfaces, three dimensional surfaces allow for a sense of depth and are thus classified as “depth-aware” surfaces. This allows for more diverse gestural interactions. However, one of the main challenges  is designing intuitive gestural actions to facilitate interaction with these non-flat surfaces. Furthermore, three dimensional shapes such as spheres and cylinders require viewing from all angles, also known as Omnidirectional displays. Designing compelling views from every angle is a difficult task, as is designing applications that make sense for these display types.<ref name=":1" />

==== Non-Flatflat ====

==Technological Components==

While most work with Surfacesurface Computingcomputing has been done with flat surfaces, non-flat surfaces have become an interest with researchers. The eventual goal of Surfacesurface Computingcomputing itself is tied to the notion of [[Ubiquitousubiquitous Computingcomputing]] “where"where everyday surfaces in our environment are made interactive”interactive".<ref name=":1" /> These everyday surfaces are often non-flat, so researchers have begun exploring curved and three-dimensional modes. Some of these include spherical, cylindrical and parabolic surfaces. Including a third dimension to Surfacesurface Computingcomputing presents both benefits and challenges. One of these benefits is an extra dimension of interaction. Unlike flat surfaces, three dimensional surfaces allow for a sense of depth and are thus classified as “depth"depth-aware”aware" surfaces. This allows for more diverse gestural interactions. However, one of the main challenges   is designing intuitive gestural actions to facilitate interaction with these non-flat surfaces. Furthermore, three -dimensional shapes such as spheres and cylinders require viewing from all angles, also known as Omnidirectionalomnidirectional displays. Designing compelling views from every angle is a difficult task, as is designing applications that make sense for these display types.<ref name=":1" />

==== Display ====

Displays for Surface Computing can range from [[LCD]] and [[Projection]] screens to physical object surfaces. Displays can be divided into single-viewpoint and multi-viewpoint displays. Single-viewpoints include any flat screen or surface where viewing is typically done from one angle. A multi-viewpoint display would include any three-dimensional object surface like a sphere or cylinder that allows viewing from any angle.<ref name=":0" />

==Technological Componentscomponents==

==== Display ====

Displays for Surfacesurface Computingcomputing can range from [[LCD]] and [[Projectionprojection screens]] screens to physical object surfaces. Alternatively, an augmented reality headset may be used to display images on real-world objects. Displays can be divided into single-viewpoint and multi-viewpoint displays. Single-viewpoints include any flat screen or surface where viewing is typically done from one angle. A multi-viewpoint display would include any three-dimensional object surface like a sphere or cylinder that allows viewing from any angle.<ref name=":0" />

==== Projectors ====

==== Projectors ====

If a projection screen or a physical object surface is being used, a projector is needed to superimpose the image on the display. A wide range of projectors are used including DLP, LCD, and LED. Front and rear projection techniques are also utilized. The advantage of a projector is that it can project onto any arbitrary surface. However, a user will end up casting shadows onto the display itself, making it harder to identify high detail.

==== Infrared Camerascameras ====

Infrared or [[Thermographic]] cameras are used to facilitate gestural detection. Unlike digital cameras, infrared cameras operate independent of light, instead relying on the heat signature of an object. This is beneficial because it allows for gesture detection in all lighting conditions. However, cameras are victim to occlusion by other objects that may result in a loss of gesture tracking.

Infrared or [[Thermographicthermographic]] cameras are used to facilitate gestural detection. Unlike digital cameras, infrared cameras operate independentindependently of light, instead relying on the heat signature of an object. This is beneficial because it allows for gesture detection in all lighting conditions. However, cameras are victimsubject to occlusion by other objects that may result in a loss of gesture tracking. Infrared cameras are most common in three-dimensional implementations.

==Interaction Methods==

Various methods of interaction exist in surface computing. The most common method of which is touch based, this includes single and multi-touch interactions. Other interactions exist such as freehand 3D interactions that depth-aware cameras can sense.

==Interaction Methodsmethods==

•'''Two Dimensional''' Typically, traditional surface types are two-dimensional and only require two-dimensional touch interactions. Depending on the system, multi-touch gestures, such as [[pinch to zoom]], are supported. These gestures allow the user to manipulate what they see on the surface by physically touching it and moving their fingers them across the surface.

Various methods of interaction exist in surface computing. The most common method of which is touch based, this includes single and [[multi-touch]] interactions. Other interactions exist such as freehand [[3D interactionsinteraction]]s that depth-aware cameras can sense.

•'''Two Dimensional''' Typically, traditional surface types are two-dimensional and only require two-dimensional touch interactions. Depending on the system, multi-touch gestures, such as [[pinch to zoom]], are supported. These gestures allow the user to manipulate what they see on the surface by physically touching it and moving their fingers them across the surface. For sufficiently large surfaces, multi-touch gestures can extend to both hands, and even multiple sets of hands in multi-user applications.

•'''Three Dimensional''' Using depth aware cameras it is possible to make three dimensional gestures. Such gestures allow the user to move in three dimensions of space without having to come into contact with the surface itself, such as the methods used in [[DepthTouch]].<ref name=":1">[http://research.microsoft.com/en-us/um/people/benko/publications/2009/benko_mm09bnt236.pdf Beyond Flat Surface Computing: Challenges of Depth-Aware and Curved Interfaces]</ref>

•'''Three Dimensional''' Using depth aware cameras it is possible to make three dimensional gestures. Such gestures allow the user to move in three dimensions of space without having to come into contact with the surface itself, such as the methods used in [[Depth perception]].<ref name=":1">{{Cite journal |last=Benko |first=Hrvoje |date=2009-08-05 |title=Beyond Flat Surface Computing: Challenges of Depth-Aware and Curved Interfaces |url=https://www.microsoft.com/en-us/research/publication/beyond-flat-surface-computing-challenges-depth-aware-curved-interfaces/ |language=en-US}}</ref> DepthTouch makes use of a depth-sensing camera, a projector, desktop computer, and a vertical screen for the user to interact with. Instead of physically touching the screen, the user can manipulate the objects he or she sees displayed onto it by making freehand gestures in mid-air. The depth-aware camera can then detect the user's gestures and the computer processes them to show what the user is doing on the display.

==Applications==

Surface computing is used in both research and commercial use. It is more widely known commercially in products such as the [[iPad]]. Although tablets like the iPad are among the most common types of surface computing other implementations exist, such as HP's [[Sprout (computer)|Sprout]] computer. In research, surface computing has been used to help develop gestures for tabletop implementations.<ref>[{{Cite web |last=Wobbrock |first=Jacob O. |last2=Ringel Morris |first2=Meredith |title=User-Defined Gestures for Surface Computing |url=https://faculty.washington.edu/wobbrock/pubs/chi-09.02.pdf User-Defined Gestures for Surface Computing]}}</ref> Additionally, the exploration of other surface types has been exploreddone to help bring surface computing to many other surface types, like curved and spherical surfaces.

==See also==

Line 40 ⟶ 46:

{{reflist|2}}

==External links==

[[Category:Graphical user interfaces]]

* [http://ruetersward.com/biblio.html Annotated Bibliography of References to Gestures, Touchscreens, and Pen Computing]

[[Category:Surface computing| ]]

[[Category:Graphical user interfaces]]