Component-based usability testing: Difference between revisions

Revision as of 19:40, 25 October 2010

Revision as of 19:43, 25 October 2010

Line 10:

==Testing==

CBUT can be categorized according to two testing paradigms, the Single-Version Testing Paradigm (SVTP) and the Multiple-Versions Testing Paradigm (MVTP). In SVTP only one version of each interaction component in a system is tested. The focus is to identify interaction components that might reduce the overall usability of the system. SVTP is therefore suitable as part of a software-integration test. In MVTP on the other hand, multiple versions of a single component are tested while the remaining components in the system remain unchanged. The focus is on identifying the version with the highest usability of specific interaction component. MVTP therefore is suitable for component development and selection. Different CBUT methods have been proposed for SVTP and MVTP, which include measures based on recorded user interaction and questionnaires. Whereas in MVTP the recorded data can directly be interpreted by making a comparison between two versions of the interaction component, in SVTP log file analysis is more extensive as interaction with both higher and lower components must be considered <ref name="Brinkman2007">Brinkman, W.-P., Haakma, R., & Bouwhuis, D.G. (2007), Towards an empirical method of efficiency testing of system parts: a methodological study, Interacting with Computers, vol. 19, no. 3, pp. 342-356. [http://mmi.tudelft.nl/~willem-paul/WP_Papers_online_versie/Towards_an_empirical_method_of_efficiency_testing_of_system_parts_a_methodological_study_preliminary_version.pdf preliminary version] [http://dx.doi.org/doi:10.1016/j.intcom.2007.01.002 online] </ref>.
Meta-analysis on the data from several lab experiments that used CBUT measures suggests that these measures can be statistically more powerful than overall (holistic) usability measures <ref name="Brinkman2008">Brinkman, W.-P., Haakma, R., & Bouwhuis, D.G. (2008). Component-Specific Usability Testing,'' IEEE Transactions on Systems, Man, and Cybernetics - Part A'', vol. 38, no. 5, pp. 1143-1155, September 2008. [http://mmi.tudelft.nl/~willem-paul/WP_Papers_online_versie/Component_specific_usability_testing_preliminary_version.pdf preliminary version] [http://dx.doi.org/doi:10.1109/TSMCA.2008.2001056 online]</ref>.

==Usability Questionnaire==

Line 34 ⟶ 35:

* Example study that uses Component-based Usability Questionnaire including questionnaires and data analysis.

Brinkman, W.-P., Haakma, R., & Bouwhuis, D.G. (2007), Towards an empirical method of efficiency testing of system parts: a methodological study, Interacting with Computers, vol. 19, no. 3, pp. 342-356.