Short-term recall comparison of iconic auditory and visual feedback stimuli in a memory game

György Wersényi, Ádám Csapó, József Tóllár

Abstract


Multimedia user interfaces incorporate various feedback methods using different modalities. Cognitive processing of audiovisual information requires the ability to recall visual and auditory information, either separately, or in combination. Short-term memory capabilities vary individually and depend on factors such as signal presentation and the number and type of visual and auditory items. In an experiment involving 40 subjects, we aimed to compare short-term auditory and visual capabilities in a serious game application. Subjects played the ‘Pairs’ game at different resolutions, using either visual icons or audio samples, while the total time cost and number of flips were recorded. The results indicate that visual memory is not superior, and female subjects performed better than males at higher levels in the visual task. Additionally, human sound samples, speech and familiar auditory icons were found to be easier to recall than artificial measurement signals.

Keywords


Audiovisual memory; Auditory icon Human-computer; Interaction; Serious gaming; Sound design

Full Text:

PDF


DOI: http://doi.org/10.11591/ijeecs.v39.i1.pp310-321

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Indonesian Journal of Electrical Engineering and Computer Science (IJEECS)
p-ISSN: 2502-4752, e-ISSN: 2502-4760
This journal is published by the Institute of Advanced Engineering and Science (IAES).

shopify stats IJEECS visitor statistics