Purchase this article with an account.
Julie Skevik, Peter Scarfe; Multisensory Detection: Using Vision and Haptics to detect hidden objects.. Journal of Vision 2018;18(10):92. doi: https://doi.org/10.1167/18.10.92.
Download citation file:
© ARVO (1962-2015); The Authors (2016-present)
Data from several studies show that when information is available from both vision and haptics simultaneously, people have a higher level of precision in discriminating properties such as size and shape, compared to either cue in isolation (Ernst and Banks 2002; Helbig and Ernst 2007). Most studies on the topic of visuo-haptic cue combination have focussed on discrimination, while few studies have investigated the effects on detection. In this experiment, we investigated whether these benefits would hold true in detection tasks, which have more relevance to applied situations such as the detection and delineation of cancerous tumours in medical imaging data (Abbey and Eckstein 2009). Participants had to compare two image patches presented on a computer monitor in a two-alternative forced choice task and detect which of the two patches contained a hidden 2D Gaussian profile. Information was available from touch, vision or both touch and vision simultaneously. Haptic feedback was provided by a desktop Phantom force feedback device and visual reliability parametrically manipulated by adding Gaussian white noise to each patch. Haptic stimuli maintained a constant level of reliability across conditions. Our findings are in line with those of previous discrimination studies. Observers are consistently better at detecting the hidden Gaussian signal across visual noise levels when both visual and haptic information were available, compared to either modality in isolation. We discuss our results in relation to models of optimal sensory cue combination, applied tasks such as tumour delineation and examine the haptic predictors of good performance.
Meeting abstract presented at VSS 2018
This PDF is available to Subscribers Only