The findings of our experiment seem to depend on the fact that we used masks that were either congruent or incongruent to the shape of the primes. To examine the role of target-mask congruency one might think that separate analyses of congruent and incongruent trials might be the best way to go (see e.g., Maksimov et al.,
2011). To illustrate this, we present percentage correct data for congruent and incongruent trials of
Experiment 1 in Supplementary
Figure S1. However, this approach departs crucially from traditional signal detection analysis because it is in danger of confounding measures of sensitivity with measures of response bias (see Albrecht & Mattler,
in press; Macmillan & Creelman,
1991; Vorberg et al.,
2004). To illustrate this problem, consider the case that an observer does not comply with task instructions to discriminate targets but rather responds to the shape of the mask. In this case, he or she would be correct on 50% of all trials. This corresponds to chance performance, which should be reflected in the results of the data analysis. However, if one regards only congruent trials, this observer would be perfectly correct. On incongruent trials, however, the observer would be incorrect on every trial (see type-A observers with short SOA in Supplementary
Figure S1A). In other words, a distinction of congruent and incongruent trials would indicate substantial performance differences in target discrimination, which depend on congruency although the true sensitivity is zero in both conditions. Signal detection analysis is useful in resolving this confound by computing sensitivity measure
d′ and response bias measure C separately for each mask. This corresponds to the recommendation to keep conditions constant that are likely to affect response bias (see Macmillan & Creelman,
1991; Vorberg et al.,
2004). The present data exemplifies that this analysis uncovers the behavior of the above considered observer that the true sensitivity is zero and the response is driven by the shape of the mask (see Type A observers with short SOA in
Figures 1a and
2a, and Supplementary
Figure S1A). Finally, we wish to note that clustering the data of a sample produces results with severely limited generalizability because the result of a cluster analysis is a function of the number of clusters, the exact parameter on which clustering is based, and the specific random assembling of the sample. For instance, in Albrecht, Klapötke et al. (
2010) we based clustering on the slope of the masking functions irrespective of performance levels at single SOAs. In the present study, we chose a more data driven approach and based clustering on the combination of absolute and relative levels of performance at the 24 and the 72 milliseconds SOA. When we cluster the present data on the slope of the masking functions, like before, slightly different groups result. Nonetheless, with both approaches we replicate a finding which has been observed by now with different random samples, namely that a group with type-A masking functions can be distinguished from a group with type-B masking functions (Albrecht, Klapötke et al.,
2010; Albrecht & Mattler,
in press; Maksimov et al.,
2011). Importantly, however, our research aims to account for the phenomenon of stable interindividual differences in objective measures of target perception in the metacontrast masking paradigm. This does not necessarily require that individuals fall into a specific number of groups although our previous studies suggested two characteristically different groups of observers. Future research will show whether human observers in metacontrast masking are best conceived as individuals that are evenly dispersed across some kind of continuum or rather as members of characteristic groups. It is but one approach to examine whether type-A and type-B observers are also distinguished by other communalities that they share with the other members of their group.