Free
Article  |   February 2015
Separable effects of inversion and contrast-reversal on face detection thresholds and response functions: A sweep VEP study
Author Affiliations
  • Joan Liu-Shuang
    Psychological Sciences Research Institute and Institute of Neuroscience, University of Louvain, Belgium
    joan.liu@uclouvain.be
  • Justin Ales
    School of Psychology and Neuroscience, University of St Andrews, St Andrews, UK
    jma23@st-andrews.ac.uk
  • Bruno Rossion
    Psychological Sciences Research Institute and Institute of Neuroscience, University of Louvain, Belgium
    bruno.rossion@uclouvain.be
  • Anthony M. Norcia
    Department of Psychology, Stanford University, Stanford, CA, USA
    amnorcia@stanford.edu
Journal of Vision February 2015, Vol.15, 11. doi:https://doi.org/10.1167/15.2.11
  • Views
  • PDF
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Joan Liu-Shuang, Justin Ales, Bruno Rossion, Anthony M. Norcia; Separable effects of inversion and contrast-reversal on face detection thresholds and response functions: A sweep VEP study. Journal of Vision 2015;15(2):11. https://doi.org/10.1167/15.2.11.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

The human brain rapidly detects faces in the visual environment. We recently presented a sweep visual evoked potential approach to objectively define face detection thresholds as well as suprathreshold response functions (Ales, Farzin, Rossion, & Norcia, 2012). Here we determined these parameters are affected by orientation (upright vs. inverted) and contrast polarity (positive vs. negative), two manipulations that disproportionately disrupt the perception of faces relative to other object categories. Face stimuli parametrically increased in visibility through phase -descrambling while alternating with scrambled images at a fixed presentation rate of 3 Hz (6 images/s). The power spectrum and mean luminance of all stimuli were equalized. As a face gradually emerged during a stimulation sequence, EEG responses at 3 Hz appeared at ≈35% phase coherence over right occipito-temporal channels, replicating previous observations. With inversion and contrast-reversal, the 3-Hz amplitude decreased by ≈20%–50% and the face detection threshold increased by ≈30%–60% coherence. Furthermore, while the 3-Hz response emerged abruptly and saturated quickly for normal faces, suggesting a categorical neural response, the response profile for inverted and negative polarity faces was shallower and more linear, indicating gradual and continuously increasing activation of the underlying neural population. These findings demonstrate that inversion and contrast-reversal increase the threshold and modulate the suprathreshold response function of face detection.

Introduction
Detecting the presence of a face in a natural scene is efficient and automatic (Crouzet, Kirchner, & Thorpe, 2010; Lewis & Edmonds, 2003; Rousselet, Macé, & Fabre-Thorpe, 2003). Human observers direct their gaze towards a face as opposed to a distractor within a few hundreds of milliseconds and do so even when instructed to gaze at the distractor (Crouzet et al., 2010). Face detection performance remains high when faces are degraded into two-tone images (i.e., Mooney faces; George, Jemel, Fiori, Chaby, & Renault, 2005) or masked through noise (Jiang et al., 2011; Rousselet, Pernet, Bennett, & Sekuler, 2008). The special status of faces among other object categories is further underlined by specialized neurofunctional mechanisms. Compared to other object categories, the perception of a face elicits a larger early electrophysiological component on the human scalp (i.e., N170; Bentin, McCarthy, Perez, Puce, & Allison, 1996; Jeffreys, 1989; Rossion & Jacques, 2011, for review) and on the ventral occipito-temporal cortical surface (Allison, Puce, Spencer, & McCarthy, 1999). Several regions within the occipito-temporal cortex, in particular the lateral fusiform gyrus, inferior occipital gyrus, and superior temporal sulcus, are thought to be dedicated to face processing (e.g., Haxby, Hoffman, & Gobbini, 2000; Kanwisher, McDermott, & Chun, 1997; Sergent, Ohta, & MacDonald, 1992; Weiner & Grill-Spector, 2010). 
In a recent study (Ales, Farzin, Rossion, & Norcia, 2012), the threshold and the response function for face detection were objectively defined with scalp EEG using the sweep visual evoked potential (VEP) technique (Regan, 1973). At the beginning of a stimulation sequence, (meaningless) phase-scrambled stimuli alternated at a constant rate of 3 Hz (6 images/s), leading to a 6-Hz steady-state visual evoked potential (SSVEP, Regan, 1966). Every other stimulus then progressively increased in phase-coherence so that a face gradually emerged. Participants were instructed to detect the appearance of a face during the 20-s sequence. Since power spectrum remained constant throughout the whole stimulation sequence, the emergence of an EEG response at exactly the presentation rate of face images, i.e., 6 Hz/2 = 3 Hz, was taken as an index of face detection. While the 6-Hz response related to low-level processing remained constant in amplitude across the entire stimulation sequence, a significant and large increase of the 3-Hz amplitude was observed around 30% coherence over the right occipito-temporal channels, reflecting an objective (i.e., at a predefined frequency) threshold for face detection. Moreover, despite the progressive increase of shape information, this 3-Hz increase was abrupt, reaching the maximal response amplitude within one level of additional phase-coherence, suggesting a strongly saturated response function for face detection. These findings are unique in the sense that they provide a sensitive (i.e., high signal-to-noise ratio, SNR) and objective (i.e., exactly at an experimentally defined frequency) threshold and response function for face detection (Ales et al., 2012). 
The present study builds upon these observations to investigate how face detection is influenced by orientation and contrast polarity inversion. Since plane inversion (Yin, 1969) and contrast polarity reversal (i.e., black pixels become white and vice versa; Galper, 1970) are two well-documented manipulations that disproportionately impair perception for faces compared to objects (for inversion see Farah, Wilson, Drain, & Tanaka, 1998; Rossion, 2008, for reviews; for contrast-reversal see Nederhouser, Yue, Mangini, & Biederman, 2007; Vuong, Peissig, Harrison, & Tarr, 2005), a first aim is to use these manipulations to test whether the face detection threshold and response function reflect high-level visual processes specific to facial structure (face vs. scrambled), rather than more general (midlevel) structure detection mechanisms (structured vs. scrambled). It is in this sense that we will use the term face specific in the text that follows. For this purpose, orientation and contrast inverted faces are better comparisons than non-face object categories because they share the same low-level characteristics and structure as upright faces (i.e., rounded shape and internal features). 
It should be noted that these behavioral effects of inversion and contrast-reversal have been most often reported in the context of individual face discrimination (i.e., the differentiation of facial identities, e.g., Freire, Lee, & Symons, 2000; Russell, Biederman, Nederhouser, & Sinha, 2007) while the effect of inversion and contrast-reversal on face detection (i.e., the perception of a face as a face) is less well described. Studies that have addressed this issue generally show that inversion or contrast-reversal slows down and reduces face detection accuracy (Garrido, Duchaine, & Nakayama, 2008; Lewis & Edmonds, 2003, 2005; Parkin & Williamson, 1987; Purcell & Stewart, 1986, 1988; Rousselet et al., 2003; VanRullen, 2006) relative to upright faces. 
At the neural level, both inversion (e.g., Kanwisher, Tong, & Nakayama, 1998; Mazard, Schiltz, & Rossion, 2006; Nasr & Tootell, 2012) and contrast-reversal (George et al., 1999; Nasr & Tootell, 2012; Rossion, Dricot, Goebel, & Busigny, 2011; Yue et al., 2013) reduce the amplitude of face-selective fMRI responses and increase the latency of the N170 component (Bentin et al., 1996; Jeffreys, 1993) and of SSVEPs elicited by faces (Liu-Shuang, Norcia, & Rossion, 2014; Rossion, Alonso Prieto, Boremanse, Kuefner, & Van Belle, 2012). However, the interpretation of a reduced response for highly suprathreshold inverted and negative polarity faces is ambiguous: Either the threshold for face detection is elevated for inverted/contrast reversed faces, or the detection threshold is the same for upright and inverted/contrast reversed faces but activation only rises to a lower level as one goes further above threshold. The second aim of this sweep VEP study is to disentangle these two possibilities. By presenting faces with systematically increasing levels of structural integrity, we are able to determine at what level of structure typical and inverted/contrast reversed faces deviate, rather than just quantify differences at the endpoint where face structure is fully visible. Here we use the coherence of the phase spectrum of the images to vary structural integrity. Using this method, we compare detection thresholds, which reflect the amount of information necessary to perceive a face, as well as suprathreshold response functions, which are indicative of how the incoming visual information activates the underlying neural population (e.g., gradually vs. abruptly). 
To pursue the two goals of this study, we used sequences of gradually revealed faces, similarly to Ales et al. (2012), which varied here in orientation and contrast polarity. We then compared the effect of these manipulations on several aspects of the resulting SSVEP response: overall amplitude, amplitude across face visibility, shape of the response function, and response threshold. Based on previous studies, we formulated the following predictions. If our sweep paradigm even partially captures face-specific processing, we should observe a reduced overall amplitude of the 3-Hz response following inversion and contrast-reversal. Importantly, the 6-Hz response, reflecting low-level visual processing, should remain constant across conditions and face visibility levels if there are no general differences in arousal or attention across conditions. Furthermore, if inversion and contrast-reversal affect the amount of face structure information (% phase coherence) necessary to generate a 3-Hz response, we should observe differences between conditions in the estimated face detection thresholds. Alternatively, if rate of activation is the key difference across conditions, we could observe slower suprathreshold response increase for inverted or polarity reversed faces. A combination of both response elevation and changes in the shape of the face-related response function is also possible. 
Methods
Participants
We tested 17 participants (eight males, mean age 23.35 ± 5.73), 15 received monetary compensation and two received course credit. Two participants were excluded due to below chance performance on the behavioral task, one participant was excluded due to amblyopia, and another was excluded due to excessive noise and artifacts in their signal. A total of 13 participants were kept for analyses (seven males, mean age 24.1 ± 6.32). None of the participants reported any history of psychiatric or neurological disorders, and had normal or corrected-to-normal vision. All gave written informed consent according to the guidelines of the Institutional Review Board of Stanford University. 
Stimuli
Stimuli were composed of the same set that was used in the original face detection sweep study (Ales et al., 2012) as well as modified versions of this stimulus set. Detailed information on the creation of the original stimulus set can be found in aforementioned paper and will be briefly summarized here. A set of 15 grayscale faces varying in gender, viewpoint, and size were equalized in terms of their power spectra. Each face was then smoothly embedded at different locations on a background composed of the phase-scrambled average power spectrum (Figure 1A). Hence, all images had the exact same power spectrum. Face sequences were generated by parametrically increasing the phase coherence of the embedded face from 0% to 100% in 5.26% steps. The resulting sequences showed a face gradually emerging from a scrambled background in 20 steps (see Figures 1C & D for an abridged version of the sequence with 10 steps). Complementary 100% scrambled sequences composed of phase-scrambled backgrounds with no faces (20 images) were also created. In both face and scrambled sequences the phase scrambling at each step was newly randomized. For the current experiment, we created three additional stimulus sets based on the original set with (a) inverted faces, (b) negative contrast polarity faces, and (c) inverted negative contrast polarity faces (Figure 1B). Inverted faces were created by rotating the images 180° around the x axis and negative polarity faces were created by inverting the contrast polarity around the mean luminance value of the images (127). The image dimensions were 512 × 512 pixels and subtended 11.44° of visual angle at a distance of 110 cm. Stimuli were shown on an 800 × 600 pixel CRT screen with a 72-Hz refresh rate. 
Figure 1
 
(A) Set of face stimuli used in the experiment. Faces differed in terms of gender, location, viewpoint, and size. (B) The different conditions of the study. (C) and (D) Schematic illustration of the sweep sequence. Phase-scrambled noise images (0%) alternated with face images whose phase coherence steadily increased (0% to 100%) so that a face appeared to gradually emerge over 20 steps (20 s). At each coherence step, one face image was alternated with one scrambled image three times. (D) An abbreviated version of the sweep sequence with only 10 steps is shown.
Figure 1
 
(A) Set of face stimuli used in the experiment. Faces differed in terms of gender, location, viewpoint, and size. (B) The different conditions of the study. (C) and (D) Schematic illustration of the sweep sequence. Phase-scrambled noise images (0%) alternated with face images whose phase coherence steadily increased (0% to 100%) so that a face appeared to gradually emerge over 20 steps (20 s). At each coherence step, one face image was alternated with one scrambled image three times. (D) An abbreviated version of the sweep sequence with only 10 steps is shown.
Procedure
We presented five types of sweep sequences in the experiment: upright positive polarity faces, inverted positive polarity faces, upright negative polarity faces, inverted negative polarity faces, and scrambled images (Figure 1B). With the exception of the scrambled condition, each sweep sequence consisted of images from the scrambled sequence alternating with images from the face sequence at a rate of 3 Hz (6 images/s; Figure 1C). At each coherence step, a face and a scrambled image were repeated three times. In the scrambled condition, only scrambled images were shown (two different scrambled images per second). Sequences lasted 20 s, with one extra second of stimulation at the start and the end of the sequence (repetitions of the first and last steps, respectively) to exclude event-related potentials generated by the abrupt onset and offset of images. The 15 faces were shown once in each condition (15 × 5 = 75 sequences). The 75 sweep sequences were presented in pseudo-random order and the total duration of the experiment was 28 min, with short breaks every 10 min. Participants were instructed to fixate on a central fixation cross and to respond with a gamepad as rapidly and accurately as possible whenever they detected a face appearing in the sequence. They were informed that faces could appear at any location and with different viewpoints but that not all sequences contained faces. The experimenter verified that the instructions were well understood before starting the experiment. 
EEG acquisition
EEG was acquired with a 128-channel Hydrocell Geodesic Sensor Net (Electrical Geodesics Inc., Eugene, OR, USA) at a sampling rate of 432 Hz. Electrode impedances were reduced below 60 kΩ priori to recording and readjusted during breaks. The data was band-pass filtered offline (0.3–50 Hz) and preprocessed with a custom software (PowerDiva). First, artifact rejection was applied by replacing channels containing more than 15% of data points exceeding a threshold of 30 μV with the average of their six neighboring channels. EEG data was then rereferenced to the average of all channels. Further artifact rejection consisted of excluding 1 s epochs on a channel-by-channel basis if they contained more than 10% of samples exceeding 30 μV. Entire 22-s trials were rejected if they contained blinks (> 7 channels exceeding 60 μV). For the SSVEP analysis, the first and last seconds were excluded. 
Behavioral data analysis
Button press response times were converted into units of phase coherence by subtracting one second ( = one step) and multiplying them by 5.26% (since at the first step, the coherence is at 0%). These estimated detection thresholds were not corrected for delays in the participants' decision or motor response generation. Accuracy and detection thresholds were recorded and averaged both per participant and per face exemplar. Effects of conditions were assessed via repeated measures analyses of variance (ANOVAs). A Greenhouse-Geisser correction was used to adjust degrees of freedom whenever the assumption of sphericity was violated. The behavioral detection thresholds were then correlated with their respective neural detection thresholds to investigate the relationship between these two measures. 
SSVEP analysis
The SSVEPs were analyzed in two ways. First, a discrete Fourier Transform was applied to average data across the entire trial to extract the amplitude of the overall SSVEP response in each condition for individual participants. These values were grand averaged in the frequency domain to compute group-level frequency spectra. This analysis was used to assess the overall presence of 3-Hz responses reflecting face detection and of 6-Hz responses reflecting low-level visual processes. To isolate channels that were specifically involved in face processing, we computed an index of the 3-Hz response (3 Hz/3 Hz + 6 Hz). Based on the spatial distribution of face-related responses, we then selected the channels composing regions of interest (ROIs) for further analyses. 
Second, 3-Hz and 6-Hz response profile as a function of stimulus coherence were computed by a recursive least squares filter (RLS; Tang & Norcia, 1995). Compared to computing a discrete Fourier transform analysis on each step separately, the RLS method adaptively estimates the response phase from the recorded data, with a resulting improvement of SNR of 3 dB. To test for differences between conditions across each coherence level, we ran a permutation test against zero difference (null hypothesis) with all possible pairwise comparisons between conditions throughout all coherence levels. For each pairwise comparison, 213 total within-subject permutations of condition labels were carried out at every coherence level and a distribution of mean differences was created. Differences between conditions in the actual data were considered as significant if they were situated among the 5% extreme values in the distribution (one-tailed) and if the difference persisted over at least three consecutive coherence levels. 
To determine the onset of the 3-Hz response relative to background EEG activity, i.e., the neural face detection threshold, we used the difference between integrated signal and noise functions (see Ales et al., 2012; see Figure 2). The signal was the cumulatively summed 3-Hz amplitude across the sweep sequence. Noise was the mean amplitude at two frequencies adjacent to 3 Hz (2.5 Hz and 3.5 Hz) averaged across the entire sequence and cumulatively summed 20 times. The cumulative amplitudes were normalized to the maximum value of the signal, thus reducing the range to 0%–100%. The normalized signal and noise functions were subtracted and a hinge function was fitted to the difference using a nonlinear least-square curve fitting algorithm (Levenberg-Marquardt) as implemented by the curve_fit method in the scipy Python toolbox. The hinge function was defined as a continuous piecewise linear function made of two parts that transition at a certain value of x, the first one being constant and the second one being linearly increasing. The onset of the 3-Hz response was defined as the inflection point of the hinge function. In case of a negative signal-noise difference, the threshold was set to 100% coherence (no face detection). These modified thresholds can be seen on Figure 9B (gray data points). In other cases when the algorithm's estimate was unrealistic (i.e., < 10% coherence or negative coherence value), thresholds were manually set according to visual inspection (coherence at which the longest increasing segment of the difference function began rising above zero; see Supplementary Table). This second adjustment was applied to one participant in the left occipito-temporal ROI and seven face exemplars, four in the left occipito-temporal ROI (one for upright positive polarity faces and three for inverted negative polarity faces) and three in the right occipito-temporal ROI (one for upright positive polarity faces and two for inverted positive polarity faces). Overall, 92% of original threshold estimates were kept. This analysis was applied both across participants (averaged across 15 trials) and across face exemplars (averaged across 13 participants). 
Figure 2
 
Schematic illustration of the estimation procedure of the 3-Hz response threshold. The amplitude was extracted at every coherence step at 3 Hz, representing the signal of interest (face detection), and at two adjacent frequencies (2.5 Hz and 3.5 Hz), representing the background EEG noise (far left). Both signal and noise were cumulatively summed and then normalized relative to the maximal value of the signal (middle). The difference between the signal and noise function (far right) can be used to estimate the stimulus value needed for response onset by fitting a hinge function to the data. The inflection point of the hinge function is then considered as the threshold of face detection.
Figure 2
 
Schematic illustration of the estimation procedure of the 3-Hz response threshold. The amplitude was extracted at every coherence step at 3 Hz, representing the signal of interest (face detection), and at two adjacent frequencies (2.5 Hz and 3.5 Hz), representing the background EEG noise (far left). Both signal and noise were cumulatively summed and then normalized relative to the maximal value of the signal (middle). The difference between the signal and noise function (far right) can be used to estimate the stimulus value needed for response onset by fitting a hinge function to the data. The inflection point of the hinge function is then considered as the threshold of face detection.
Results
Behavior
Mean behavioral detection thresholds derived from the button press task and expressed as percent coherence are shown on Figure 3. Mean accuracy rates are reported in Table 1. Both participant and face exemplar data show a decline in performance according to orientation and contrast polarity manipulation. Upright positive polarity faces were detected most rapidly, followed by inverted positive polarity faces then upright negative polarity faces. The combined effects of inversion and contrast polarity reversal caused the longest response latency. This exact pattern was present in 9 out of 13 participants and in 10 out of 15 face exemplars. A 2 × 2 repeated measures ANOVA with Orientation (upright vs. inverted) and Polarity (positive vs. negative) confirmed additive effects of these manipulations on response times for both participant, Orientation: F(1, 12) = 25.6, p < 0.001, η2 = 0.68; Polarity: F(1, 12) = 130.38, p < 0.001, η2 = 0.92, and face exemplar analyses, Orientation: F(1, 14) = 16.34, p < 0.001, η2 = 0.54; Polarity: F(1, 14) = 100.35, p < 0.001, η2 = 0.88. There were no significant Orientation × Polarity interactions, participant analysis: F(1, 12) = 0.42, p = 0.53, η2 = 0.03; face exemplar data: F(1, 14) = 0.83, p = 0.38, η2 = 0.06. For accuracy, there was a significant main effect of Polarity for participant analysis, F(1, 12) = 5.66, p < 0.035, η2 = 0.32, reflecting decreased detection rates for negative polarity faces. The same trend was visible for the face-exemplar analysis, F(1, 14) = 4.38, p = 0.055, η2 = 0.24. There were no effects of Orientation, participant analysis: F(1, 12) = 1.68, p = 0.22, η2 = 0.12; face-exemplar analysis: F(1, 14) = 3.03, p = 0.1, η2 = 0.12, nor any Orientation × Polarity interactions, participant analysis: F(1, 12) = 0.42, p = 0.53, η2 = 0.03; face-exemplar analysis: F(1, 14) = 1.37, p = 0.26, η2 = 0.1, for accuracy. 
Figure 3
 
Face detection thresholds for each participant (A) and each face exemplar (B) across conditions (left), and the corresponding group means with their SEM (right). Detection threshold increased with inversion and polarity inversion and this pattern was consistent both across participants and face-exemplars.
Figure 3
 
Face detection thresholds for each participant (A) and each face exemplar (B) across conditions (left), and the corresponding group means with their SEM (right). Detection threshold increased with inversion and polarity inversion and this pattern was consistent both across participants and face-exemplars.
Table 1
 
Response accuracy rates (Mean ± SEM). Notes: Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity.
Table 1
 
Response accuracy rates (Mean ± SEM). Notes: Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity.
Up +Pol Inv +Pol Up −Pol Inv −Pol Scrambled
Participants 0.96 (0.02) 0.95 (0.02) 0.92 (0.02) 0.89 (0.03) 0.85 (0.06)
Face exemplars 0.96 (0.01) 0.95 (0.02) 0.92 (0.03) 0.89 (0.03) 0.84 (0.03)
Overall sweep VEP responses
There were consistent 3-Hz responses in all face conditions but not in the scrambled condition, whereas 6-Hz responses, corresponding to general low-level responses to the general visual stimulation, were present in all conditions (Figure 4). The representative frequency spectra at three channels (58/P7, 75/Oz, 96/P8) with peak SSVEP responses are shown on Figure 5. The topographical distribution of the 3-Hz and 6-Hz responses were clearly distinct (Figure 4). Activity at 3 Hz was spread bilaterally along the occipital and occipito-temporal regions and decreased as the faces were inverted and contrast reversed. By contrast, the 6-Hz responses were focally located on medial occipital electrodes and did not differ between conditions. In order to better isolate the topography of face-related responses, we calculated a 3-Hz index (3Hz/(3 Hz + 6 Hz)). The resulting topographical maps of this index highlighted the implication of bilateral occipito-temporal regions in face detection (Figure 4, bottom). Based on these scalp topographies, we created three regions of interest (ROIs) among posterior occipito-temporal channels in order to compare the magnitude of 3-Hz and 6-Hz responses: right occipito-temporal (channels 90/PO8, 91/P6, 95/PPO10h, 96/P8), left occipito-temporal (channels 58/P7, 59/P5, 64/PPO9h, 65/PO7), and medial occipital (channels 70/Oz, 71/POO3h, 75/O1, 76/POO4h, 83/O2). These channels consistently showed the largest relevant responses across participants and conditions (see Figure 6 for the position of these channels and Supplementary Figure 1 for individual participant data). Statistical testing was then carried out separately for 3-Hz and 6-Hz responses at their respective ROIs. 
Figure 4
 
Topography of SSVEP responses across conditions. A 3-Hz response is present in all face conditions and is distributed along the posterior and occipito-temporal regions, with a right hemisphere dominance that is most evident in the upright positive polarity condition. The amplitude of the 3-Hz response is decreased with inversion and more severely with polarity inversion. The 6-Hz response is similarly localized around the medial occipital region in all conditions. The topography of the 1F index, representing the proportion of face-specific responses at each channel, isolates the contribution of the lateral occipito-temporal channels.
Figure 4
 
Topography of SSVEP responses across conditions. A 3-Hz response is present in all face conditions and is distributed along the posterior and occipito-temporal regions, with a right hemisphere dominance that is most evident in the upright positive polarity condition. The amplitude of the 3-Hz response is decreased with inversion and more severely with polarity inversion. The 6-Hz response is similarly localized around the medial occipital region in all conditions. The topography of the 1F index, representing the proportion of face-specific responses at each channel, isolates the contribution of the lateral occipito-temporal channels.
Figure 5
 
Frequency spectra of channels 58/P7, 75/Oz, and 96/P8 showing the largest 3-Hz and 6-Hz responses across conditions. Note that although a 3-Hz response is present on all channels in face conditions, the 6-Hz response is largely reduced on bilateral occpito-temporal channels (58 and 96) compared to the medial occipital channel (75). In the scrambled condition, only a 6-Hz response is present.
Figure 5
 
Frequency spectra of channels 58/P7, 75/Oz, and 96/P8 showing the largest 3-Hz and 6-Hz responses across conditions. Note that although a 3-Hz response is present on all channels in face conditions, the 6-Hz response is largely reduced on bilateral occpito-temporal channels (58 and 96) compared to the medial occipital channel (75). In the scrambled condition, only a 6-Hz response is present.
Figure 6
 
(A) Mean amplitude difference (± SEM) between right and left occipito-temporal ROIs across face conditions. (B) Amplitude difference between right and left occipito-temporal ROIs averaged across contrast polarities in individual participants. A larger right-lateralized response in the positive compared to the negative polarity condition was present for 10/13 participants.
Figure 6
 
(A) Mean amplitude difference (± SEM) between right and left occipito-temporal ROIs across face conditions. (B) Amplitude difference between right and left occipito-temporal ROIs averaged across contrast polarities in individual participants. A larger right-lateralized response in the positive compared to the negative polarity condition was present for 10/13 participants.
A repeated-measures ANOVA on the 6-Hz response amplitude in the occipital ROI with Condition (face conditions and scrambled) as within-subject factor showed a significant effect of Condition, F(4, 48) = 4.31, p < 0.005, η2 = 0.26. This was due to higher amplitudes in the scrambled compared to the face conditions. However, within face conditions, the ANOVA did not reveal any significant differences, F(3, 36) = 1.07, p = 0.37, η2 = 0.08. Hence, the general processing of low-level visual features did not differ across face conditions and cannot account for the differences of face-related 3-Hz responses. 
A 2 × 5 repeated measures ANOVA on the 3-Hz response amplitude with ROI (left vs. right occipito-temporal) and Condition (upright positive polarity face, inverted positive polarity face, upright negative polarity face, inverted negative polarity face, and scrambled) as within-subject factors showed a significant main effect of Condition, F(2.13, 25.51) = 36.65, p < 0.0001, η2 = 0.77, as well as a significant ROI × Condition interaction, F(4, 48) = 2.92, p < 0.031, η2 = 0.20. The 3-Hz response was larger in all face conditions compared to the scrambled condition. The ROI × Condition interaction was due to the larger amplitude over the right than the left hemisphere for upright faces, as previously found (Ales et al., 2012) as well as smaller amplitudes in the right relative to the left ROI with face inversion and polarity reversal. Based on these results, we ran a more detailed 2 × 2 × 2 repeated-measures ANOVA on face conditions only with ROI (left vs. right occipito-temporal), Orientation (upright vs. inverted), and Polarity (positive vs. negative) as within-subject factors. There were significant main effects of Orientation, F(1, 12) = 15.56, p < 0.002, η2 = 0.57, Polarity, F(1, 12) = 28.97, p < 0.001, η2 = 0.71, as well as a significant ROI × Polarity interaction, F(1, 12) = 5.56, p < 0.036, η2 = 0.32. The 3-Hz response amplitudes were larger for upright compared to inverted faces and for positive compared to negative polarity faces. The lack of Orientation × Polarity interaction, F(1, 12) = 2.68, p = 0.13, η2 = 0.18, suggests that the effects were mainly additive. The ROI × Polarity interaction was due to stronger right lateralization (i.e., larger response in the right than the left ROI) for positive polarity faces compared to negative polarity faces (pairwise t-test on right-left difference: t(12) = 2.36, p < 0.018; see Figure 6). This difference was present in 10/13 participants. There was no main effect of ROI, F(1, 12) = 0.14, p = 0.72, η2 = 0.01, nor any ROI × Orientation interaction, F(1, 12) = 1.20, p = 0.30, η2 = 0.09. 
In summary, EEG data show that face detection performance and its related neural response decrease when face orientation and contrast polarity are manipulated. The general pattern of results suggests that the detrimental effects are amplified additively. It is noteworthy that the effect of contrast polarity inversion was larger than the effect of orientation inversion in both behavioral and frequency analyses (i.e., partial η2 of the main ANOVA effects). This observation suggests that contrast polarity plays a more important role than picture-plane orientation in face detection. To determine to which extent the reduced neural response reflects overall weaker activity and/or increased response threshold, we next examined the evolution of the 3-Hz response across the sweep sequence. Additionally, we investigated the correlation between neural and behavioral response latencies. Given the topography of the face-related response, we focused our analyses on the bilateral occipito-temporal regions. 
Sweep VEP responses as a function of stimulus visibility
As can be seen in Figure 7, the amplitude of the 3-Hz response increases as a function of face visibility while the 6-Hz response function remains stable across face coherence levels. This distinction further supports the notion that the 3-Hz response represents coherence-dependent face detection processes while the 6-Hz response reflects the constant low-level visual input that is equalized across conditions. Accordingly, the 3-Hz response differs between conditions on several aspects while the 6-Hz response does not. Although all face conditions elicited a rising 3-Hz response, this response varies in terms of absolute amplitude, slope, and onset. 
Figure 7
 
Sweep response functions in the left and right occipito-temporal ROIs across conditions (see legend) for group means (± SEM) averaged across participants at 3 Hz and 6 Hz. While the 6-Hz amplitude remains stable throughout the sweep sequence, the 3-Hz amplitude shows abrupt increases, reflecting face detection. The 3-Hz response functions differ in terms of onset, absolute amplitude, and shape across conditions, especially in the right hemisphere.
Figure 7
 
Sweep response functions in the left and right occipito-temporal ROIs across conditions (see legend) for group means (± SEM) averaged across participants at 3 Hz and 6 Hz. While the 6-Hz amplitude remains stable throughout the sweep sequence, the 3-Hz amplitude shows abrupt increases, reflecting face detection. The 3-Hz response functions differ in terms of onset, absolute amplitude, and shape across conditions, especially in the right hemisphere.
In line with mean response amplitudes, visual inspection reveals that upright positive polarity faces elicit the largest 3-Hz response in both regions, followed by inverted positive polarity faces. Negative polarity faces show the lowest response, which did not vary between orientations. This order was present mainly at low and intermediate levels of face coherence (≈30%–80%). At higher coherence levels, amplitude values tended to converge. Furthermore, this pattern was more salient and was also more consistent across participants and face exemplars (i.e., smaller SEM) in the right compared to the left occipito-temporal region. We ran pairwise permutations test in order to determine significant deviations between response functions. Results are summarized on Figure 8. In the right occipito-temporal region, upright positive polarity faces showed significantly larger amplitudes than inverted positive polarity faces for a large part of the sequence and negative polarity faces from around 32% until approximately the end of the sequence. Inverted positive polarity faces also diverged from negative polarity faces for a large part of the sequence. In the left occipito-temporal region however, differences between conditions were less robust, with smaller amplitude differences and fewer consecutive significant differences. Consistently across both hemispheres, responses for negative polarity faces overlapped throughout nearly all coherence levels, regardless of orientation. 
Figure 8
 
Significant differences between conditions throughout all 20 coherence levels indicated by permutation tests for the bilateral occipito-temporal ROIs. The color-scale refers to the p value of the difference. Crossed out rectangles indicate differences that did not meet our consecutivity criterion (minimum three consecutive significant differences). Differences between conditions were more salient in the right compared to the left occipito-temporal ROI.
Figure 8
 
Significant differences between conditions throughout all 20 coherence levels indicated by permutation tests for the bilateral occipito-temporal ROIs. The color-scale refers to the p value of the difference. Crossed out rectangles indicate differences that did not meet our consecutivity criterion (minimum three consecutive significant differences). Differences between conditions were more salient in the right compared to the left occipito-temporal ROI.
Aside from the magnitude of the 3-Hz response, its profile also varied across conditions. For upright positive polarity faces, the 3-Hz amplitude behaved in a step-like manner, with an abrupt onset followed by a constant level of activation. This pattern was also present in the other face conditions but with the initial response increase being more gradual and linear before reaching a plateau. For instance, in the right occpito-temporal region, upright positive polarity faces elicited a sharp 3-Hz increase around ≈30% coherence before saturating around ≈40% coherence. In comparison, response to upright negative polarity faces emerged a little later around ≈35% coherence and continued to increase until approximately ≈80% coherence. Once again, differences it terms of the slope of the response function were more evident in the right compared to the left hemisphere. A potential cause for the shallower slopes for inverted and negative polarity faces may be a larger variation in the onset of the 3-Hz response, such that step-like increases are smoothed when averaged (see Supplementary Figure 2). 
To investigate this possibility, we estimated the onsets of the face-related response using cumulatively summed data (see Methods). Table 2 shows the mean goodness-of-fit values of the hinge function used to estimate the detection thresholds. Additionally, we also tested whether neural face detection was correlated with behavioral face detection, either by considering the data in a participant-wise (i.e., variation between participants) or face exemplar-wise manner (i.e., variation between stimuli). The mean response threshold in the bilateral occipito-temporal ROIs for both participant and face exemplar analyses are shown on Figure 9A (the differential cumulative sum function that were used are depicted on Supplementary Figure 3 and individual participant and face exemplar response functions can be seen on Supplementary Figure 4). In accordance with the visual observation of sweep response profiles, the quantified response thresholds increased with inversion and contrast-reversal in both right and left occipito-temporal ROIs. 
Figure 9
 
(A) Mean estimated 3-Hz response onset, i.e., face detection threshold (± SEM) the in left (LOT) and right (ROT) occipito-temporal ROIs in each face condition for participant and face exemplar analyzed data. (B) Scatterplots depicting the correlations between neural and behavioral face detection thresholds for participants (top) and face exemplar (bottom) data in each face condition. Significant correlations are marked with an asterisk (* = p < 0.05; ** = p < 0.01). Grayed data points represent participants or face exemplars for whom a detection response was not present.
Figure 9
 
(A) Mean estimated 3-Hz response onset, i.e., face detection threshold (± SEM) the in left (LOT) and right (ROT) occipito-temporal ROIs in each face condition for participant and face exemplar analyzed data. (B) Scatterplots depicting the correlations between neural and behavioral face detection thresholds for participants (top) and face exemplar (bottom) data in each face condition. Significant correlations are marked with an asterisk (* = p < 0.05; ** = p < 0.01). Grayed data points represent participants or face exemplars for whom a detection response was not present.
Table 2
 
Goodness-of-fit measures for the hinge function used to estimate neural face detection thresholds (Mean ± SEM). Note. Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity; RMSE = root mean squared error (smaller values indicate better fit).
Table 2
 
Goodness-of-fit measures for the hinge function used to estimate neural face detection thresholds (Mean ± SEM). Note. Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity; RMSE = root mean squared error (smaller values indicate better fit).
Up +Pol Inv +Pol Up −Pol Inv −Pol
R2 RMSE R2 RMSE R2 RMSE R2 RMSE
Participants 0.98 (0.01) 0.095 (0.012) 0.95 (0.02) 0.084 (0.007) 0.94 (0.02) 0.104 (0.010) 0.87 (0.03) 0.111 (0.009)
Face exemplars 0.93 (0.03) 0.088 (0.008) 0.90 (0.03) 0.096 (0.009) 0.84 (0.06) 0.114 (0.008) 0.83 (0.05) 0.110 (0.008)
To verify whether the hinge function was equally well fitted across conditions, we ran 2 × 2 × 2 repeated measures ANOVAs on the RMSE values with ROI (left vs. right occipito-temporal), Polarity (positive vs. negative), and Orientation (upright vs. inverted) as within-subject factors. RMSE values were used because R2 was near ceiling in some conditions. For participant analyses, there was a significant main effect of ROI, F(1, 12) = 9.46, p < 0.01, η2 = 0.44, due to better fits in the right than the left occipito-temporal ROI. There was a trend for an effect of Polarity, F(1, 12) = 4.29, p = 0.06, η2 = 0.26, suggesting better fits for positive comparted to negative polarity faces. No other main effect, Orientation: F(1, 12) = 0.07, p = 0.8, η2 = 0.01, nor interactions were significant, Orientation × Polarity: p = 0.22; Orientation × ROI: p = 0.53; Polarity × ROI: p = 0.79; Orientation × Polarity × ROI: p = 0.18. For face exemplars, there was only a main effect of Polarity indicating better fits for positive relative to negative polarity faces, F(1, 14) = 16.03, p < 0.001, η2 = 0.53. All other effects were nonsignificant, Orientation: p = 0.80; ROI: p = 0.99; Orientation × Polarity: p = 0.32; Orientation × ROI: p = 0.1; Polarity × ROI: p = 0.80; Orientation × Polarity × ROI: p = 0.80. These results suggest that thresholds for negative polarity faces need to be interpreted with caution. 
For the participant analyses, a 2 × 2 × 2 repeated-measures ANOVA with ROI (left vs. right occipito-temporal), Orientation (upright vs. inverted), and Polarity (positive vs. negative) as within-subject factors showed main effects of Orientation, F(1, 12) = 14.1, p < 0.003, η2 = 0.54, and Polarity, F(1, 12) = 20.43, p < 0.001, η2 = 0.63, but not ROI, F(1, 12) = 1.64, p = 0.23, η2 = 0.12. Neural face detection thresholds followed the same pattern as behavioral thresholds with the lowest thresholds for upright positive polarity faces, followed by inverted positive polarity faces, upright negative polarity faces, and, finally, inverted negative polarity faces. The effects were additive as there was no Orientation × Polarity interaction, F(1, 12) = 1.25, p = 0.29, η2 = 0.09. There were some trends towards interactions between ROI × Polarity, F(1, 12) = 4.58, p = 0.053, η2 = 0.28, and between ROI × Orientation × Polarity, F(1, 12) = 3.91, p = 0.071, η2 = 0.25. These near-significant interactions were due to increased thresholds for inverted negative polarity faces in the left compared to the right occipito-temporal region. In the other conditions, thresholds were equivalent across hemispheres. The ROI × Orientation interaction was nonsignificant, F(1, 12) = 2.15, p = 0.17, η2 = 0.15. 
For face exemplar analyses, the same ANOVA also showed main effects of Orientation, F(1, 14) = 6.84, p < 0.02, η2 = 0.33, and Polarity, F(1, 14) = 9.08, p < 0.009, η2 = 0.39, as well as trends towards interactions between Orientation × Polarity, F(1, 14) = 4.18, p = 0.06, η2 = 0.23, and ROI × Polarity, F(1, 14) = 4, p = 0.065, η2 = 0.22. There was no main effect of ROI, F(1, 14) = 1.78, p = 0.20, η2 = 0.11, nor any ROI × Orientation, F(1, 14) = 2.23, p = 0.16, η2 = 0.14, or Orientation × Polarity × ROI interactions, F(1, 14) = 2.34, p = 0.15, η2 = 0.14. The main effects reflected the same pattern as the participant analysis. However, here the interactions suggested no threshold differences between upright and inverted polarity faces in the left occipito-temporal region and increased thresholds to inverted negative polarity faces in the right but not the left hemisphere. Overall, the patterns were the most consistent in the right hemisphere across subject-wise and face exemplar analyses. Statistical comparison did indeed not reveal effects of Analysis-type on the threshold patterns in the right occipito-temporal region, F(1, 12) = 1.26, p = 0.28, η2 = 0.1. 
Given that the 3-Hz response onsets paralleled the response time data, we calculated the correlations between the neural and behavioral face detection thresholds (see Figure 9B). For participant analyses, there were low to modest correlations in the right occipito-temporal ROI especially, with only the correlation for inverted negative polarity faces reaching significance. The same analysis taking into account the individual participant's peak ROI for the 3-Hz response did not improve correlations. Instead, these decreased and were not significant (upright positive polarity = 0.33; inverted positive polarity = 0.02; upright negative polarity = 0.41; inverted negative polarity = 0.16). Filtering data according to correct detection responses did not change the pattern of correlations either. 
Correlations for face exemplar data were higher and present in both hemispheres, with significant neural–behavioral correlations for both upright face conditions. Selecting the best ROI for each trial did improve correlations for all conditions except for inverted negative polarity faces (upright positive polarity = 0.75, p < 0.001; inverted positive polarity = 0.57, p < 0.025; upright negative polarity = 0.72, p < 0.002; inverted negative polarity = 0.1, p = 0.73). Using only correct responses did not change the overall pattern but did reveal a significant correlation for inverted negative polarity faces (r = 0.54, p < 0.038). 
Discussion
Summary of results
We investigated the effects of orientation and contrast polarity inversion on face detection using a sweep VEP paradigm, which provides objectively defined and high signal-to-noise ratio responses in a limited number of trials (Ales et al., 2012; Norcia & Tyler, 1985; Regan, 1973; see Almoqbel, Leat, & Irving, 2008, for a review). 
Our first aim was to test whether the sweep face detection response defined by Ales et al. (2012) reflected high-level visual processes, at least partially specific to faces. This was indeed the case as a larger response was recorded to upright than inverted and contrast-reversed faces. Moreover, there were no differences between face conditions at the 6-Hz presentation frequency, which reflects general low-level processes. In this context, it is important to note that the stimuli used here were fully equalized in terms of their power spectrum and mean luminance. This is not the case in most studies that have used Caucasian faces and manipulated contrast polarity: mean luminance is not controlled so that negative polarity faces are darker than their positive counterpart and thus a comparison between positive and negative polarity faces is biased (Bruce & Langton, 1994; Farroni et al., 2005; Galper, 1970; Itier & Taylor, 2002; Nasr & Tootell, 2012; Nederhouser et al., 2007; Ohayon, Freiwald, & Tsao, 2012; Otsuka, Hill, Kanazawa, Yamaguchi, & Spehar, 2012; Russell, Sinha, Biederman, & Nederhouser, 2006; Taubert & Alais, 2011; Vuong et al., 2005; Yue, Nasr, Devaney, Holt, & Tootell, 2013; see George et al., 1999; Liu, Collin, Burton, & Chaudhuri, 1999; Tomalski & Johnson, 2012, for controlled stimuli). Furthermore, since SSVEP responses are sensitive to attention (e.g., Morgan, Hansen, & Hillyard, 1996), especially over medial occipital sites where the 6-Hz response is prominent (Müller et al., 2006; Pei, Pettet, & Norcia, 2002), the lack of differences between conditions suggest that there were no general differences in allocation of attentional resources across conditions. 
Our second aim was to examine how the face detection process was affected by these two image manipulations (picture-plane inversion and contrast-reversal). Behaviorally, more face structure was necessary for participants to detect inverted and contrast-reversed faces (≈5%–15% additional coherence) compared to upright normal faces. Several factors appear to account for the behavioral effects. First, face detection responses on bilateral occipito-temporal regions decreased in amplitude for inverted and contrast-reversed faces. The response profile as a function of face image coherence indicates that this effect was largely sustained throughout the stimulation sequence. Second, the estimated face detection thresholds increased with inversion and contrast-reversal. Third, the response function was shallower for inverted and contrast-reversed faces than typical faces. Our results show that impaired face detection can be attributed to the combination of elevated detection threshold and inefficient activation of neural populations. 
Upright positive polarity face detection
The detection of upright positive polarity faces varying in position, viewpoint, gender, and size was associated with an abrupt increase at the face presentation frequency (3 Hz) over the right occipito-temporal region around channel 96/P8. The onset of the 3-Hz response, occurred on average at a coherence level of ≈35% and quickly saturated at suprathreshold levels (≈40%). Behaviorally, performance was near ceiling and the average detection threshold was around 42%. Our findings thus replicate the results from the original face detection sweep study (Ales et al., 2012). Interestingly, the two sets of data were comparable despite a large difference in the proportion of face trials in each experiment (1/3 face trials–2/3 scrambled trials in Ales et al., 2012 vs. 4/5 face trials–1/5 scrambled trials in the present experiment). The role of expectation in generating this precise response profile and threshold therefore appears to be limited. 
The step-like response profile is consistent with previous ERP studies that parametrically varied the phase coherence of face images and measured the N170 face-sensitive component (Philiastides & Sajda, 2006; Rousselet et al., 2008). Responses also rose around similar coherence levels (30% in Rousselet et al., 2008; 35% in Philiastides & Sajda, 2006, though in this case the range was restricted to 30%–45% phase-coherence), despite using a different approach of phase scrambling (weighted mean phase, Dakin et al., 2002). Response functions like these indicate that detection of normal faces is categorical in nature: face versus nonface. 
Several mechanisms are thought to underlie efficient face detection in natural scenes. Some authors have suggested that the typical amplitude spectrum present in human faces provides enough information for face detection (Crouzet & Thorpe, 2011; Honey et al., 2008). However, since this property is equalized across all images as in our study, it cannot drive a neural face-detection response (see also Rousselet et al., 2008). Midlevel properties such as local shape and edge information also play a part in face detection, but again these factors are not sufficient (Honey, Kirchner, & VanRullen, 2008; Rousselet et al., 2008). While the eyes are important for fast face detection (Burton & Bindemann, 2009; Lewis & Edmonds, 2003), the absence of clearly defined facial features does not necessarily hinder face perception (e.g., Caharel et al., 2013; George et al., 2005). Face detection probably relies on a combination of visual properties summarized within a face template with which the visual input is compared (Perrett, Oram, & Ashbridge, 1998; Rossion & Boremanse, 2008; Rousselet et al., 2003). Such a template is likely to be based both on biological constraints (Morton & Johnson, 1991; Turati, Simion, Milani, & Umiltà, 2002) and visual experience, so that only upright positive polarity faces can match this template. 
Effects of orientation and contrast polarity on face detection
Inverted and negative polarity faces are unusual for the visual system and because of this the brain cannot rely on a pre-existing internal template. The lack of such a template may then lead to the need for more structure (phase coherence) in the stimulus in order for a differential response to be generated. We found a significant threshold increase of the 3-Hz response for inverted (≈9% additional coherence on average) and negative polarity faces (14%–20% additional coherence) relative to normal upright faces. Moreover, even after detection was achieved, the responses still differed from normal upright faces in terms of their overall amplitude and response profile. 
The decrease of response amplitude at supratheshold coherence values was especially salient on right occipito-temporal channels and lasted throughout the entire sequence for negative polarity faces. Response amplitudes for inverted faces eventually converged with those of upright faces at higher coherence levels. Previous studies have consistently reported reduced neural activity to inverted (e.g., Haxby et al., 1999; Kanwisher et al., 1998; Mazard et al., 2006; Nasr & Tootell, 2012) and negative polarity faces (e.g., George et al., 1999; Nasr & Tootell, 2012; Yue et al., 2013) in face-selective regions. In transient ERP studies by contrast, these manipulations generally evoke a paradoxical increase in the N170 amplitude (e.g., Eimer, 2000; Itier & Taylor, 2002; Rossion et al., 1999; Sadeh & Yovel, 2010). However, a reduction of the N170 amplitude for inverted faces can be observed when face stimuli are degraded by masking the features with noise (Linkenkaer-Hansen et al., 1998; Schneider, DeLong, & Busey, 2007), transformed into two-tone images (George et al., 2005) or when the features are schematic/unrealistic (Caharel et al., 2013; Sagiv & Bentin, 2001; but see Tomalski & Johnson, 2012). In these cases, the decrease of N170 amplitude with inversion is interpreted as a failure to perceive the stimulus as a face (Rossion & Jacques, 2011). Interestingly, Schneider et al. (2007) parametrically varied the visibility of phase-scrambled faces and reported an increase of the N170 amplitude with increasing visibility. Critically, amplitudes for inverted faces were smaller relative to upright faces throughout visibility levels. This kind of reasoning can be applied to both our inverted and negative polarity conditions in which facial features were masked by phase scrambling. 
Besides the quantitative differences, the profile of the response amplitude relative to face structure was also different for inverted and negative polarity faces. While the response function was step-like for upright positive polarity faces, it had a shallower slope for inverted and negative polarity faces and levelled off at a higher coherence level (≈75% vs. 40% for normal faces), suggesting that the face-related information is integrated differently in these conditions (Perrett et al., 1998). If we consider the hypothesis of an internal upright positive polarity face template which optimally activates the neural population to saturation point, these modified faces would only partially match the template and therefore gradually activate neural populations and reach saturation level only when there is enough structure to fully match the template. 
Origins of orientation and contrast polarity inversion effects
For picture-plane inversion, it is proposed that faces are processed by suboptimal analytical (feature-based) mechanisms, as opposed to the more efficient holistic processing (integrated perception of multiple facial features) underlying the perception of upright positive polarity faces (Rossion, 2008; Sergent, 1984; Tanaka & Farah, 1993). The effect of contrast polarity inversion seems to stem from a different cue given the relatively intact holistic processing with negative polarity faces (Taubert & Alais, 2011). Some suggest that shape-from-shading cues are distorted with contrast inversion (Kemp, Pike, White, & Musselman, 1996; Lewis & Johnston, 1997; Liu, Collin, & Chaudhuri, 2000) while others underline the role of texture and pigmentation cues (Bruce & Langton, 1994; Nederhouser et al., 2007; Russell et al., 2006). A third alternative postulates that a more global property underlies this effect, namely, the pattern of light and dark regions (Dakin & Watt, 2009; Gilad, Meng, & Sinha, 2008). In a face, the eyes are always darker than the forehead and cheeks, and it is this stable contrast relationship that drives efficient face processing. 
Comparing effects of orientation and contrast polarity inversion
Directly comparing the effects of picture-plane and contrast polarity inversion reveals larger effects of negating contrast polarity. This pattern is present in other studies as well both behaviourally (Bruce & Langton, 1994; Gaspar, Bennett, & Sekuler, 2008; Lewis & Edmonds, 2003) and electrophysiologically (Itier & Taylor, 2002; Rossion et al., 2012), even though contrast-reversed faces were not equated to normal faces in terms of luminance in these studies. An upside-down face may be taken as an extreme case of the range of face orientations normally experienced. However, contrast polarity inversion never occurs in the natural world and would not benefit from the existing template processing. In another sweep VEP study (Liu-Shuang, Ales, Rossion, & Norcia, 2015) with a similar design as the current experiment, the results show that the perception of a positive polarity face dominates that of its negative counterpart when they are directly competing, suggesting that the visual system exclusively uses the information contained in the positive polarity face. These findings suggest a more fundamental role of the contrast pattern in activating face-selective neural populations for face detection. This hypothesis is also supported by infant research showing that infants' preference for faces is inherently dependent on whether the real or schematic face stimulus contains the correct contrast information (Farroni et al., 2005; Otsuka et al., 2012). Additionally, face-selective cells in the monkey infero-temporal cortex show sensitivity to this parameter as well (Ohayon et al., 2012). 
The combined picture-plane and contrast polarity inversion caused the most substantial decrement in behavioral performance and neural response magnitudes. With the exception of the amplitude analysis across coherence levels, the data generally point towards an additive effect of both manipulations. This additivity is also in line with previous evidence (Bruce & Langton, 1994; Gaspar et al., 2008; Itier et al., 2006; Johnston et al., 1992; Lewis & Edmonds, 2003; Rossion et al., 2012). 
Hemispheric lateralization
The face-related SSVEP response at 3 Hz was distributed along the posterior occipito-temporal channels. However, a more detailed examination taking into account its amplitude relative to the non-face-related 6-Hz response revealed activation clusters over bilateral occipito-temporal regions. These scalp topographies correspond to the typical locations of the face-sensitive N170 component (e.g., Bentin et al., 1996; for review see Rossion & Jacques, 2011) and SSVEP responses to sequences of different faces presented below 10 Hz (Alonso-Prieto et al., 2013; Liu-Shuang et al., 2014; Rossion & Boremanse, 2011). However, there were hemispheric differences. Responses were right lateralized for positive polarity faces but bilateral for negative polarity faces, and differences between conditions in terms of response profile and thresholds were more salient in the right hemisphere. Given the dominance of the right hemisphere in face perception and recognition in humans (e.g., Bentin et al., 1996; Hécaen & Angelergues, 1962; Hillger & Koenig, 1991; Kanwisher et al., 1997; Rossion, 2014; Sergent et al., 1992), our data reflect the involvement of specialized face detection processes and underline the magnitude of the disturbance caused by contrast polarity inversion (i.e., not recruiting a dedicated right occipito-temporal face processing network). 
Correlation with behavior
At the behavioral level, our face detection thresholds conform with data from previous studies where a roughly linear increase in response times with inversion and contrast-reversal have been found (e.g., Lewis & Edmonds, 2003). Compared to our previous study (Ales et al., 2012), the correlations between the neural thresholds and behavioral measures were rather weak when considering the variability across participants. In a similar vein, the N170 face-sensitive component was not related to behavioral reaction times in a face detection task with phase-scrambled images (Philiastides, Ratcliff, & Sajda, 2006; Philiastides & Sajda, 2006). These findings suggest that neural signatures of face detection are not strongly related to overt behavioral detection responses, which is understandable when considering the added sources of variability that are present in the behavioral response. Decisional strategies and criteria, as well as delays in motor response preparation and output across individual participants, contribute heavily to interindividual variance in behavioral responses. Correlations were much higher when considering data across individual face stimuli rather than participants. Thus, some faces were consistently detected faster or slower irrespective of individual variations in response speed. In our stimulus set, face n°3 was the most easily detected and face n°13 was the least well detected in all conditions, similar to the original face detection sweep study (Ales et al., 2012). 
Conclusions
In conclusion, our sweep VEP study reveals that orientation and contrast polarity inversion additively impair the face detection process at several levels. First, these manipulations increase behavioral and neural response thresholds. Second, they decrease the overall neural response amplitude over bilateral occipito-temporal regions. Third, contrast inversion also reduces the right hemisphere lateralization that is characteristic of high-level face processing. Overall, this manipulation produces greater effects behaviorally and neurally compared to picture-plane inversion, indicating that contrast polarity may be fundamental for face detection. Finally, with orientation and contrast inversion the suprathreshold response profile as a function of face visibility changes from a step-like function towards a more progressive increase, suggesting that the underlying neural populations require additional face structure information to reach saturation level. 
Acknowledgments
This research was funded by a grant from the European Research Council (facessvep 284025) awarded to B. R. and a travel grant from the Belgian National Scientific Research Fund (A2/5-ROI/JA-1240) awarded to J. L.-S. The authors would like to thank Faraz Farzin and Claudia Arrighi for their help for data acquisition and participant recruitment, Vladimir Vildavski and Corentin Jacques for helpful comments regarding data analysis, and Bastien Gorissen for providing the function fitting scripts. 
Commercial relationships: none. 
Corresponding author: Joan Liu-Shuang. 
Email: joan.liu@uclouvain.be. 
Address: Psychological Sciences Research Institute and Institute of Neuroscience, University of Louvain, Belgium. 
References
Ales J. M. Farzin F. Rossion B. Norcia A. M. (2012). An objective method for measuring face detection using the sweep steady-state visual evoked response. Journal of Vision, 12 (10): 18, 1–18, http://www.journalofvision.org/content/12/10/18, doi:10.1167/12.10.18. [PubMed] [Article]
Allison T. Puce A. Spencer D. D. McCarthy G. (1999). Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cerebral Cortex, 9, 415–430. [CrossRef] [PubMed]
Almoqbel F. Leat S. J. Irving E. (2008). The technique, validity and clinical use of the sweep VEP. Ophthalmic and Physiological Optics, 28, 393–403. [CrossRef] [PubMed]
Alonso-Prieto E. Van Belle G. Liu-Shuang J. Norcia A. M. Rossion B. (2013). The 6Hz fundamental frequency rate for individual face discrimination in the right occipito-temporal cortex. Neuropsychologia, 51, 2863–2975. [CrossRef] [PubMed]
Bentin S. McCarthy G. Perez E. Puce A. Allison T. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 8, 551–565. [CrossRef] [PubMed]
Bruce V. Langton S. (1994). The use of pigmentation and shading information in recognising the sex and identities of faces. Perception, 23, 803–822. [CrossRef] [PubMed]
Burton A. M. Bindemann M. (2009). The role of view in human face detection. Vision Research, 49, 2026–2036. [CrossRef] [PubMed]
Caharel S. Leleu A. Bernard C. Viggiano M.-P. Lalonde R. Rebaï M. (2013). Early holistic face-like processing of Arcimboldo paintings in the right occipito-temporal cortex: Evidence from the N170 ERP component. International Journal of Psychophysiology, 90, 157–164. [CrossRef] [PubMed]
Crouzet S. M. Kirchner H. Thorpe S. J. (2010). Fast saccades toward faces: Face detection in just 100 ms. Journal of Vision, 10 (4): 16, 1–17, http://www.journalfofvision.org/content/10/4/16, doi:10.1167/10.4.16. [PubMed] [Article] [CrossRef] [PubMed]
Crouzet S. M. Thorpe S. J. (2011). Low-level cues and ultra-fast face detction. Frontiers in Psychology, 2, 342. [PubMed]
Dakin S. C. Hess R. F. Ledgeway T. Achtman R. L. (2002). What causes non-monotonic tuning of fMRI response to noisy images? Current Biology, 12, R476–477. [CrossRef] [PubMed]
Dakin S. C. Watt R. J. (2009). Biological “bar codes” in human faces. Journal of Vision, 9 (4): 2, 1–10, http://www.journalofvision.org/content/9/4/2, doi:10.1167/9.4.2. [PubMed] [Article]
Eimer M. (2000). Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. Brain Research, 10, 145–158. [PubMed]
Farah M. J. Wilson K. D. Drain M. Tanaka J. N. (1998). What is “special” about face perception? Psychological Review, 105, 482–498. [CrossRef] [PubMed]
Farroni T. Johnson M. H. Menon E. Zulian L. Faraguna D. Csibra G. (2005). Newborns' preference for face-relevant stimuli: Effects of contrast polarity. Proceedings of the National Academy of Sciences, USA, 102, 17245–17250. [CrossRef]
Freire A. Lee K. Symons L. A. (2000). The face-inversion effect as a deficit in the encoding of configural information: Direct evidence. Perception, 29, 159–170. [CrossRef] [PubMed]
Galper R. E. (1970). Recognition of faces in photographic negative. Psychonomic Science, 19, 207–208. [CrossRef]
Garrido L. Duchaine B. Nakayama K. (2008). Face detection in normal and prosopagnosic individuals. Journal of Neuropsychology, 2, 119–140. [CrossRef] [PubMed]
Gaspar C. M. Bennett P. J. Sekuler A. B. (2008). The effects of face inversion and contrast-reversal on efficiency and internal noise. Vision Research, 48 (8), 1084–1095. [CrossRef] [PubMed]
George N. Dolan R. J. Fink G. R. Baylis G. C. Russell C. Driver J. (1999). Contrast polarity and face recognition in the human fusiform gyrus. Nature Neuroscience, 2 (6), 574–580. [CrossRef] [PubMed]
George N. Jemel B. Fiori N. Chaby L. Renault B. (2005). Electrophysiological correlates of facial decision: Insights from upright and upside-down Mooney-face perception. Cognitive Brain Research, 24, 663–673. [CrossRef] [PubMed]
Gilad S. Meng M. Sinha P. (2008). Role of ordinal contrast relationships. Proceedings of the National Academy of Sciences, USA, 106, 2–7.
Haxby J. V. Hoffman E. A. Gobbini M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4, 223–233. [CrossRef] [PubMed]
Haxby J. V. Ungerleider L. G. Clark V. P. Schouten J. L. Hoffman E. A. Martin A. (1999). The effect of face inversion on actiivty in human neural systems for face and object perception. Neuron, 22, 189–199. [CrossRef] [PubMed]
Hécaen H. Angelergues R. (1962). Agnosia for faces. Archives of Neurology, 7, 92–100. [CrossRef] [PubMed]
Hillger L. A. Koenig O. (1991). Separable mechanisms in face processing: Evidence from hemispheric lateralization. Journal of Cognitive Neuroscience, 3, 42–58. [CrossRef] [PubMed]
Honey C. Kirchner H. VanRullen R. (2008). Faces in the cloud: Fourier power spectrum biases ultrarapid face detection. Journal of Vision, 8 (12): 9, 1–13, http://www.journalofvision.org/content/8/12/9, doi:10.1167/8.12.9. [PubMed] [Article]
Itier R. J. Latinus M. Taylor M. J. (2006). Face, eye and object early processing: What is the face specificity? NeuroImage, 29, 667–676. [CrossRef] [PubMed]
Itier R. J. Taylor M. J. (2002). Inversion and contrast polarity reversal affect both encoding and recognition processes of unfamiliar faces: A repetition study using ERPs. NeuroImage, 15, 353–372. [CrossRef] [PubMed]
Jeffreys D. A. (1989). A face-responsive potential recorded from the human scalp. Experimental Brain Research, 78, 193–202. [CrossRef] [PubMed]
Jeffreys D. A. (1993). The influence of stimulus orientation on the vertex positive scalp potential evoked by faces. Experimental Brain Research, 96, 163–172. [CrossRef] [PubMed]
Jiang F. Dricot L. Weber J. Righi G. Tarr M. J. Goebel R. Rossion B. (2011). Face categorization in visual scences may start in a higher order area of the right fusiform gyrus: Evidence from dynamic visual stimulation in neuroimaging. Journal of Neurophysiology, 106, 2720–2736. [CrossRef] [PubMed]
Johnston A. Hill H. Carman N. (1992). Recognising faces: Effects of lighting direction, inversion, and brightness reversal. Perception, 21, 365–375. [CrossRef] [PubMed]
Kanwisher N. McDermott J. Chun M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302–4311. [PubMed]
Kanwisher N. Tong F. Nakayama K. (1998). The effect of face inversion on the human fusiform face area. Cognition, 68, B1–11. [CrossRef] [PubMed]
Kemp R. Pike G. White P. Musselman A. (1996). Perception and recognition of normal and negative faces: Role of shape from shading and pigmentation. Perception, 25, 37–52. [CrossRef] [PubMed]
Lewis M. B. Edmonds A. J. (2003). Face detection: Mapping human performance. Perception, 32, 903–920. [CrossRef] [PubMed]
Lewis M. B. Edmonds A. J. (2005). Searching for faces in scrambled scenes. Visual Cognition, 12, 1309–1336. [CrossRef]
Lewis M. B. Johnston R. A. (1997). The Thatcher illusion as a test of configural disruption. Perception, 26, 225–227. [CrossRef] [PubMed]
Linkenkaer-Hansen K. Palva J. M. Sams M. Hietanen J. K. Aronen H. J. Ilmoniemi R. J. (1998). Face-selective processing in human extrastriate cortex around 120 ms after stimulus onset revealed by magneto- and electroencephalography. Neuroscience Letters, 253, 147–150. [CrossRef] [PubMed]
Liu C. H. Collin C. A. Burton, A. M., & Chaudhuri, A. (1999). Lighting direction affects recognition of untextured faces in photographic positive and negative. Vision Research, 39 (24), 4003–4009. [PubMed]
Liu C. H. Collin C. A. Chaudhuri A. (2000). Does face recognition rely on encoding of 3-D surface? Examining the role of shape-from-shading and shape-from-stereo. Perception, 29 (6), 729–743. [CrossRef] [PubMed]
Liu-Shuang J. Ales J. M. Rossion B. Norcia A. M. (2015). The effect of contrast polarity reversal on face detection: Evidence of perceptual asymmetry from sweep VEP. Vision Research, 108, 8–19. [CrossRef] [PubMed]
Liu-Shuang J. Norcia A. M. Rossion B. (2014). An objective index of individual face discrimination in the right occipito-temporal cortex by means of fast periodic visual stimulation. Neuropsychologia, 52, 57–72. [CrossRef] [PubMed]
Mazard A. Schiltz C. Rossion B. (2006). Recovery from adaptation to facial identity is larger for upright than inverted faces in the human occipito-temporal cortex. Neuropsychologia, 44, 912–922. [CrossRef] [PubMed]
Morgan S. T. Hansen J. C. Hillyard S. A. (1996). Selective attention to stimulus location modulates the steady-state visual evoked potential. Proceedings of the National Academy of Sciences, USA, 93, 4770–4774. [CrossRef]
Morton J. Johnson M. H. (1991). CONSPEC and CONLERN: A two-process theory of infant face recognition. Psychological Review, 98, 164–181. [CrossRef] [PubMed]
Müller M. M. Andersen S. Trujillo N. J. Valdés-Sosa P. Malinowski P. Hillyard S. A. (2006). Feature-selective attention enhances color signals in early visual areas of the human brain. Proceedings of the National Academy of Sciences, USA, 103, 14250–14254. [CrossRef]
Nasr S. Tootell B. H. (2012). Role of fusiform and anterior temporal cortical areas in facial recognition. NeuroImage, 63, 1743–1753. [CrossRef] [PubMed]
Nederhouser M. Yue X. Mangini M. C. Biederman I. (2007). The deleterious effect of contrast reversal on recognition is unique to faces, not objects. Vision Research, 47, 2134–2142. [CrossRef] [PubMed]
Norcia A. M. Tyler C. W. (1985). Spatial frequency sweep VEP: Visual acuity during the first year of life. Vision Research, 25, 1399–1408. [CrossRef] [PubMed]
Ohayon S. Freiwald W. A Tsao D. Y. (2012). What makes a cell face selective? The importance of contrast. Neuron, 74, 567–581. [CrossRef] [PubMed]
Otsuka Y. Hill H. C. H. Kanazawa S. Yamaguchi M. K. Spehar B. (2012). Perception of Mooney faces by young infants: The role of local feature visibility, contrast polarity, and motion. Journal of Experimental Child Psychology, 111, 164–179. [CrossRef] [PubMed]
Parkin A. J. Williamson P. (1987). Cerebral lateralisation at different stages of facial processing. Cortex, 23, 99–110. [CrossRef] [PubMed]
Pei F. Pettet M. W. Norcia A. M. (2002). Neural correlates of object-based attention. Journal of Vision, 2 (9): 1, 588–596, http://www.journalofvision.org/content/2/9/1, doi:10.1167/2.9.1. [PubMed] [Article] [PubMed]
Perrett D. I. Oram M. W. Ashbridge E. (1998). Evidence accumulation in cell populations responsive to faces: An account of generalisation of recognition without mental transformations. Cognition, 67, 111–145. [CrossRef] [PubMed]
Philiastides M. G. Ratcliff R. Sajda P. (2006). Neural representation of task difficulty and decision making during perceptual organization: A timing paradigm. Journal of Neuroscience, 26, 8965–8975. [CrossRef] [PubMed]
Philiastides M. G. Sajda P. (2006). Temporal characterization of the neural correlates of perceptual decision making in the human brain. Cerebral Cortex, 16, 509–518. [CrossRef] [PubMed]
Purcell D. G. Stewart A. L. (1986). The face-detection effect. Bulletin of the Psychonomic Society, 24, 118–120. [CrossRef]
Purcell D. G. Stewart A. L. (1988). The face-detection effect: Configuration enhances detection. Perception & Psychophysics, 43, 355–366. [CrossRef] [PubMed]
Regan D. (1966). Some characteristics of average steady-state and transient responses evoked by modulated light. Electroencephalography and Clinical Neurophysiology, 20, 238–248. [CrossRef] [PubMed]
Regan D. (1973). Rapid objective refraction using evoked brain potentials. Investigative Ophthalmology, 12, 669–679. [PubMed]
Rossion B. (2008). Picture-plane inversion leads to qualitative changes of face perception. Acta Psychologica, 128, 274–289. [CrossRef] [PubMed]
Rossion B. (2014). Understanding face perception by means of prosopagnosia and neuroimaging. Frontiers in Bioscience, 6, 308–317.
Rossion B. Alonso Prieto E. Boremanse A. Kuefner D. Van Belle G. (2012). A steady-state visual evoked potential approach to individual face perception: Effect of inversion, contrast-reversal and temporal dynamics. NeuroImage, 63, 1585–1600. [CrossRef] [PubMed]
Rossion B. Boremanse A. (2008). Nonlinear relationship between holistic processing of individual faces and picture-plane rotation: Evidence from the face composite illusion. Journal of Vision, 8 (4), 3, 1–13, http://www.journalofvision.org/content/8/4/3, doi:10.1167/8.4.3. [PubMed] [Article] [PubMed]
Rossion B. Boremanse A. (2011). Robust sensitivity to facial identity in the right human occipito-temporal cortex as revealed by steady-state visual-evoked potentials. Journal of Vision, 11 (2): 16, 1–21, http://www.journalofvision.org/content/11/2/16, doi:10.1167/11.2.16. [PubMed] [Article]
Rossion B. Delvenne J.-F. Debatisse D. Goffaux V. Bruyer R. Crommelinck M. Guérit J.-M. (1999). Spatio-temporal brain localization of the face inversion effect. Biological Psychology, 50, 173–189. [CrossRef] [PubMed]
Rossion B. Dricot L. Goebel R. Busigny T. (2011). Holistic face categorization in higher-level cortical visual areas of the normal and prosopagnosic brain: Towards a non-hierarchical view of face perception. Frontiers in Human Neuroscience, 4, 225. [CrossRef] [PubMed]
Rossion B. Jacques C. (2011). The N170: Understanding the time-course of face perception in the human brain. In Luck S. Kappenman E. (Eds.), The Oxford handbook of ERP components. Oxford: Oxford University Press.
Rousselet G. A. Macé M. J.-M. Fabre-Thorpe M. (2003). Is it an animal? Is it a human face? Fast processing in upright and inverted natural scenes. Journal of Vision, 3 (6): 5, 440–455, http://www.journalofvision.org/content/3/6/5, doi:10.1167/3.6.5. [PubMed] [Article] [PubMed]
Rousselet G. A. Pernet C. R. Bennett P. J. Sekuler A. B. (2008). Parametric study of EEG sensitivity to phase noise during face processing. BMC Neuroscience, 9(98), 1, 18.
Russell R. Biederman I. Nederhouser M. Sinha P. (2007). The utility of surface reflectance for the recognition of upright and inverted faces. Vision Research, 47, 157–165. [CrossRef] [PubMed]
Russell R. Sinha P. Biederman I. Nederhouser M. (2006). Is pigmentation important for face recognition? Evidence from contrast negation. Perception, 356, 749–759. [CrossRef]
Sadeh B. Yovel G. (2010). Why is the N170 enhanced for inverted faces? An ERP competition experiment. NeuroImage, 53, 782–789. [CrossRef] [PubMed]
Sagiv N. Bentin S. (2001). Structural encoding of human and schematic faces: Holistic and part-bases processes. Journal of Cognitive Neuroscience, 13, 937–951. [CrossRef] [PubMed]
Schneider B. L. DeLong J. E. Busey T. A. (2007). Added noise affects the neural correlates of upright and inverted faces differently. Journal of Vision, 7 (4): 4, 1–24, http://www.journalofvision.org/content/7/4/4, doi:10.1167/7.4.4.
Sergent J. (1984). An investigation into component and configural processes underlying face perception. British Journal of Psychology, 75, 221–242. [CrossRef] [PubMed]
Sergent J. Ohta S. MacDonald B. (1992). Functional neuroanatomy of face and object processing: A positron emission tomography study. Brain, 115, 15–36. [CrossRef] [PubMed]
Tanaka J. W. Farah M. J. (1993). Parts and wholes in face recognition. Quarterly Journal of Experimental Psychology, A. Human Experimental Psychology, 46, 225–245. [CrossRef]
Tang Y. Norcia A. M. (1995). An adaptive filter for steady-state evoked responses. Electroencephalography and Clinical Neurophysiology, 96, 268–277. [CrossRef] [PubMed]
Taubert J. Alais D. (2011). Identity aftereffects, but not composite effects, are contingent on contrast polarity. Perception, 40 (4), 422–436. [CrossRef] [PubMed]
Tomalski P. Johnson M. H. (2012). Cortical sensitivity to contrast polarity and orientation of faces is modulated by temporal-nasal hemifield asymmetry. Brain Imaging and Behavior, 6 (1), 88–101. [CrossRef] [PubMed]
Turati C. Simion F. Milani I. Umiltà C. (2002). Newborns' preference for faces: What is crucial? Developmental Psychology, 3, 875–882. [CrossRef]
VanRullen R. (2006). On second glance: Still no high-level pop-out effect for faces. Vision Research, 46, 3017–3027. [CrossRef] [PubMed]
Vuong Q. C. Peissig J. J. Harrison M. C. Tarr M. J. (2005). The role of surface pigmentation for recognition revealed by contrast reversal in faces and Greebles. Vision Research, 45 (10), 1213–1223. [CrossRef] [PubMed]
Weiner K. S. Grill-Spector K. (2010). Sparsely-distributed organization of face and limb activations in human ventral temporal cortex. Neuroimage, 52, 1559–1573. [CrossRef] [PubMed]
Yin R. K. (1969). Looking at upside-down faces. Journal of Experimental Psychology, 81, 141–145. [CrossRef]
Yue X. Nasr S. Devaney K. J. Holt D. J. Tootell R. B. H. (2013). FMRI analysis of contrast polarity in face-selective cortex in humans and monkeys. NeuroImage, 76, 57–69. [CrossRef] [PubMed]
Figure 1
 
(A) Set of face stimuli used in the experiment. Faces differed in terms of gender, location, viewpoint, and size. (B) The different conditions of the study. (C) and (D) Schematic illustration of the sweep sequence. Phase-scrambled noise images (0%) alternated with face images whose phase coherence steadily increased (0% to 100%) so that a face appeared to gradually emerge over 20 steps (20 s). At each coherence step, one face image was alternated with one scrambled image three times. (D) An abbreviated version of the sweep sequence with only 10 steps is shown.
Figure 1
 
(A) Set of face stimuli used in the experiment. Faces differed in terms of gender, location, viewpoint, and size. (B) The different conditions of the study. (C) and (D) Schematic illustration of the sweep sequence. Phase-scrambled noise images (0%) alternated with face images whose phase coherence steadily increased (0% to 100%) so that a face appeared to gradually emerge over 20 steps (20 s). At each coherence step, one face image was alternated with one scrambled image three times. (D) An abbreviated version of the sweep sequence with only 10 steps is shown.
Figure 2
 
Schematic illustration of the estimation procedure of the 3-Hz response threshold. The amplitude was extracted at every coherence step at 3 Hz, representing the signal of interest (face detection), and at two adjacent frequencies (2.5 Hz and 3.5 Hz), representing the background EEG noise (far left). Both signal and noise were cumulatively summed and then normalized relative to the maximal value of the signal (middle). The difference between the signal and noise function (far right) can be used to estimate the stimulus value needed for response onset by fitting a hinge function to the data. The inflection point of the hinge function is then considered as the threshold of face detection.
Figure 2
 
Schematic illustration of the estimation procedure of the 3-Hz response threshold. The amplitude was extracted at every coherence step at 3 Hz, representing the signal of interest (face detection), and at two adjacent frequencies (2.5 Hz and 3.5 Hz), representing the background EEG noise (far left). Both signal and noise were cumulatively summed and then normalized relative to the maximal value of the signal (middle). The difference between the signal and noise function (far right) can be used to estimate the stimulus value needed for response onset by fitting a hinge function to the data. The inflection point of the hinge function is then considered as the threshold of face detection.
Figure 3
 
Face detection thresholds for each participant (A) and each face exemplar (B) across conditions (left), and the corresponding group means with their SEM (right). Detection threshold increased with inversion and polarity inversion and this pattern was consistent both across participants and face-exemplars.
Figure 3
 
Face detection thresholds for each participant (A) and each face exemplar (B) across conditions (left), and the corresponding group means with their SEM (right). Detection threshold increased with inversion and polarity inversion and this pattern was consistent both across participants and face-exemplars.
Figure 4
 
Topography of SSVEP responses across conditions. A 3-Hz response is present in all face conditions and is distributed along the posterior and occipito-temporal regions, with a right hemisphere dominance that is most evident in the upright positive polarity condition. The amplitude of the 3-Hz response is decreased with inversion and more severely with polarity inversion. The 6-Hz response is similarly localized around the medial occipital region in all conditions. The topography of the 1F index, representing the proportion of face-specific responses at each channel, isolates the contribution of the lateral occipito-temporal channels.
Figure 4
 
Topography of SSVEP responses across conditions. A 3-Hz response is present in all face conditions and is distributed along the posterior and occipito-temporal regions, with a right hemisphere dominance that is most evident in the upright positive polarity condition. The amplitude of the 3-Hz response is decreased with inversion and more severely with polarity inversion. The 6-Hz response is similarly localized around the medial occipital region in all conditions. The topography of the 1F index, representing the proportion of face-specific responses at each channel, isolates the contribution of the lateral occipito-temporal channels.
Figure 5
 
Frequency spectra of channels 58/P7, 75/Oz, and 96/P8 showing the largest 3-Hz and 6-Hz responses across conditions. Note that although a 3-Hz response is present on all channels in face conditions, the 6-Hz response is largely reduced on bilateral occpito-temporal channels (58 and 96) compared to the medial occipital channel (75). In the scrambled condition, only a 6-Hz response is present.
Figure 5
 
Frequency spectra of channels 58/P7, 75/Oz, and 96/P8 showing the largest 3-Hz and 6-Hz responses across conditions. Note that although a 3-Hz response is present on all channels in face conditions, the 6-Hz response is largely reduced on bilateral occpito-temporal channels (58 and 96) compared to the medial occipital channel (75). In the scrambled condition, only a 6-Hz response is present.
Figure 6
 
(A) Mean amplitude difference (± SEM) between right and left occipito-temporal ROIs across face conditions. (B) Amplitude difference between right and left occipito-temporal ROIs averaged across contrast polarities in individual participants. A larger right-lateralized response in the positive compared to the negative polarity condition was present for 10/13 participants.
Figure 6
 
(A) Mean amplitude difference (± SEM) between right and left occipito-temporal ROIs across face conditions. (B) Amplitude difference between right and left occipito-temporal ROIs averaged across contrast polarities in individual participants. A larger right-lateralized response in the positive compared to the negative polarity condition was present for 10/13 participants.
Figure 7
 
Sweep response functions in the left and right occipito-temporal ROIs across conditions (see legend) for group means (± SEM) averaged across participants at 3 Hz and 6 Hz. While the 6-Hz amplitude remains stable throughout the sweep sequence, the 3-Hz amplitude shows abrupt increases, reflecting face detection. The 3-Hz response functions differ in terms of onset, absolute amplitude, and shape across conditions, especially in the right hemisphere.
Figure 7
 
Sweep response functions in the left and right occipito-temporal ROIs across conditions (see legend) for group means (± SEM) averaged across participants at 3 Hz and 6 Hz. While the 6-Hz amplitude remains stable throughout the sweep sequence, the 3-Hz amplitude shows abrupt increases, reflecting face detection. The 3-Hz response functions differ in terms of onset, absolute amplitude, and shape across conditions, especially in the right hemisphere.
Figure 8
 
Significant differences between conditions throughout all 20 coherence levels indicated by permutation tests for the bilateral occipito-temporal ROIs. The color-scale refers to the p value of the difference. Crossed out rectangles indicate differences that did not meet our consecutivity criterion (minimum three consecutive significant differences). Differences between conditions were more salient in the right compared to the left occipito-temporal ROI.
Figure 8
 
Significant differences between conditions throughout all 20 coherence levels indicated by permutation tests for the bilateral occipito-temporal ROIs. The color-scale refers to the p value of the difference. Crossed out rectangles indicate differences that did not meet our consecutivity criterion (minimum three consecutive significant differences). Differences between conditions were more salient in the right compared to the left occipito-temporal ROI.
Figure 9
 
(A) Mean estimated 3-Hz response onset, i.e., face detection threshold (± SEM) the in left (LOT) and right (ROT) occipito-temporal ROIs in each face condition for participant and face exemplar analyzed data. (B) Scatterplots depicting the correlations between neural and behavioral face detection thresholds for participants (top) and face exemplar (bottom) data in each face condition. Significant correlations are marked with an asterisk (* = p < 0.05; ** = p < 0.01). Grayed data points represent participants or face exemplars for whom a detection response was not present.
Figure 9
 
(A) Mean estimated 3-Hz response onset, i.e., face detection threshold (± SEM) the in left (LOT) and right (ROT) occipito-temporal ROIs in each face condition for participant and face exemplar analyzed data. (B) Scatterplots depicting the correlations between neural and behavioral face detection thresholds for participants (top) and face exemplar (bottom) data in each face condition. Significant correlations are marked with an asterisk (* = p < 0.05; ** = p < 0.01). Grayed data points represent participants or face exemplars for whom a detection response was not present.
Table 1
 
Response accuracy rates (Mean ± SEM). Notes: Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity.
Table 1
 
Response accuracy rates (Mean ± SEM). Notes: Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity.
Up +Pol Inv +Pol Up −Pol Inv −Pol Scrambled
Participants 0.96 (0.02) 0.95 (0.02) 0.92 (0.02) 0.89 (0.03) 0.85 (0.06)
Face exemplars 0.96 (0.01) 0.95 (0.02) 0.92 (0.03) 0.89 (0.03) 0.84 (0.03)
Table 2
 
Goodness-of-fit measures for the hinge function used to estimate neural face detection thresholds (Mean ± SEM). Note. Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity; RMSE = root mean squared error (smaller values indicate better fit).
Table 2
 
Goodness-of-fit measures for the hinge function used to estimate neural face detection thresholds (Mean ± SEM). Note. Up = upright; Inv = inverted; +Pol = positive polarity; −Pol = negative polarity; RMSE = root mean squared error (smaller values indicate better fit).
Up +Pol Inv +Pol Up −Pol Inv −Pol
R2 RMSE R2 RMSE R2 RMSE R2 RMSE
Participants 0.98 (0.01) 0.095 (0.012) 0.95 (0.02) 0.084 (0.007) 0.94 (0.02) 0.104 (0.010) 0.87 (0.03) 0.111 (0.009)
Face exemplars 0.93 (0.03) 0.088 (0.008) 0.90 (0.03) 0.096 (0.009) 0.84 (0.06) 0.114 (0.008) 0.83 (0.05) 0.110 (0.008)
Supplementary Material
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×