Future directions and outstanding questions prompted by the meta-analysis
Is serial dependence implemented at each level of visual processing? The meta-analysis shows serial dependence exists for many different kinds of stimuli, but is it implemented at each level of processing? The meta-analysis suggests some perceptual judgments have less serial dependence, such as face attractiveness (Figure 3). Perhaps different visual stimuli and functions have different degrees of serial dependence, and perhaps they can be dissociated (Liberman et al., 2014; Manassi et al., 2018a; Pascucci et al., 2023). Individual differences may be a way to address this (Zhang & Whitney, 2017).
Is the spatial and temporal tuning of serial dependence different for different features and objects? It may be possible to dissociate different forms or levels of serial dependence by comparing their tuning properties.
Is there a systemic relation between the spatial and temporal tuning of serial dependence? Is it a spatiotemporal serial dependence or are they separable dimensions that do not necessarily co-vary? Individual differences may be a way to address this, as well.
Does serial dependence occur in other domains beyond basic vision? Is there serial dependence in social cognition, in behavioral economics, in emotion and cognitive control? What are the connections between serial dependence and heuristics and biases reported in that literature? For example, there are anchoring effects and other sequential biases in economic decisions, but those are not known to have clear tuning properties like serial dependence. On the other hand, whether they are tuned like serial dependence has not really been tested.
Where in the brain is serial dependence implemented for any given visual feature or object? There are several reports of neural signatures of serial dependence, but very mixed results with precious few studies that have linked trial-wise serial dependence behavioral measures with any consistent neural correlate of the effect. Something in the brain must implement serial dependence, echoing its tuning properties revealed in the meta-analysis here, but what is the signal? Does it differ for different stimuli? Is it silent, or multiplexed, or sustained, or in oscillations, or in spontaneous activity, or in non-neural activity, or something else?
Does serial dependence echo the temporal statistics of features, objects, and high-level properties of scenes? It is possible, if not likely, that different kinds of visual information are characterized by different temporal statistics in the natural world. For example, orientation, color, surface, shape, face identity, and emotional content in scenes might have very different autocorrelation functions in typical observer experience. These might also depend on the particular environment, age, culture, development, and other factors. Are the putative differences in the temporal statistics of different kinds of information associated with differences in serial dependence?
How do individual differences impact serial dependence at the observer level? The temporal statistics (e.g., autocorrelation) of orientation information in natural movies have been reported before (van Bergen & Jehee, 2019), but not at the individual observer level. The temporal statistics of emotion information in natural movies was also reported before (Ortega et al., 2023), but these were not linked to individual observers either. Is it possible that the temporal statistics of visual information at any level is dictated in part by how humans as individuals interact and move around the world? Do the goals and limits of particular observers, and their interactions with the world, shape the temporal statistics of incoming information in a way that mimics or predicts individual differences in serial dependence?
Do individual differences in serial dependence arise from differences in age, visual impairments, expertise, atypical development, or other idiosyncratic characteristics? Whether there are differences in serial dependence that echo other individual differences is a very broad, open question. Group level analyses with pooled data are inadequate to tackle this question. More studies at the individual observer level and on individual differences are needed (Kondo et al., 2022; Turbett et al., 2021; Van Geert et al., 2022).
Does perceptual learning impact serial dependence? Serial dependence could be a fast-adapting or a slow-adapting process. Although it is possible, it is not necessarily the case that serial dependence must reflect the temporal statistics of the world in a rigid and fixed way, independent of the particular observer; the needs and interactions of individual observers could modulate the incoming and learned temporal statistics. Therefore serial dependence could change over time, depending on modulations of the incoming information and the goals/needs of the observer. Perceptual learning experiments combined with measures of serial dependence at the individual observer level could help address this.
What is the development of serial dependence and does it vary with observer age? Is there serial dependence in infant object recognition, for example measured in preferential looking experiments? Or are infants with less exposure to the temporal statistics of natural scenes less susceptible to serial dependence effects? Does serial dependence of different kinds of information develop at different rates? Does serial dependence in development echo the changes in perceptual sensitivity, efficiency, and stability?
What is the role of attention in different forms of serial dependence? Attention matters for orientation serial dependence (Figure 9), but whether it matters in other forms of serial dependence is not clear because there are not yet enough studies on it.
Can serial dependence be trained away? Can the visual system actually learn randomness? Statistical learning exists (Fiser & Lengyel, 2022) but whether this learning is associated with specific trial-by-trial biases (serial dependencies) is less clear. At a broader level, is randomness a fundamental dimension of perception and is it related to serial dependence?
Why might the feature tuning of serial dependence vary across individuals and across stimuli? The meta-analysis here reveals that serial dependence is most often tuned to stimulus similarity. The width of that tuning doesn't seem to substantially differ across stimulus type, but it could; there aren't enough studies yet to know. More importantly, the tuning width may vary across different observers, as well, but these have rarely been tested or reported (Turbett et al., 2019) and the test-retest reliability of these individual differences remains unclear. If there are stimulus and observer individual differences, why do these occur and what do they reflect?
What is the role of internal and external noise in serial dependence? The role of noise in serial dependence has been studied in some forms, but the manipulations yield mixed results. There are both external and internal sources of noise, however, and it is worth considering what counts as noise for different stimuli and tasks (beyond, for example, 1/f noise), and what the visual system attributes the noise to. Future studies could take advantage of equivalent noise paradigms to try to parcel out the impact of different forms of noise in sequences.
Does serial dependence occur for nested properties of compound objects? Some similar ideas have been explored before (Collins, 2022b; Fischer et al., 2020; Liberman et al., 2018; Pascucci et al., 2023; Taubert et al., 2016a), but only with features. Complex scenes are made of compound objects that are themselves made up of attentionally segmentable features and parts (e.g., an emotional scene has an expressive face, which has a salient set of face parts made up of features like color, orientation, etc.) We can attend to any of these levels of analysis (color, nose or mouth orientation, configuration of eyes-nose-mouth, holistic properties of the face identity, expression information, contextual scene information, or interactions between these). Does serial dependence happen only at the attended level of analysis? Or at all levels?
How do serial dependencies relate to (working) memory? Which forms of serial dependence involve memory and how? Is (maladaptive) proactive interference dissociable from (adaptive) serial dependence, or is it actually a form of serial dependence? Are individual differences in memory related to individual differences in serial dependence? Does this hold within and across different features and objects?
How is serial dependence related to ongoing narratives of perceptual consciousness? Are serial dependencies consistent with theories of consciousness (Seth & Bayne, 2022) like global workspace theory, multiple drafts model, re-entry and predictive processing theories, integrated information theory, and other accounts of awareness?
What are the computational goals and functional benefits of serial dependence? Several studies have reported putative computational goals of serial dependence including improved efficiency, accuracy, and stability. Relating these benefits specifically to individual differences in perception and expertise would further test these ideas. In the face domain, this work has started (Turbett et al., 2019), but more is needed in other areas of perception science, including tying the domain specific functional benefits to the spatial and temporal tuning properties of serial dependence.
Does serial dependence vary in atypical populations? For example, in neurocognitive developmental disorders such as those with autism? Or those with schizophrenia? Those with depressive and anxiety disorders? Those with other forms of mental illness? Intriguing recent work has begun to explore this (Stein et al., 2020), but there is not enough published yet to conduct a meta-analysis, and the existing literature is mixed. Higher-powered studies are required, as are studies using stimuli beyond just orientation. The meta-analysis here demonstrates that face identity serial dependence is significantly stronger than face attractiveness serial dependence, casting doubts on the (often implicit) assumption that one form of serial dependence (e.g., orientation) can be used as a proxy for other forms of serial dependence.
Can serial dependence be modulated with transcranial magnetic stimulation (TMS) or transcranial direct current stimulation (tDCS)? If so, can it be done in a stimulus-specific or location specific manner? The meta-analysis reveals a very precise picture of the tuning properties of serial dependence, which provides a firmer foundation for testing manipulations of serial dependence with noninvasive techniques such as TMS.
This laundry list of questions and future directions only scratches the surface. It does, however, highlight the value of the meta-analyses, which revealed the diagnostic properties of serial dependence and provide a baseline of comparison for future (and past) work.