Open Access
Article  |   December 2017
The effects of delay duration on visual working memory for orientation
Author Affiliations
  • Hongsup Shin
    Center for Neural Science and Department of Psychology, New York University, New York, USA
    hongsup.s@gmail.com
  • Qijia Zou
    Center for Neural Science and Department of Psychology, New York University, New York, USA
    qz583@nyu.edu
  • Wei Ji Ma
    Center for Neural Science and Department of Psychology, New York University, New York, USA
    weijima@nyu.edu
Journal of Vision December 2017, Vol.17, 10. doi:https://doi.org/10.1167/17.14.10
  • Views
  • PDF
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Hongsup Shin, Qijia Zou, Wei Ji Ma; The effects of delay duration on visual working memory for orientation. Journal of Vision 2017;17(14):10. https://doi.org/10.1167/17.14.10.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

We used a delayed-estimation paradigm to characterize the joint effects of set size (one, two, four, or six) and delay duration (1, 2, 3, or 6 s) on visual working memory for orientation. We conducted two experiments: one with delay durations blocked, another with delay durations interleaved. As dependent variables, we examined four model-free metrics of dispersion as well as precision estimates in four simple models. We tested for effects of delay time using analyses of variance, linear regressions, and nested model comparisons. We found significant effects of set size and delay duration on both model-free and model-based measures of dispersion. However, the effect of delay duration was much weaker than that of set size, dependent on the analysis method, and apparent in only a minority of subjects. The highest forgetting slope found in either experiment at any set size was a modest 1.14°/s. As secondary results, we found a low rate of nontarget reports, and significant estimation biases towards oblique orientations (but no dependence of their magnitude on either set size or delay duration). Relative stability of working memory even at higher set sizes is consistent with earlier results for motion direction and spatial frequency. We compare with a recent study that performed a very similar experiment.

Introduction
Visual working memory can maintain multiple items for durations of up to tens of seconds. Not surprisingly, two basic variables used to characterize working memory performance are the number of items (set size) and delay duration (a third basic variable would be the complexity or number of features per item). As in recent years, set size effects have received the most scrutiny in experimental psychology (for reviews, see Luck & Vogel, 2013; Ma, Husain, & Bays, 2014); the study of delay duration effects has ended up being somewhat overshadowed. 
Perhaps the first researcher to vary delay duration in a controlled experiment was Friedrich Hegelmaier (1833–1906), when he was a medical student in Tübingen (Laming & Laming, 1992). His work was published in German in 1852 and republished in English in Laming and Laming (1992). Hegelmaier measured visual working memory for the length of a line segment using a sameness judgment task, and found that his accuracy dropped only modestly, from 80% to 73%, when he increased delay duration from 3 to 60 s. More recent studies have predominantly used two-alternative forced-choice delayed-discrimination tasks. Using delay durations between 1 and 30 s, no effect of delay duration on discrimination threshold was found for spatial frequency (Greenlee, Rischewski, Mergner, & Seeger, 1993; Magnussen, Greenlee, Asplund, & Dyrnes, 1990, 1991; Magnussen, Greenlee, & Thomas, 1996; Magnussen, Idas, & Holst-Myhre, 1998; Regan, 1985), speed (Greenlee, Lang, Mergner, & Seeger, 1995; Magnussen & Greenlee, 1992), motion direction (Blake, Cepeda, & Hiris, 1997), and motion coherence (Blake et al., 1997). Discrimination thresholds for contrast, however, seem to approximately double as delay duration increases from 1 to 10 s (Greenlee, Magnussen, & Thomas, 1991; Harvey, 1986; Lee & Harris, 1996; Magnussen et al., 1996). Working memory for orientation (Magnussen et al., 1998; Magnussen, Landro, & Johnsen, 1985; Vogels & Orban, 1986) and vernier offset (Fahle & Harris, 1992) show modest rates of decay—for example, from 77% to 71% correct when going from 1- to 10-s delay (Magnussen et al., 1998). Another paradigm that has been used to measure delay duration effects is delayed estimation, in which the subject matches a probe stimulus to a memorized stimulus along a continuum in the feature of interest. Blake et al. (1997) used this paradigm for motion direction to replicate their results from the two-alternative forced-choice task. Consistently, Zokaei, Gorgoraptis, Bahrami, Bays, and Husain (2011) in a sequential presentation, found a significant effect of sequence length but not of serial position on the precision of encoding as estimated from a model. Two studies employing delayed estimation for color found mild declines of performance between 1 and 26 s at a set size of one (Nilsson & Nelson, 1981) and between 4 and 10 s at a set size of three (Zhang & Luck, 2009). 
Despite extensive bodies of literature on set size and delay duration effects, their intersection is sparsely populated. Blake et al. (1997) used their delayed-estimation task not only to probe the memory of a single-motion direction, but also the memory of one of N simultaneously or sequentially presented motion directions, with set size N being 3, 5, 7, or 9 (Blake et al., 1997). They found a significant effect of set size on average error, but no significant effect of delay duration (0, 10, or 30 s) and no significant interaction. In a two-item spatial-frequency delayed-discrimination task, Magnussen and Greenlee (1999) similarly found a strong effect of set size (one or two) and no effect of delay duration (1, 3, or 10 s). 
The present article uses delayed estimation to investigate the joint effects of set size and delay duration on visual working memory for orientation. Since the exact shape of the error distribution in delayed estimation has in recent years become a topic of interest (Fougnie, Suchow, & Alvarez, 2012; Ma et al., 2014; van den Berg, Shin, Chou, George, & Ma, 2012; Zhang & Luck, 2008), we characterize the error distribution using a variety of metrics besides average error. In addition, we examine estimation biases (Pratte, Park, Rademaker, & Tong, 2016; Van Bergen, Ma, Pratte, & Jehee, 2015) and nontarget reports (Bays, Catalao, & Husain, 2009; van den Berg, Awh, & Ma, 2014; Zokaei et al., 2011). 
The joint variation of set size and delay duration could shed light on neural mechanisms of visual working memory. A recent biophysical computational model in which working memories are represented by patterns of persistent activity (so-called “bump attractors”) that fade and merge, predicts that the effect of delay duration interacts with set size: Delay duration would affect performance at intermediate (three or four), but not at small or large set sizes (Z. Wei, Wang, & Wang, 2012). Thus, it is possible that earlier studies did not find significant effects of delay duration on orientation memory performance because they only used a set size of one. In Wei et al.'s model, the merging of multiple patterns of activity arises largely because the patterns are jointly maintained in a one-dimensional population, in which neurons only have feature selectivity; metaphorically speaking, the bumps have “too little space to avoid each other.” By contrast, if visual working memories were to a large extent maintained in visual sensory areas (Harrison & Tong, 2009; Pasternak & Greenlee, 2005; Sneve, Alns, Endestad, Greenlee, & Magnussen, 2012), spatial dimensions would be available in addition to the feature dimension. Then, one might predict largely independent maintenance and no interaction between the effects of delay duration and set size. 
Experiment 1 presented here was part of the PhD thesis of author H.S. in April 2015. During the review process of the present article, we became aware of a recent article that also studies the temporal decay of visual short-term memory for orientation at multiple set sizes (Pertzov, Manohar, & Husain, 2017). This convergence offers an excellent opportunity for comparison. We comment on the similarities and differences with Pertzov et al. in the Results and Discussion sections. Experiment 2 was done in response to a reviewer concern. 
Methods
Subjects
All subjects gave informed consent. Treatment of subjects was in accordance with the Declaration of Helsinki. 
Experiment 1
Five subjects participated (including one author). The data were collected at the authors' previous institution, Baylor College of Medicine, and the study was approved by the Institutional Review Board of Baylor College of Medicine. Subjects were compensated $50 for their participation. 
Experiment 2
Six subjects participated (all naive; two male, four female). The data were collected at New York University, and the study was approved by the Institutional Review Board of New York University. Subjects were compensated $55 for their participation. 
Apparatus and stimuli
Experiment 1
All stimuli were displayed on a 19-in. Dell LCD monitor (1280 × 1024 pixels) at a viewing distance of approximately 60 cm; in calculations of degrees of visual angle (dva), we assume a viewing distance of exactly 60 cm. The stimuli were presented on a midlevel gray background (128 on an 8-bit grayscale) with a luminance of approximately 25 cd/m2
Each stimulus was a Gabor pattern with a Gaussian envelope of standard deviation 0.2 dva and a cosine modulation with a spatial frequency of 2.86 cycles/dva, a phase of 0, and a peak luminance of approximately 110 cd/m2. We did not gamma-correct the monitor but because the only variable of interest was orientation, we do not believe this mattered. 
A memory array consisted of one, two, four, or six Gabor stimuli with orientations independently drawn from a uniform distribution. The center of each Gabor was located at one of six fixed positions on an imaginary circle around fixation of radius 5 dva. These positions were spaced at 60° angular intervals (within the screen, not dva), starting from the position to the right of fixation. When set size was one, two, or four, a contiguous subset of positions was used. 
Experiment 2
Identical to Experiment 1 except for the following. All stimuli were displayed on a 24-in. ViewSonic LED monitor (3840 × 2160 pixels) at a viewing distance of 61 cm (controlled using a headrest). The stimuli were presented on a midlevel gray background (128 on an 8-bit grayscale) with a luminance of 57.9 cd/m2. The Gabor stimuli had a Gaussian envelope of standard deviation 0.25 dva, a cosine modulation with a spatial frequency of 2.28 cycles/dva, and a peak luminance of approximately 240 cd/m2. The imaginary circle had a radius of 6.27 dva. 
Trial procedure
We used a delayed-estimation task (Blake et al., 1997; Nilsson & Nelson, 1981; Wilken & Ma, 2004). The trial sequence consisted of the presentation of a fixation cross (1 s), the memory array (0.1 s), a delay period during which only the fixation cross was visible (1, 2, 3, or 6 s), and a response screen (presented until response). Subjects were instructed to fixate on the fixation cross. The response screen initially consisted of an empty circle at one of the locations where a stimulus had been present in the memory array. When the subject moved the mouse, a probe Gabor appeared inside the circle; it had the same properties as the stimuli in the memory array except for orientation. When the subject moved the mouse horizontally, the probe changed orientation. The task was to adjust the probe to match the orientation of the remembered stimulus at the corresponding location. The probe could take 320 possible values—equally spaced across orientation space, with a step size of 1.12°. Its initial orientation was drawn randomly from these possible values. 
Experimental procedure
Experiment 1
The experiment consisted of four sessions, with each session consisting of eight blocks, and each block consisting of 60 trials. On each trial, set size was pseudorandomly chosen from its four possible values. Delay duration was held constant within a block. The four delay durations were each used once in the first four blocks, and then again each once in the last four blocks, both in pseudorandom order. Thus, each subject completed 8 × 4 × 60 = 1,920 trials in total, with 120 trials at each combination of delay duration and set size. At the start of the first session, right after the instructions were given, the subject completed 16 representative practice trials; these were not used in the analysis. 
Experiment 2
Identical to Experiment 1 except for the following. On each trial, delay duration was pseudorandomly chosen from its four possible values. Subjects completed four instead of eight blocks per session, for a total of 4 × 4 × 60 = 960 trials, with on average of 60 trials at each combination of delay duration and set size. 
Circular statistics
To quantify the effects of set size and delay duration on the error distribution, we consider four measures of dispersion: mean absolute error, circular standard deviation, interquartile range, and circular variance. Interquartile range is the difference between the 75th and the 25th percentiles of the sorted errors. To compute circular standard deviation and circular variance, we first multiplied all errors by 2, so that they took values between –180° and 180° (which is the standard for calculations of circular statistics). We then regarded each error as a point on a unit circle and calculated the mean resultant length R of the unit vectors corresponding to all errors. Circular standard deviation is then Display Formula\(\def\upalpha{\unicode[Times]{x3B1}}\)\(\def\upbeta{\unicode[Times]{x3B2}}\)\(\def\upgamma{\unicode[Times]{x3B3}}\)\(\def\updelta{\unicode[Times]{x3B4}}\)\(\def\upvarepsilon{\unicode[Times]{x3B5}}\)\(\def\upzeta{\unicode[Times]{x3B6}}\)\(\def\upeta{\unicode[Times]{x3B7}}\)\(\def\uptheta{\unicode[Times]{x3B8}}\)\(\def\upiota{\unicode[Times]{x3B9}}\)\(\def\upkappa{\unicode[Times]{x3BA}}\)\(\def\uplambda{\unicode[Times]{x3BB}}\)\(\def\upmu{\unicode[Times]{x3BC}}\)\(\def\upnu{\unicode[Times]{x3BD}}\)\(\def\upxi{\unicode[Times]{x3BE}}\)\(\def\upomicron{\unicode[Times]{x3BF}}\)\(\def\uppi{\unicode[Times]{x3C0}}\)\(\def\uprho{\unicode[Times]{x3C1}}\)\(\def\upsigma{\unicode[Times]{x3C3}}\)\(\def\uptau{\unicode[Times]{x3C4}}\)\(\def\upupsilon{\unicode[Times]{x3C5}}\)\(\def\upphi{\unicode[Times]{x3C6}}\)\(\def\upchi{\unicode[Times]{x3C7}}\)\(\def\uppsy{\unicode[Times]{x3C8}}\)\(\def\upomega{\unicode[Times]{x3C9}}\)\(\def\bialpha{\boldsymbol{\alpha}}\)\(\def\bibeta{\boldsymbol{\beta}}\)\(\def\bigamma{\boldsymbol{\gamma}}\)\(\def\bidelta{\boldsymbol{\delta}}\)\(\def\bivarepsilon{\boldsymbol{\varepsilon}}\)\(\def\bizeta{\boldsymbol{\zeta}}\)\(\def\bieta{\boldsymbol{\eta}}\)\(\def\bitheta{\boldsymbol{\theta}}\)\(\def\biiota{\boldsymbol{\iota}}\)\(\def\bikappa{\boldsymbol{\kappa}}\)\(\def\bilambda{\boldsymbol{\lambda}}\)\(\def\bimu{\boldsymbol{\mu}}\)\(\def\binu{\boldsymbol{\nu}}\)\(\def\bixi{\boldsymbol{\xi}}\)\(\def\biomicron{\boldsymbol{\micron}}\)\(\def\bipi{\boldsymbol{\pi}}\)\(\def\birho{\boldsymbol{\rho}}\)\(\def\bisigma{\boldsymbol{\sigma}}\)\(\def\bitau{\boldsymbol{\tau}}\)\(\def\biupsilon{\boldsymbol{\upsilon}}\)\(\def\biphi{\boldsymbol{\phi}}\)\(\def\bichi{\boldsymbol{\chi}}\)\(\def\bipsy{\boldsymbol{\psy}}\)\(\def\biomega{\boldsymbol{\omega}}\)\(\def\bupalpha{\unicode[Times]{x1D6C2}}\)\(\def\bupbeta{\unicode[Times]{x1D6C3}}\)\(\def\bupgamma{\unicode[Times]{x1D6C4}}\)\(\def\bupdelta{\unicode[Times]{x1D6C5}}\)\(\def\bupepsilon{\unicode[Times]{x1D6C6}}\)\(\def\bupvarepsilon{\unicode[Times]{x1D6DC}}\)\(\def\bupzeta{\unicode[Times]{x1D6C7}}\)\(\def\bupeta{\unicode[Times]{x1D6C8}}\)\(\def\buptheta{\unicode[Times]{x1D6C9}}\)\(\def\bupiota{\unicode[Times]{x1D6CA}}\)\(\def\bupkappa{\unicode[Times]{x1D6CB}}\)\(\def\buplambda{\unicode[Times]{x1D6CC}}\)\(\def\bupmu{\unicode[Times]{x1D6CD}}\)\(\def\bupnu{\unicode[Times]{x1D6CE}}\)\(\def\bupxi{\unicode[Times]{x1D6CF}}\)\(\def\bupomicron{\unicode[Times]{x1D6D0}}\)\(\def\buppi{\unicode[Times]{x1D6D1}}\)\(\def\buprho{\unicode[Times]{x1D6D2}}\)\(\def\bupsigma{\unicode[Times]{x1D6D4}}\)\(\def\buptau{\unicode[Times]{x1D6D5}}\)\(\def\bupupsilon{\unicode[Times]{x1D6D6}}\)\(\def\bupphi{\unicode[Times]{x1D6D7}}\)\(\def\bupchi{\unicode[Times]{x1D6D8}}\)\(\def\buppsy{\unicode[Times]{x1D6D9}}\)\(\def\bupomega{\unicode[Times]{x1D6DA}}\)\(\def\bupvartheta{\unicode[Times]{x1D6DD}}\)\(\def\bGamma{\bf{\Gamma}}\)\(\def\bDelta{\bf{\Delta}}\)\(\def\bTheta{\bf{\Theta}}\)\(\def\bLambda{\bf{\Lambda}}\)\(\def\bXi{\bf{\Xi}}\)\(\def\bPi{\bf{\Pi}}\)\(\def\bSigma{\bf{\Sigma}}\)\(\def\bUpsilon{\bf{\Upsilon}}\)\(\def\bPhi{\bf{\Phi}}\)\(\def\bPsi{\bf{\Psi}}\)\(\def\bOmega{\bf{\Omega}}\)\(\def\iGamma{\unicode[Times]{x1D6E4}}\)\(\def\iDelta{\unicode[Times]{x1D6E5}}\)\(\def\iTheta{\unicode[Times]{x1D6E9}}\)\(\def\iLambda{\unicode[Times]{x1D6EC}}\)\(\def\iXi{\unicode[Times]{x1D6EF}}\)\(\def\iPi{\unicode[Times]{x1D6F1}}\)\(\def\iSigma{\unicode[Times]{x1D6F4}}\)\(\def\iUpsilon{\unicode[Times]{x1D6F6}}\)\(\def\iPhi{\unicode[Times]{x1D6F7}}\)\(\def\iPsi{\unicode[Times]{x1D6F9}}\)\(\def\iOmega{\unicode[Times]{x1D6FA}}\)\(\def\biGamma{\unicode[Times]{x1D71E}}\)\(\def\biDelta{\unicode[Times]{x1D71F}}\)\(\def\biTheta{\unicode[Times]{x1D723}}\)\(\def\biLambda{\unicode[Times]{x1D726}}\)\(\def\biXi{\unicode[Times]{x1D729}}\)\(\def\biPi{\unicode[Times]{x1D72B}}\)\(\def\biSigma{\unicode[Times]{x1D72E}}\)\(\def\biUpsilon{\unicode[Times]{x1D730}}\)\(\def\biPhi{\unicode[Times]{x1D731}}\)\(\def\biPsi{\unicode[Times]{x1D733}}\)\(\def\biOmega{\unicode[Times]{x1D734}}\)\({1 \over 2}\sqrt { - 2\log R} \) (Mardia & Jupp, 1999), where we introduced the factor Display Formula\({1 \over 2}\) to map back to the true orientation space. Circular variance is 1 – R, which is between 0 and 1. 
We also consider other circular statistics: circular mean, circular skewness, and circular kurtosis. Denoting errors rescaled to [–π, π] by ∈i, where i is the trial index, the circular mean Display Formula\(\bar \epsilon \) is the angle of the resultant vector (Mardia & Jupp, 1999). For circular skewness and circular kurtosis, we use the simple definitions by Pewsey (2004), namely Display Formula\({\rm{skewness}} = {1 \over n}\sum\nolimits_{i = 1}^n {\sin }\, 2({\epsilon _i} - \bar \epsilon )\), and Display Formula\({\rm{kurtosis}} = {1 \over n}\sum\nolimits_{i = 1}^n {\cos }\, 2({\epsilon _i} - \bar \epsilon )\), where n is the number of trials. 
Experiment 1: Results
Model-free: Population
We measured subjects' ability to estimate orientations stored in visual working memory as a function of both set size (one, two, four, or six) and delay duration (1, 2, 3, or 6 s). The error of an estimate on a given trial is the circular distance between the estimate and the true orientation; it takes values between –90° and 90°. For visualization (but not for any statistical analysis), we binned errors in nine equal bins. The binned error distributions across conditions are shown in Figure 1. Visually, it appears that the error distribution is strongly affected by set size but only weakly by delay duration. The effect of set size has been widely reported (e.g., van den Berg et al., 2012; Wilken & Ma, 2004) and we will not emphasize it in this article. 
Figure 1
 
Experiment 1: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects. Each bin was 20° wide, and we plot the histogram value in the center of the bin. Here and elsewhere, error bars represent 1 SEM across subjects.
Figure 1
 
Experiment 1: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects. Each bin was 20° wide, and we plot the histogram value in the center of the bin. Here and elsewhere, error bars represent 1 SEM across subjects.
The measures of error dispersion are shown in Figure 2. We calculated all measures for each subject, then took means and standard errors across subjects. Visually, these plots confirm the impression from the histograms: Each measure shows a strong effect of set size and a much weaker effect of delay duration. Repeated-measures analyses of variance (ANOVAs; Table 1) show effects of set size with p values lower than 10−8, effects of delay duration with p values of 0.017 and lower; the significance of the interaction depends on the measure. Averaged across trials, delay duration, and set sizes, absolute error was 19.3° ± 1.0° (mean ± standard error of the mean across subjects). 
Figure 2
 
Experiment 1: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Figure 2
 
Experiment 1: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Table 1
 
Repeated-measures analysis of variance on dispersion measures in Experiment 1.
Table 1
 
Repeated-measures analysis of variance on dispersion measures in Experiment 1.
Next, we performed a linear regression of mean absolute error against delay duration, separately at each set size, and following Pertzov et al. (2017), we call the slope of this regression line the “forgetting slope.” This slope ranges from 0.42 ± 0.16 at a set size of one to 1.14 ± 0.49 at a set size of six (Figure 3, blue). None of these were significantly different from 0 after a t test with Bonferroni-Holm correction (p values = 0.062, 0.13, 0.024, and 0.082). Repeated-measures ANOVAs did not reveal a significant effect of set size on forgetting slope, F(3, 12) = 3.39, p = 0.054. 
Figure 3
 
Forgetting slopes in Experiments 1 and 2, and comparison with Pertzov et al.(2017). Working memory (WM) conditions: The delay duration of 0.1 s was left out.
Figure 3
 
Forgetting slopes in Experiments 1 and 2, and comparison with Pertzov et al.(2017). Working memory (WM) conditions: The delay duration of 0.1 s was left out.
For completeness, we also examined the effect of delay duration and set size on other moments of the error distribution (Figure 4). As expected, the circular mean and circular skewness are close to zero, and all p values in a repeated-measures ANOVA are greater than 0.08. For circular kurtosis, we find a significant effect of set size, F(3, 12) = 73.5, p < 10−7, but no significant effect of delay duration, F(3, 12) = 2.42, p = 0.12, and no significant interaction, F(9, 36) = 2.08, p = 0.058. 
Figure 4
 
Experiment 1: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Figure 4
 
Experiment 1: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Model-free: Individual subjects
We next examined individual subjects. Visually, the histograms (Figure 5) suggest individual differences: Effects of delay duration seem to be absent in subjects S1 and S3, minimal in S5, and modest in S2 and S4; it should also be kept in mind that S2 was an author. To quantify individual-subject effects, we performed a linear regression of circular standard deviation against set size, delay duration, and their product (to model a potential interaction), for each subject individually (Table 2). Besides providing within-subjects confidence intervals (CIs), regression has the advantage over ANOVA of taking into account the ordinal nature of both set size and delay duration, albeit in a specific way (here linear). The 95% CI for the coefficient of set size contained 0 for no subject, indicating a linear effect of set size on circular standard deviation. The 95% CI for the coefficient of delay duration contained 0 for 1 subject, indicating a linear effect of delay duration on circular standard deviation for most subjects. 
Figure 5
 
Experiment 1: Error distributions for individual subjects by delay duration and set size. Plotting conventions are as in Figure 1. Subject S2 was author H.S.
Figure 5
 
Experiment 1: Error distributions for individual subjects by delay duration and set size. Plotting conventions are as in Figure 1. Subject S2 was author H.S.
Table 2
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 1. Notes: Bold = confidence interval that does not contain 0.
Table 2
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 1. Notes: Bold = confidence interval that does not contain 0.
Model-based: Estimates of (mean) precision
So far, we have used descriptive statistics to quantify dispersion. An alternative approach is to fit a model to the error distribution and estimate the model's precision parameter as a function of set size and delay duration. Different models have been proposed to describe the error distribution. Typically, these models have theoretical roots. In one category of models, the central concept is that of variability in encoding precision, giving rise to “variable-precision models” (Fougnie et al., 2012; Keshvari, Van den Berg, & Ma, 2013; Ma et al., 2014; van den Berg et al., 2012). In a competing tradition, the central concept is that only a subset of items are encoded (so-called “high-threshold” or “item-limit” models; Luck & Vogel, 2013; Pashler, 1988; Zhang & Luck, 2008), giving rise to a “slots-plus-resources” or a “slots-plus-averaging” model in the context of delayed estimation (Zhang & Luck, 2008). Although the slots-plus-resources and slots-plus-averaging models as originally presented have been refuted (Keshvari et al., 2013; van den Berg et al., 2012), the item-limit concept is potentially salvageable by combining it with the notion of variable precision (van den Berg et al., 2014). Since this debate is not the focus of the present article, we have chosen to take a theoretically neutral approach by borrowing from each theoretical tradition only the parametric form of the error distribution. Thus, we treat each model as descriptive, moving only slightly beyond the model-free statistics reported above. 
In a descriptive model, it is important to avoid overfitting, as that would reduce the reliability of parameter estimates. In the present experiment, the main focus is on the dependence of precision on set size and delay duration. This inevitably introduces 16 parameters, one for each condition. Besides these 16 parameters, we choose to minimize the number of additional parameters to avoid overfitting. The models below have 0 or 1 additional parameters. 
  •  
    Pure von Mises model: The error follows a von Mises distribution: Display Formula\(p(\epsilon ) = {1 \over {2\pi {I_o}(\kappa )}}{e^{\kappa \cos \epsilon }}\). Here, κ is called the concentration parameter, and I0 is the modified Bessel function of the first kind of order 0. We define precision J as the Fisher information, which amounts to Display Formula\(J = \kappa {{{I_1}(\kappa )} \over {{I_0}(\kappa )}}\) (van den Berg et al., 2012), where I1 is the modified Bessel function of the first kind of order 1. The pure von Mises model is generally not considered a good description of the error distribution (van den Berg et al., 2014; Zhang & Luck, 2008).
  •  
    Mixture model: Zhang and Luck (2008) proposed that the error distribution is a mixture of a con Mises distribution and a uniform distribution (corresponding to guesses): Display Formula\(p(\epsilon ) = {\lambda \over {2\pi }} + {{1 - \lambda } \over {2\pi {I_0}(\kappa )}}{e^{\kappa \cos \epsilon }}\), where Display Formula\(\lambda \in [0,1]\) is the weight given to the uniform component. We again define precision as Fisher information. To constrain the fits of the model, we assume that λ is shared across all set sizes and all delay durations.
  •  
    Variable-precision model with shared scale parameter: It has been proposed that precision J itself varies across trials (and items; Fougnie et al., 2012; van den Berg et al., 2012). Such variation could be caused by a variety of factors, including stimulus differences (Bae, Olkkonen, Allred, Wilson, & Flombaum, 2008; Pratte et al., 2016), variability in decay (Fougnie et al., 2012), Poisson fluctuations in spike count (Bays, 2014), and fluctuations in attention (Cohen & Maunsell, 2010; Goris, Simoncelli, & Movshon, 2014). We have previously parametrized the variable-precision model by assuming that precision J follows a gamma distribution with mean Display Formula\(\bar J\) and scale parameter Display Formula\(\tau :p(\epsilon ) = \int_0^\infty {{1 \over {2\pi {I_0}(\kappa )}}} {e^{\kappa \cos \epsilon }}{\rm{Gamma}}(J;{{\bar J} \over \tau },\tau )dJ\), where Gamma(J; k, τ) is the gamma distribution with shape parameter k and scale parameter τ (the mean of the gamma distribution is ). The parameter of interest is mean precision Display Formula\(\bar J\) as a function of set size and delay duration. To constrain the fits of the model, we assume that τ is shared across all set sizes and all delay durations.
  •  
    Variable-precision model with shared shape parameter: We previously also considered an alternative parametrization of the variable-precision model, in which the shape parameter k rather than the scale parameter τ is shared across conditions (van den Berg et al., 2014). Thus, we use Display Formula\({\rm{Gamma}}\ (J;k,{{\bar J} \over k})\) instead of Display Formula\({\rm{Gamma}}(J;{{\bar J} \over \tau },\tau )\). In a single condition, the two versions of the variable-precision model are equivalent; however, the different constraints across conditions make the two versions different.
The pure von Mises model has 16 parameters, one for each combination of set size and delay duration. The other three models have one parameter more, which is shared across all conditions. Our primary goal here is not to compare between these models, but to examine whether conclusions about the effect of delay duration are shared across models. 
We fitted all models using maximum-likelihood estimation. Our algorithm used a combination of Bayesian optimization (Brochu, Cora, & De Freitas, 2010) and pattern search (Audet & Dennis, 2006), as implemented by Luigi Acerbi. For parameters with a range (0, ∞), we fitted the logarithm of the parameter for better optimization performance. For each (log) parameter, we set a lower and upper bound. To minimize the risk of getting stuck in local maxima, we ran each optimization 10 times, with different initializations, then picked the best. Each initialization was generated by independently drawing the value of each parameter from a uniform distribution over its range. As it turned out, the algorithm almost always converged on the same maximum across runs, making it likely that local maxima were not a problem. 
We find that all four models provide good fits to the data (Figures 16 through 19). The estimates of the logarithm of precision (in the pure von Mises and mixture models) and the logarithm of mean precision (in the variable-precision models) again seem to show a strong effect of set size and a weaker effect of delay duration (Figure 6). In each model, a repeated-measures ANOVA shows significant effects of both set size and delay duration on the estimated log (mean) precision, and no significant interaction (Table 3). 
Figure 6
 
Experiment 1: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Figure 6
 
Experiment 1: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Table 3
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 1.
Table 3
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 1.
Model-based: Individual subjects
Using nested model comparison, we can perform an individual-subject analog of ANOVA on (mean) precision. An ANOVA is meant to determine whether the variation in a quantity across conditions is greater than expected by chance. At the individual-subject level, we can compare a model in which the quantity is free to vary across conditions to one in which the quantity is constrained to be equal across conditions. (A fully Bayesian treatment would also marginalize over parameters [Rouder, Morey, Speckman, & Province, 2012]; we do not do that here.) 
Since we are most interested in the effect of delay duration, we compare the models above against their counterparts in which precision or mean precision depends only on set size, but not on delay duration; the models are otherwise the same. Such a “null” variant of the pure von Mises model has four parameters (one precision parameter for each set size), and the null variants of the other three models each have five parameters. Thus, the null variants have 12 parameters fewer than the full models. We compare models using the Akaike Information Criterion (AIC; Akaike, 1974) and Bayesian Information Criterion (BIC; Schwarz, 1978). Both metrics penalize a model for having more free parameters, but the BIC penalty is steeper. Table 4 shows that the model comparison results are consistent across models, but inconsistent across subjects and metrics. Overall, on an individual-subject basis, the evidence that delay duration affects (mean) precision is mixed. This is to some extent consistent with visual inspection of the individual-subject data (Figure 5): There is no discernible effect of delay duration for subjects S1 and S3. 
Table 4
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 1. Notes: Comparisons are performed using Akaike information criterion (AIC) and Bayesian information criterion (BIC). Negative values (bold) means that the null model is worse, suggesting an effect of delay duration.
Table 4
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 1. Notes: Comparisons are performed using Akaike information criterion (AIC) and Bayesian information criterion (BIC). Negative values (bold) means that the null model is worse, suggesting an effect of delay duration.
One concern might be that we assumed that in the three models that had an extra, nonprecision parameter, this parameter was shared across all conditions. However, we verified in a separate analysis that the conclusions did not change if we allowed that parameter to vary across set size. 
Estimation biases
In perception (Andrews, 1965; Girshick, Landy, & Simoncelli, 2011; X.-X. Wei & Stocker, 2015) and in visual working memory (Pratte et al., 2016; Van Bergen et al., 2015), orientation biases both towards and away from the cardinal orientations have been reported. In our previous analyses of dispersion, any orientation-dependent biases would merely contribute to the dispersion. To find any potential biases, we first plot reported orientation against target orientation across all subjects, set sizes, and delay durations (Figure 7A). The data seem to deviate systematically from the diagonal, indicating biases. Indeed, we find biases away from the cardinal directions (horizontal and vertical; Figure 7B), consistent with Pratte et al. (2016), Van Bergen et al. (2015), and X.-X. Wei and Stocker (2015). Using 20° bins, a repeated-measures ANOVA reveals a significant effect of target orientation, F(8, 32) = 8.52, p < 10−5; using 10° bins like Pratte et al. (2016), the corresponding result is F(17, 68) = 8.26 with p < 10−10. In Figure 7B, we show bias for 10° bins. 
Figure 7
 
Experiment 1: Estimation biases. Target orientation is defined as clockwise with respect to vertical. We binned target orientation into 10° bins. (A) Scatter plot of reported versus target orientation. Data were collapsed across set sizes and delay durations. Diagonal in dashed red. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). Data were collapsed across set sizes and delay durations. Individual subjects in gray. (C) Scatterplot of error against target orientation for subject S1 at delay 1 s and a set size of one. (D) Weight assigned to target orientation in the calculation of net oblique bias. (E) Net oblique bias as a function of delay duration and set size.
Figure 7
 
Experiment 1: Estimation biases. Target orientation is defined as clockwise with respect to vertical. We binned target orientation into 10° bins. (A) Scatter plot of reported versus target orientation. Data were collapsed across set sizes and delay durations. Diagonal in dashed red. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). Data were collapsed across set sizes and delay durations. Individual subjects in gray. (C) Scatterplot of error against target orientation for subject S1 at delay 1 s and a set size of one. (D) Weight assigned to target orientation in the calculation of net oblique bias. (E) Net oblique bias as a function of delay duration and set size.
Next, we break the estimation biases down by condition. Figure 7C shows an example of the raw data: error as a function of target orientation S1 for delay 1 s and a set size of one. One way to summarize these data is as the absolute circular error averaged across target orientations. The disadvantage of that metric, however, is that it is positive even if there is no true effect. Therefore, we instead define the net oblique bias as the circular mean of the weighted errors, where the weight is 1 if the target orientation is counterclockwise from the closest oblique orientation (±45°), and −1 if the target orientation is clockwise from the closest oblique orientation (Figure 7D). Note that the calculation of this metric does not involve binning. We show net oblique bias as a function of delay duration and set size in Figure 7E. A two-way repeated-measures ANOVA shows no effect of delay duration, F(3, 12) = 0.21, p = 0.89, or set size, F(3, 12) = 1.54, p = 0.25, but a significant interaction, F(9, 36) = 2.90, p = 0.011; indeed, a bit of a cross-over effect is visible. Bias as a function of target orientation is shown separately for each delay duration and set size in Figure 20
Figure 8
 
Experiment 1: Histograms of the nontarget error for individual subjects by delay duration and set size.
Figure 8
 
Experiment 1: Histograms of the nontarget error for individual subjects by delay duration and set size.
Figure 9
 
Experiment 2: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects.
Figure 9
 
Experiment 2: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects.
Figure 10
 
Experiment 2: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Figure 10
 
Experiment 2: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Figure 11
 
Experiment 2: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Figure 11
 
Experiment 2: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Figure 12
 
Experiment 2: Error distributions for individual subjects by delay duration and set size.
Figure 12
 
Experiment 2: Error distributions for individual subjects by delay duration and set size.
Figure 13
 
Experiment 2: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Figure 13
 
Experiment 2: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Figure 14
 
Experiment 2: Estimation biases. Target orientations are binned into 10° bins. (A) Scatter plot of reported versus target orientation. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). (C) Net oblique bias as a function of delay duration and set size.
Figure 14
 
Experiment 2: Estimation biases. Target orientations are binned into 10° bins. (A) Scatter plot of reported versus target orientation. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). (C) Net oblique bias as a function of delay duration and set size.
Figure 15
 
Experiment 2: Histograms of the nontarget error for individual subjects by delay duration and set size.
Figure 15
 
Experiment 2: Histograms of the nontarget error for individual subjects by delay duration and set size.
Nontarget reports
It has previously been reported that in delayed estimation, subjects sometimes report the feature value of a stimulus other than the target (Bays et al., 2009; van den Berg et al., 2014; Zokaei et al., 2011), potentially due to a loss of binding between feature and location (Ma et al., 2014). To look for such reports, we calculated on each trial the circular distances between the subject's response and each of the N – 1 distractor orientations on that trial. The histograms of these distances look nearly flat at all set sizes and all delay durations (Figure 8). To quantify this, we followed Bays et al. (2009) and van den Berg et al. (2014) and fitted separately for each subject, delay duration, and set size, a mixture model consisting of a von Mises distribution centered at the target orientation, a von Mises distribution at each of the distractor orientations (with equal weights), and a guessing rate (weight to a uniform component); all von Miseses had the same concentration parameter. Of interest is the total weight to the von Mises distributions corresponding to the distractors. Averaged across set sizes (excluding N = 1) and delay durations, we find this weight to be 0.0284 ± 0.0060. Thus, the role of nontarget reports was small in this experiment. The fitted parameters of this mixture model are shown by condition in Figure 21
Experiment 2: Results
In Experiment 1, delay duration was blocked. As a result, the average interstimulus interval depended on delay duration. If proactive interference (e.g., Makovski & Jiang, 2008) were to play a role in this experiment, it would then be stronger at shorter delay durations. Therefore, we conducted a control experiment in which delay durations were interleaved. We ran six subjects for 960 trials each (half the number of trials of Experiment 1). 
Model-free: Population
Overall mean absolute error was 19.1° ± 1.4°, consistent with Experiment 1 (t test, p = 0.9). As in Experiment 1, the error distribution is strongly affected by set size but only weakly by delay duration (Figure 9). The measures of error dispersion confirm a strong effect of set size and a much weaker effect of delay duration (Figure 10). Repeated-measures ANOVAs (Table 5) show effects of set size with p values lower than 10−8 and effects of delay duration with p values of 0.025 and lower, except for interquartile range. No interaction were significant. 
Table 5
 
Repeated-measures analyses of variance on dispersion measures in Experiment 2.
Table 5
 
Repeated-measures analyses of variance on dispersion measures in Experiment 2.
Forgetting slopes ranged from 0.25 ± 0.13 at a set size of one to 0.88 ± 0.48 at a set size of six (Figure 3, orange). None of these were significantly different from 0 after a t test with Bonferroni-Holm correction (p values = 0.12, 0.043, 0.040, and 0.13). Repeated-measures ANOVAs did not reveal a significant effect of set size on forgetting slope, F(3, 15) = 1.46, p = 0.26. 
Examining secondary metrics (Figure 11), we find that the circular mean and circular skewness are close to zero, and all p values in a repeated-measures ANOVA are greater than 0.12. For circular kurtosis, we find a significant effect of set size, F(3, 15) = 99.2, p < 10−9; a significant effect of delay duration, F(3, 15) = 8.03, p = 0.0020; and no significant interaction, F(9, 45) = 0.708, p = 0.70. 
Model-free: Individual subjects
For individual subjects (Figure 12), effects of delay duration seem to be modest in S3, minimal in S4, and absent in all others. A linear regression of circular standard deviation against set size, delay duration. and their product for each subject (Table 6) shows that the 95% CI for the coefficient of set size contained 0 for no subject, while the 95% CI for the coefficient of delay duration contained 0 for 4 subjects. This indicates little evidence for a linear effect of delay duration on circular standard deviation. 
Table 6
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 2. Notes: Bold = confidence interval that does not contain 0.
Table 6
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 2. Notes: Bold = confidence interval that does not contain 0.
Model-based: Estimates of (mean) precision
For Experiment 2, all models provide good fits to the data (Figures 22 through 25). The estimates of the logarithm of precision (in the pure von Mises and mixture models) and the logarithm of mean precision (in the variable-precision models) again seem to show a strong effect of set size and a weak effect of delay duration (Figure 13). In each model, a repeated-measures ANOVA shows significant effects of both set size and delay duration on the estimated log (mean) precision, and no significant interaction (Table 7). 
Table 7
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 2.
Table 7
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 2.
Model-based: Individual subjects
We now compare a version of each model in which (mean) precision depends on delay duration against a null variant in which it does not. For no individual subject do we find consistent evidence (between AIC and BIC) that the null model is worse (Table 8). For S3, AIC differences are consistent among each other but are contradicted by the BIC differences, making us hesitant to draw a conclusion. 
Table 8
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 2. Notes: Negative values (bold) means that the null model is worse, suggesting an effect of delay duration. AIC = Akaike information criterion; BIC = Bayesian information criterion.
Table 8
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 2. Notes: Negative values (bold) means that the null model is worse, suggesting an effect of delay duration. AIC = Akaike information criterion; BIC = Bayesian information criterion.
Estimation biases
As a function of target orientation, the data again indicate biases away from the cardinal directions (Figure 14). A repeated-measures ANOVA reveals a significant effect of target orientation (20° bins: F[8, 40] = 6.94, p < 10−5; 10° bins: F[17, 85] = 7.29, p < 10−9). A two-way repeated-measures ANOVA shows no effect on net oblique bias (Figure 14E) of delay duration, F(3, 15) = 2.05, p = 0.15; set size, F(3, 15) = 0.67, p = 0.58; or interaction, F(9, 45) = 1.61, p = 0.14. 
Nontarget reports
Again, the histograms of these distances look nearly flat at all set sizes and all delay durations (Figure 15). Averaged across set sizes (excluding N = 1) and delay durations, the weight to the nontargets was 0.053 ± 0.013. The fitted parameters of this mixture model are shown by condition in Figure 27
Comparison of Experiments 1 and 2
We did not find any major differences between Experiments 1 and 2: Both showed strong effects of set size and relatively weak effects of delay duration (Figures 1, 2, 9, and 10). Nontarget reports were minimal in both experiments, and estimation biases were very similar. However, the effect of delay duration on circular kurtosis was significant in Experiment 2 but not in Experiment 1. Overall, the similarities between Experiments 1 and 2 suggest that interleaving or blocking delay durations did not substantially impact behavior. In both experiments, the statistical significance of the effect of delay duration on performance depended on the analysis method: For example, the effect was significant in an ANOVA (Tables 1 and 5), but not consistently so in a linear regression (Tables 5 and 7) or in a formal model comparison (Tables 4 and 8). 
Is forgetting faster when set size is higher? In Experiment 1, the main ANOVA showed a significant interaction between delay duration and set size for mean absolute error and circular variance, but not for circular standard deviation or interquartile range (Table 1); moreover, the significant results would disappear when correcting for multiple comparisons. In Experiment 2, none of the interactions were significant (Table 5). Forgetting slopes were very similar between Experiments 1 and 2 (Table 9; Figure 3), but in neither experiment did set size have a significant effect on forgetting slope. Moreover, in neither experiment and in no model did we find a significant interaction between set size and delay duration for the estimates of log (mean) precision (Tables 3 and 7). At the individual-subject level, the interaction between set size and delay duration in a linear regression was significant for only three out of the 11 subjects in both experiments (Tables 2 and 6). Thus, we did not find any clear evidence that forgetting is faster at some set sizes than at others. 
Table 9
 
Comparison of forgetting slopes (based on mean absolute errors, in °/s) with those of Pertzov et al. (2017). Notes: Delay duration was 0.1, 1, 2, or 3 s in Pertzov et al. Second column: data extracted from their figure 4 using WebPlotDigitizer (http://arohatgi.info/WebPlotDigitizer). Third column: Mean slope estimated from a linear regression to the data in their figure 1B, restricted to the working memory delays (i.e., leaving out 0.1 s).
Table 9
 
Comparison of forgetting slopes (based on mean absolute errors, in °/s) with those of Pertzov et al. (2017). Notes: Delay duration was 0.1, 1, 2, or 3 s in Pertzov et al. Second column: data extracted from their figure 4 using WebPlotDigitizer (http://arohatgi.info/WebPlotDigitizer). Third column: Mean slope estimated from a linear regression to the data in their figure 1B, restricted to the working memory delays (i.e., leaving out 0.1 s).
Comparison with Pertzov et al.
Experimental differences
Our experimental design closely resembles that of Pertzov et al. (2017), but with some potentially important differences. First, we used delays of 1, 2, 3, and 6 s, whereas Pertzov et al. used delays of 0.1, 1, 2, and 3 s. Second, we used a presentation time of 100 ms, whereas Pertzov et al. used 500 ms; the latter allows for better encoding, but also for covert shifts of attention among items in the display. Third, Pertzov et al. interleaved durations, whereas we only did that in Experiment 2. Fourth, we cued the target by location, whereas Pertzov et al. cued by color (using eight easily distinguishable colors). Fifth, the stimuli used by Pertzov were substantially larger (bars of length 2 dva) than ours (Gaussian standard deviation of 0.2 or 0.25 dva). Finally, we drew orientations independently from a uniform distribution, whereas Pertzov et al. imposed the constraint that orientations within the same trial must differ by at least 10°. We will comment on the consequences of these differences in the Discussion
Comparison of results
We now compare the results of Pertzov et al. (2017) to those of our Experiments 1 and 2, using their chosen measure of dispersion, mean absolute error. The 0.1-s delay used by Pertzov et al. is not usually regarded as a working memory delay (Long, 1980; Phillips, 1974; Sperling, 1960). Restricting ourselves to the working memory delays of 1, 2, and 3 s that are common between our experiments and Pertzov et al., we observe that mean absolute error is very similar across all three experiments, ranging from around 10° at a set size of one to around 30° at a set size of six and a delay of 3 s. At the common delay durations, errors were overall slightly higher in our study (Experiment 1: 18.6° ± 1.2°; Experiment 2: 18.6° ± 1.4°) than in Pertzov et al. (about 15.1°). Our results agree with Pertzov et al. in the main effects and interaction in an ANOVA on mean absolute error, and in the main effect of delay duration on the precision parameter in a mixture model. 
Our results disagree from Pertzov et al.'s (2017) in that we did not find significantly nonzero forgetting slopes, an effect of delay time on forgetting slope, or an interaction in the mixture model. Pertzov et al.'s forgetting slopes were comparable to ours at a set size of one, but higher at other set sizes (Table 9; Figure 3). Pertzov et al. did not test other model-free measures of dispersion (circular standard deviation, interquartile range, or circular variance) or other models (pure Von Mises or variable precision). They also did not perform individual-subject regressions or model comparisons. In our hands, all those analyses made the case for an effect of delay duration or an interaction between delay duration and set size much more tenuous. 
What could explain these substantial discrepancies between our results and Pertzov et al.'s? First, some of our nonsignificant results might have become significant if we had run more subjects (Pertzov et al. ran 10 subjects, we five and six per experiment, respectively). However, the model-based results were obtained for individual subjects. Moreover, the effect size (as seen in the forgetting slopes) would still have been much larger in Pertzov et al. Second, all of Pertzov et al.'s analyses included a delay duration of 0.1 s. This is not considered a pure working memory delay, as sensory and iconic memory can bolster the quality of the internal representation (Long, 1980; Phillips, 1974; Sperling, 1960). Therefore, it is possible that Pertzov et al. overestimated the pure working memory forgetting slope; however, forgetting slopes estimated from only the working memory delays did not show a different pattern (Figure 3; Table 9, column 3). Third, we ran a delay duration of 6 s in both experiments. It could be that forgetting flattens off after 3 s. Our data indeed show a hint of such flattening. Fourth, Pertzov et al. cued by color rather than by location. It is possible that maintaining color-orientation bindings requires more resources than maintaining location-orientation bindings, increasing the forgetting slope. 
Finally, Pertzov et al. (2017) found substantially more nontarget reports than we did. Multiple factors could play a role: First, the distance-to-size ratio of our stimuli was larger for our stimuli, thereby potentially reducing nontarget responses (Bays, 2016). Second, the colors used by Pertzov et al. to cue an item might have been less distinguishable than the locations in our experiment. 
Discussion
Using a variety of model-free and model-based metrics, we characterized how well people recall orientation from visual working memory as a function of set size and delay duration. All metrics of dispersion show a strong effect of set size, consistent with previous work. Effects of delay duration are much weaker, depend on the analysis method, and are found for only a subset of subjects. Our results are consistent with a reported lack of effect of delay duration on orientation memory at a set size of one (Magnussen et al., 1998; Magnussen et al., 1985; Vogels & Orban, 1986). However, it should be kept in mind that our longest delay was 6 s, shorter than in previous studies (10 or 30 s). It is possible that measures of error dispersion will increase substantially beyond 6 s. We already discussed the similarities and discrepancies with Pertzov et al. (2017) above. 
Our results do not provide strong support for Z. Wei et al.'s (2012) “merging attractor” model, in which unambiguous effects of delay duration are predicted. To the extent that our results can speak to neural underpinnings, they would suggest largely independent, interference-free maintenance of orientation in working memory, of the kind that would likely be provided by topographic visual areas (Harrison & Tong, 2009; Pasternak & Greenlee, 2005; Sneve et al., 2012). 
Based on delayed estimation at a set size of three, it has been claimed that items “die a sudden death” in visual working memory for color (Zhang & Luck, 2009). We did not find any evidence for an analogous claim for orientation. This might in part be due to differences between color and orientation, and indeed, a mild decay of working memory for color would be consistent with earlier results (Nilsson & Nelson, 1981). In addition, there might be other relevant differences in the experimental design; for example, Zhang and Luck used a longest delay of 10 s, and added an articulatory task during the delay period. However, we do not believe that their empirical findings warrant a strong qualitative conclusion of “sudden death.” They reached this conclusion by fitting a mixture of a von Mises and a uniform distribution independently at each delay duration, and then performing an ANOVA on the estimates of the weights of the uniform component. However, they did not perform the more direct AIC or BIC comparison against a null model in which the weight of the uniform component is equal across delay durations. Moreover, a reasonable fit of the mixture model does not support the process claim that people truly guess randomly; to make that claim, one would need to show that the mixture model fits better than models without truly random guessing, such as the variable-precision model. Here, we did not attempt to adjudicate between these models; instead, we tried to show that our conclusions held across models. However, Fougnie, Suchow, and Alvarez (2013) did perform such a model comparison and found that gradual decay provides a better description for color working memory. Nevertheless, the fact that delay duration seems to affect working memory for color and contrast much more strongly than working memory for spatial frequency, orientation, or motion direction is puzzling and needs to be explained. 
Acknowledgments
This work was supported by grant R01EY020958 from the National Institutes of Health. 
Commercial relationships: none. 
Corresponding Author: Wei Ji Ma. 
Email: weijima@nyu.edu
Address: Center for Neural Science and Department of Psychology, New York University, New York, USA. 
References
Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716–723.
Andrews, P. D. (1965). Perception of lines in the central fovea. Nature, 205 (10), 1218–1220.
Audet, C.,& Dennis, J. E.,Jr. (2006). Mesh adaptive direct search algorithms for constrained optimization. SIAM Journal on Optimization, 17, 188–217.
Bae, G.-Y., Olkkonen, M., Allred, S. R., Wilson, C., & Flombaum, J. (2008). Stimulus-specific variability in color working memory with delayed estimation. Journal of Vision, 14 (4): 7, 1–14, doi:10.1167/14.4.7. [PubMed] [Article]
Bays, P. M. (2014). Noise in neural populations accounts for errors in working memory. Journal of Neuroscience, 34, 3632–3645.
Bays, P. M. (2016). Evaluating and excluding swap errors in analogue tests of working memory. Scientific Reports, 6, 19203.
Bays, P. M., Catalao, R. F. G., & Husain, M. (2009). The precision of visual working memory is set by allocation of a shared resource. Journal of Vision, 9 (10): 7, 1–11, doi:10.1167/9.10.7. [PubMed] [Article]
Blake, R., Cepeda, N. J., & Hiris, E. (1997). Memory for visual motion. Journal of Experimental Psychology: Human Perception and Performance, 23 (2), 353–369.
Brochu, E., Cora, V. M., & De Freitas, N. (2010). A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv, 1012, 2599. Available from https://arxiv.org/abs/1012.2599
Cohen, M. R., & Maunsell, J. H. R. (2010). A neuronal population measure of attention predicts behavioral performance on individual trials. Journal of Neuroscience, 45, 15241–15253.
Fahle, M., & Harris, J. P. (1992). Visual memory for vernier offsets. Vision Research, 32 (6), 1033–1042.
Fougnie, D., Suchow, J. W., & Alvarez, G. A. (2012). Variability in the quality of visual working memory. Nature Communications, 3, 1229.
Fougnie, D., Suchow, J. W., & Alvarez, G. A. (2013). Gradual decay and death by natural causes in visual working memory. Journal of Vision, 13 (9): 19, doi:10.1167/13.9.19. [Abstract]
Girshick, A. R., Landy, M. S., & Simoncelli, E. P. (2011). Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics. Nature Neuroscience, 14, 926–932.
Goris, R. L. T., Simoncelli, E. P., & Movshon, J. A. (2014). Using a doubly-stochastic model to analyze neuronal activity in the visual cortex. Nature Neuroscience, 17, 858–865.
Greenlee, M. W., Lang, H. J., Mergner, T., & Seeger, W. (1995). Visual short-term memory of stimulus velocity in patients with unilateral posterior brain damage. Journal of Neuroscience, 15 (3 Pt 2), 2287–2300.
Greenlee, M. W., Magnussen, S., & Thomas, J. P. (1991). Different neural codes for spatial frequency and contrast. In Valberg A. & Lee B. B. (Eds.), From pigments to perception: Advances in understanding visual processes (pp. 451–454). New York: Plenum.
Greenlee, M. W., Rischewski, J., Mergner, T., & Seeger, W. (1993). Delayed pattern discrimination in patients with unilateral temporal lobe damage. Journal of Neuroscience, 13 (6), 2565–2574.
Harrison, S., & Tong, F. (2009). Decoding reveals the contents of working memory in early visual areas. Nature, 458 (7238), 632–635.
Harvey, L.,Jr. (1986). Visual memory: What is remembered? In Klix F. & Hagendorf H. (Eds.), Human memory and cognitive capabilities (pp. 173–187). Amsterdam, the Netherlands: Elsevier.
Keshvari, S., Van den Berg, R., & Ma, W. J. (2013). No evidence for an item limit in change detection. PLoS Computational Biology, 9 (2), e1002927.
Laming, D., & Laming, J. (1992). F. Hegelmaier: On memory for the length of a line. Psychological Research, 54, 233–239.
Lee, B., & Harris, J. (1996). Contrast transfer characteristics of visual short-term memory. Vision Research, 36 (14), 2159–2166.
Long, G. (1980). Iconic memory: A review and critique of the study of short-term visual storage. Psychological Bulletin, 88 (3), 785–820.
Luck, S., & Vogel, E. K. (2013). Visual working memory capacity: From psychophysics and neurobiology to individual differences. Trends in Cognitive Science, 17 (8), 391–400.
Ma, W. J., Husain, M., & Bays, P. M. (2014). Changing concepts of working memory. Nature Neuroscience, 17, 347–356.
Magnussen, S., & Greenlee, M. W. (1992). Retention and disruption of motion information in visual short-term memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18 (1), 151–156.
Magnussen, S., & Greenlee, M. W. (1999). The psychophysics of perceptual memory. Psychological Research, 62 (2–3), 81–92.
Magnussen, S., Greenlee, M. W., Asplund, R., & Dyrnes, S. (1990). Perfect short-term memory for periodic patterns. European Journal of Cognitive Psychology, 2 (4), 345–362.
Magnussen, S., Greenlee, M. W., Asplund, R., & Dymes, S. (1991). Stimulus-specific mechanisms of visual short-term memory. Vision Research, 31 (7–8), 1213–1219.
Magnussen, S., Greenlee, M. W., & Thomas, J. P. (1996). Parallel processing in visual short-term memory. Journal of Experimental Psychology: Human Perception and Performance, 22 (1), 202–212.
Magnussen, S., Idas, E., & Holst-Myhre, S. (1998). Representation of orientation and spatial frequency in perception and memory: A choice reaction-time analysis. Journal of Experimental Psychology: Human Perception and Performance, 24 (3), 707–718.
Magnussen, S., Landro, N., & Johnsen, T. (1985). Visual half-field symmetry in orientation perception. Perception, 14 (3), 265–273.
Makovski, T., & Jiang, Y. (2008). Proactive interference from items previously stored in visual working memory. Memory and Cognition, 36 (1), 43–52.
Mardia, K. V., & Jupp, P. E. (1999). Directional statistics. New York: John Wiley & Sons.
Nilsson, T. H., & Nelson, T. M. (1981). Delayed monochromatic hue matches indicate characteristics of visual memory. Journal of Experimental Psychology: Human Perception and Performance, 7 (1), 141–150.
Pashler, H. (1988). Familiarity and visual change detection. Perception & Psychophysics, 44 (4), 369–378.
Pasternak, T., & Greenlee, M. W. (2005). Working memory in primate sensory systems. Nature Reviews Neuroscience, 6, 97–107.
Pertzov, Y., Manohar, S., & Husain, M. (2017). Rapid forgetting results from competition over time between items in visual working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43, 528–536.
Pewsey, A. (2004). The large-sample joint distribution of key circular statistics. Metrika, 60, 25–32.
Phillips, W. (1974). On the distinction between sensory storage and short-term visual memory. Perception & Psychophysics, 16 (2), 283–290.
Pratte, M. S., Park, Y. P., Rademaker, R. L., & Tong, F. (2016). Accounting for stimulus-specific variation in precision reveals a discrete capacity limit in visual working memory. Attention, Perception and Psychophysics, 46, 6–17.
Regan, D. (1985). Storage of spatial-frequency information and spatial-frequency discrimination. Journal of the Optical Society of America A, 2 (4), 619–621.
Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012). Default Bayes factors for ANOVA designs. Journal of Mathematical Psychology, 56, 356–374.
Schwarz, G. E. (1978). Estimating the dimension of a model. IEEE Transactions on Automatic Control, 6, 461–464.
Sneve, M. H., Alns, D., Endestad, T., Greenlee, M. W., & Magnussen, S. (2012). Visual short-term memory: Activity supporting encoding and maintenance in retinotopic visual cortex. Neuroimage, 63 (1), 166–178.
Sperling, G. (1960). The information available in brief visual presentations. Psychological Monographs, 74, 1–29.
van den Berg, R., Awh, E., & Ma, W. (2014). Factorial comparison of working memory models. Psychological Review, 121, 124–149.
van den Berg, R., Shin, H., Chou, W.-C., George, R., & Ma, W. J. (2012). Variability in encoding precision accounts for visual short-term memory limitations. Proceedings of the National Academy of Sciences, 109, 8780–8785.
Van Bergen, R. S., Ma, W. J., Pratte, M. S., & Jehee, J. F. M. (2015). Sensory uncertainty decoded from visual cortex predicts behavior. Nature Neuroscience, 18, 1728–1730.
Vogels, R., & Orban, G. A. (1986). Decision processes in visual discrimination of line orientation. Journal of Experimental Psychology: Human Perception and Performance, 12 (2), 115–132.
Wei, X.-X., & Stocker, A. (2015). Visual short-term memory: Activity supporting encoding and maintenance in retinotopic visual cortex. Nature Neuroscience, 18 (10), 1509–1517.
Wei, Z., Wang, X. J., & Wang, D. H. (2012). From distributed resources to limited slots in multiple-item working memory: A spiking network model with normalization. Journal of Neuroscience, 32 (33), 11228–11240.
Wilken, P., & Ma, W. J. (2004). A detection theory account of change detection. Journal of Vision, 4 (12): 11, 1120–1135, doi:10.1167/4.12.11. [PubMed] [Article]
Zhang, W., & Luck, S. (2008). Discrete fixed-resolution representations in visual working memory. Nature, 453, 233–235.
Zhang, W., & Luck, S. (2009). Sudden death and gradual decay in visual working memory. Psychological Science, 20, 423–428.
Zokaei, N., Gorgoraptis, N., Bahrami, B., Bays, P. M., & Husain, M. (2011). Precision of working memory for visual motion sequences and transparent motion surfaces. Journal of Vision, 11 (14): 2, 1–18, doi:10.1167/11.14.2. [PubMed] [Article]
Appendix A: Supplementary figures
Experiment 1
Figure 16
 
Experiment 1: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 16
 
Experiment 1: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 17
 
Experiment 1: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 17
 
Experiment 1: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 18
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 18
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 19
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 19
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 20
 
Experiment 1: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 20
 
Experiment 1: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 21
 
Experiment 1: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. Note that this descriptive model has no fewer than 48 parameters (16 conditions, three parameters per condition) and the parameter values are therefore less reliable than those of the more constrained mixture model used for Figure 5, Table 3, and Table 4; this is also reflected in the large error bars.
Figure 21
 
Experiment 1: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. Note that this descriptive model has no fewer than 48 parameters (16 conditions, three parameters per condition) and the parameter values are therefore less reliable than those of the more constrained mixture model used for Figure 5, Table 3, and Table 4; this is also reflected in the large error bars.
Experiment 2
Figure 22
 
Experiment 2: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 22
 
Experiment 2: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 23
 
Experiment 2: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 23
 
Experiment 2: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 24
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 24
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 25
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 25
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 26
 
Experiment 2: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 26
 
Experiment 2: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 27
 
Experiment 2: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. The same caveat as in Figure 21C applies.
Figure 27
 
Experiment 2: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. The same caveat as in Figure 21C applies.
Figure 1
 
Experiment 1: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects. Each bin was 20° wide, and we plot the histogram value in the center of the bin. Here and elsewhere, error bars represent 1 SEM across subjects.
Figure 1
 
Experiment 1: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects. Each bin was 20° wide, and we plot the histogram value in the center of the bin. Here and elsewhere, error bars represent 1 SEM across subjects.
Figure 2
 
Experiment 1: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Figure 2
 
Experiment 1: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Figure 3
 
Forgetting slopes in Experiments 1 and 2, and comparison with Pertzov et al.(2017). Working memory (WM) conditions: The delay duration of 0.1 s was left out.
Figure 3
 
Forgetting slopes in Experiments 1 and 2, and comparison with Pertzov et al.(2017). Working memory (WM) conditions: The delay duration of 0.1 s was left out.
Figure 4
 
Experiment 1: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Figure 4
 
Experiment 1: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Figure 5
 
Experiment 1: Error distributions for individual subjects by delay duration and set size. Plotting conventions are as in Figure 1. Subject S2 was author H.S.
Figure 5
 
Experiment 1: Error distributions for individual subjects by delay duration and set size. Plotting conventions are as in Figure 1. Subject S2 was author H.S.
Figure 6
 
Experiment 1: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Figure 6
 
Experiment 1: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Figure 7
 
Experiment 1: Estimation biases. Target orientation is defined as clockwise with respect to vertical. We binned target orientation into 10° bins. (A) Scatter plot of reported versus target orientation. Data were collapsed across set sizes and delay durations. Diagonal in dashed red. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). Data were collapsed across set sizes and delay durations. Individual subjects in gray. (C) Scatterplot of error against target orientation for subject S1 at delay 1 s and a set size of one. (D) Weight assigned to target orientation in the calculation of net oblique bias. (E) Net oblique bias as a function of delay duration and set size.
Figure 7
 
Experiment 1: Estimation biases. Target orientation is defined as clockwise with respect to vertical. We binned target orientation into 10° bins. (A) Scatter plot of reported versus target orientation. Data were collapsed across set sizes and delay durations. Diagonal in dashed red. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). Data were collapsed across set sizes and delay durations. Individual subjects in gray. (C) Scatterplot of error against target orientation for subject S1 at delay 1 s and a set size of one. (D) Weight assigned to target orientation in the calculation of net oblique bias. (E) Net oblique bias as a function of delay duration and set size.
Figure 8
 
Experiment 1: Histograms of the nontarget error for individual subjects by delay duration and set size.
Figure 8
 
Experiment 1: Histograms of the nontarget error for individual subjects by delay duration and set size.
Figure 9
 
Experiment 2: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects.
Figure 9
 
Experiment 2: Binned error histograms grouped by delay duration (A) and set size (B), averaged over subjects.
Figure 10
 
Experiment 2: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Figure 10
 
Experiment 2: Measures of error dispersion as a function of delay duration and set size. (A) Mean absolute error. (B) Circular standard deviation. (C) Interquartile range. (D) Circular variance.
Figure 11
 
Experiment 2: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Figure 11
 
Experiment 2: Other moments of the error distribution as a function of delay duration and set size. (A) Circular mean. (B) Circular skewness. (C) Circular kurtosis.
Figure 12
 
Experiment 2: Error distributions for individual subjects by delay duration and set size.
Figure 12
 
Experiment 2: Error distributions for individual subjects by delay duration and set size.
Figure 13
 
Experiment 2: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Figure 13
 
Experiment 2: Estimates of (mean) precision as a function of delay duration and set size in four models. (A) Pure von Mises model. (B) Mixture model. (C) Variable-precision model with shared scale parameter. (D) Variable-precision model with shared shape parameter.
Figure 14
 
Experiment 2: Estimation biases. Target orientations are binned into 10° bins. (A) Scatter plot of reported versus target orientation. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). (C) Net oblique bias as a function of delay duration and set size.
Figure 14
 
Experiment 2: Estimation biases. Target orientations are binned into 10° bins. (A) Scatter plot of reported versus target orientation. (B) Bias (circular mean of error distribution) as a function of target orientation (black line with error bars). (C) Net oblique bias as a function of delay duration and set size.
Figure 15
 
Experiment 2: Histograms of the nontarget error for individual subjects by delay duration and set size.
Figure 15
 
Experiment 2: Histograms of the nontarget error for individual subjects by delay duration and set size.
Figure 16
 
Experiment 1: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 16
 
Experiment 1: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 17
 
Experiment 1: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 17
 
Experiment 1: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 18
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 18
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 19
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 19
 
Experiment 1: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 20
 
Experiment 1: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 20
 
Experiment 1: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 21
 
Experiment 1: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. Note that this descriptive model has no fewer than 48 parameters (16 conditions, three parameters per condition) and the parameter values are therefore less reliable than those of the more constrained mixture model used for Figure 5, Table 3, and Table 4; this is also reflected in the large error bars.
Figure 21
 
Experiment 1: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. Note that this descriptive model has no fewer than 48 parameters (16 conditions, three parameters per condition) and the parameter values are therefore less reliable than those of the more constrained mixture model used for Figure 5, Table 3, and Table 4; this is also reflected in the large error bars.
Figure 22
 
Experiment 2: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 22
 
Experiment 2: Fit of the pure von Mises model. The model has one precision parameter per condition.
Figure 23
 
Experiment 2: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 23
 
Experiment 2: Fit of the mixture model. The model has one precision parameter per condition and a lapse rate shared across all conditions.
Figure 24
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 24
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a scale parameter shared across all conditions.
Figure 25
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 25
 
Experiment 2: Fit of the variable-precision model with one precision parameter per condition and a shape parameter shared across all conditions.
Figure 26
 
Experiment 2: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 26
 
Experiment 2: Estimation bias as a function of target orientation (binned in 20° bins), delay duration, and set size.
Figure 27
 
Experiment 2: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. The same caveat as in Figure 21C applies.
Figure 27
 
Experiment 2: Parameters fitted per condition in a descriptive model that assumes that responses follow a mixture of a von Mises distribution centered at the target orientation, a uniform distribution reflecting guesses, and von Mises distributions centered at the distractor orientations. (A) Concentration parameter of the von Mises distribution. (B) Weight to the uniform distribution. (C) Weight to nontarget responses. The same caveat as in Figure 21C applies.
Table 1
 
Repeated-measures analysis of variance on dispersion measures in Experiment 1.
Table 1
 
Repeated-measures analysis of variance on dispersion measures in Experiment 1.
Table 2
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 1. Notes: Bold = confidence interval that does not contain 0.
Table 2
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 1. Notes: Bold = confidence interval that does not contain 0.
Table 3
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 1.
Table 3
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 1.
Table 4
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 1. Notes: Comparisons are performed using Akaike information criterion (AIC) and Bayesian information criterion (BIC). Negative values (bold) means that the null model is worse, suggesting an effect of delay duration.
Table 4
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 1. Notes: Comparisons are performed using Akaike information criterion (AIC) and Bayesian information criterion (BIC). Negative values (bold) means that the null model is worse, suggesting an effect of delay duration.
Table 5
 
Repeated-measures analyses of variance on dispersion measures in Experiment 2.
Table 5
 
Repeated-measures analyses of variance on dispersion measures in Experiment 2.
Table 6
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 2. Notes: Bold = confidence interval that does not contain 0.
Table 6
 
Ninety-five percent confidence intervals of the coefficients in a linear regression of circular standard deviation against set size (mean-centered), delay duration (mean-centered), and their product (interaction) in Experiment 2. Notes: Bold = confidence interval that does not contain 0.
Table 7
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 2.
Table 7
 
Repeated-measures analyses of variance on the estimates of log (mean) precision in different models for Experiment 2.
Table 8
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 2. Notes: Negative values (bold) means that the null model is worse, suggesting an effect of delay duration. AIC = Akaike information criterion; BIC = Bayesian information criterion.
Table 8
 
Comparison of each model against a corresponding null model in which (mean) precision only depends on set size, but not on delay duration, for Experiment 2. Notes: Negative values (bold) means that the null model is worse, suggesting an effect of delay duration. AIC = Akaike information criterion; BIC = Bayesian information criterion.
Table 9
 
Comparison of forgetting slopes (based on mean absolute errors, in °/s) with those of Pertzov et al. (2017). Notes: Delay duration was 0.1, 1, 2, or 3 s in Pertzov et al. Second column: data extracted from their figure 4 using WebPlotDigitizer (http://arohatgi.info/WebPlotDigitizer). Third column: Mean slope estimated from a linear regression to the data in their figure 1B, restricted to the working memory delays (i.e., leaving out 0.1 s).
Table 9
 
Comparison of forgetting slopes (based on mean absolute errors, in °/s) with those of Pertzov et al. (2017). Notes: Delay duration was 0.1, 1, 2, or 3 s in Pertzov et al. Second column: data extracted from their figure 4 using WebPlotDigitizer (http://arohatgi.info/WebPlotDigitizer). Third column: Mean slope estimated from a linear regression to the data in their figure 1B, restricted to the working memory delays (i.e., leaving out 0.1 s).
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×