For all models, statistical significance for main effects and interactions was determined via a likelihood ratio (LR) test against a reduced nested model excluding the fixed term (i.e., Type II sum of squares, SS), and statistical significance for parameter coefficients was determined according to Wald
z-test (
Fox, 2016). To provide support for null results (
p > 0.05), we additionally calculated the Bayes factor (BF) between the full and reduced model, using bayesian information criterion (BIC) approximation (
Wagenmakers, 2007). BF is reported with the null result in the denominator (
BF01), representing how much the data are supported by the null model relative to the full model. The model's random effect structure was selected according to the model that was found to be most parsimonious with the data, that is, the fullest model that the data permit while still converging with no singular estimates (
Bates, Kliegl, Vasishth, & Baayen, 2015), in order to balance between Type I error and statistical power (
Matuschek, Kliegl, Vasishth, Baayen, & Bates, 2017). This was achieved by starting with a random intercept by subject-only model and continuing to a model with random slopes for fixed terms by subject and their correlation parameters, and from there to a random-interaction slopes-by-subject model, testing for model convergences in each step. Models that failed to converge were trimmed by the random slope with the least explained variance and were retested. Analyses were performed in R v4.0.3 using RStudio v1.3.959 (
R Core Team, 2018). Modeling was performed using the lme4 (
Bates, Mächler, Bolker, & Walker, 2015) package, BF was calculated using the BayesFactor package (
Morey & Rouder, 2018), and model diagnostics were performed using the performance package (
Lüdecke, Makowski, & Waggoner, 2020). An R-markdown file describing all the model-fitting steps and diagnostic checks on the final model is available at the project's OSF repository (see Data availability statement).