ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article
Revised

EEG anticipation of random high and low arousal faces and sounds

[version 2; peer review: 1 approved, 1 not approved]
PUBLISHED 12 Dec 2019
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Background: In this study, we investigated the neural correlates of the anticipatory activity of randomly presented faces and sounds of both high and low arousal level by recording EEG activity with a high spatial resolution EEG system.
Methods: We preregistered the following three hypotheses: 1) a contingent Negative Variation (CNV) difference in the amplitude voltage between auditory vs faces stimuli; 2) a greater amplitude voltage in the CNV, in high arousal stimuli vs low arousal stimuli, both in auditory and faces stimuli, in the temporal  window from 0 to 1000 ms before the stimulus presentation; 3) in the time window from 0 to 1000 ms a sensory specific activation at the brain source level in the temporal lobe and auditory cortex before the presentation of an auditory stimulus and an activation of occipital area, dedicated to the elaboration of visual stimuli, before the presentation of faces .
Results: Using a preregistered, hypothesis-driven approach, we found no statistically significant differences in the CNV due to an overly conservative correction for multiple comparisons for the control of Type I error. By contrast, using a data-driven approach based on a machine learning algorithm (Support Vector Machine), we found a significantly larger amplitude in the occipital cluster of electrodes before the presentation of faces with respect to sounds, along with a larger amplitude in the right auditory cortex before the presentation of sounds with respect to faces. Furthermore, we found greater CNV activity in the late prestimulus interval for high vs. low-arousal sounds stimuli in the left centro-posterior scalp regions.
Conclusions: These findings, although preliminary, seem to support the hypothesis that the neurophysiological anticipatory activity of random events is specifically driven by either the sensory characteristics or the arousal level of future stimuli.

Keywords

anticipation, random events, EEG, source analysis, support vector machine

Revised Amendments from Version 1

Amendments from Version 1
-We have added a new Table 1 reporting the means and standard deviations of epochs of each experimental condition across subjects.
-We have added more information related to the technical description of EEG recording and Events-Related-Potentials analysis.
-We have added ERP waveforms corresponding to the comparison Faces vs Sounds Passive Task and High vs. Low arousal stimuli in the active task in the Supplementary materials as Supplementary Figure 1a/1b and Supplementary Figure 2 respectively, available at: https://doi.org/10.6084/m9.figshare.6874871.v6

See the authors' detailed response to the review by J. Bruno Debruille
See the authors' detailed response to the review by Xifu Zheng and Jingchu Hu

Introduction

When we observe the world, reality is not always chaotic and unpredictable. Rather, it shows some spatiotemporal regularities. The capacity to extract these regularities is a fundamental survival function for an organism, since it allows for the fine-grained, proactive control of resource allocation necessary for stimuli elaboration or action preparation. Taking advantage of these regularities, the brain building up inner models of external reality anticipating forthcoming events implementing its predictive aptitude by capitalizing on Bayesian computational architecture and, consequently, optimizing our behaviour over time (Friston, 2005; Mento, 2017; Mento & Vallesi, 2016; Mento et al., 2015).

This account posits the brain as a mechanism that makes continuous inferences about forthcoming stimuli on the basis of conditional probabilistic computations (Chater et al., 2006; Pouget et al., 2013) accomplished by exploiting the sensory contingencies provided by the external sensory environment and the internal representation of the events.

In the last decade, neuroimaging evidence has shown that the possibility of predicting the ‘what’, ‘when’, and ‘where’ of forthcoming events translates into anticipatory neural activity (Mento et al., 2015; Mento et al., 2018; Mento, 2017; Mento et al., 2013). Notably, the experimental paradigms of this literature took advantage of statistically predictable stimuli, where predictive information about stimulus identity and time–space features were provided by cue presentation. A consistent finding reported in the literature is the observation of a sustained, slow event-related activity preceding the onset of predicted stimuli. This wave, known in literature as the Contingent Negative Variation (CNV; Rebert & Tecce, 1973; Walter et al., 1964), has been interpreted as a general neural marker of anticipatory processes, including motor preparation, temporal expectancy, and temporal attention. Interestingly, the CNV is sensitive to the subjective (rather than objective) implementation of anticipatory processes (Mento et al., 2013; Trillenberg et al., 2000) in the context of temporally predictable events (Mento et al., 2015; Mento, 2017; Miniussi et al., 1999).

Recent studies explored the possibility of extending the study of anticipatory brain activity to statistically unpredictable stimuli (Duggan & Tressoldi, 2018; Duma et al., 2017; Mossbridge et al., 2012; Radin et al., 2011), more generally defined by Mossbridge et al. (2014) as Predictive Anticipatory Activity (PPA). In our previous work (Duma et al., 2017), we investigated brain PPA phenomena in relation to the passive presentation of randomly presented car accidents compared with safe journeys. The results showed a prestimulus greater CNV negativity amplitude for trials related to car crashes from those ending with no car accidents. These results suggested that statistically unpredictable events may nevertheless engage differential anticipatory neural activity. However, since the experimental design we employed in our previous study had possible methodological limitations in the implementation of a pseudo- rather than true-random trial sorting procedure, as well as in the use of a variable anticipatory time window, we designed a new paradigm to further address any possible procedural issues.

To address any possible methodological pitfalls, in the present work we used a trial randomization procedure mediated by a true random number generator. Unlike the implementation of a pseudo-random trial sorting procedure, this method ensures that the experimental conditions presented to participants are fully randomized, so that any possible bias arising from employing a seed-based trial selection can occur, including casual repetition of the same condition in many consecutive trials. Indeed, this issue could result in the presence of possible biases conditioning both participants’ behavioural and neural correlates. Furthermore, to avoid any possible bias due to implicit temporal expectancy of stimuli induced by a variable prestimulus interval (i.e., hazard function (Mento et al., 2015)), we purposely used a fixed prestimulus time window. As a second goal of the present study, we aimed at extending the knowledge about the nature of PPA phenomena, with the specific interest of investigating whether such phenomena are aspecific (i.e., independent from stimuli and task) or specific (i.e., different from stimulus type and task). To this end, in the current study, a group of healthy volunteers were asked to predict either the sensory category (i.e., visual or auditory) or the emotional meaning (i.e., low or high arousal level) of randomly delivered target stimuli in the context of both a passive and an active experimental task. Finally, in line with the methodological guidelines for increasing the reproducibility of scientific findings, the methodological procedure of this study was pre-registered.

Methods

Study pre-registration

The method of this study was registered before data collection and is available here: https://osf.io/uf59a

Participants

Thirty healthy participants recruited from graduate and undergraduate students of Padova University, with normal or corrected-to-normal vision participated in the experiment. Due to the high level of noise artefact, data from two participants were removed from the analysis. All participants received 10€ for their participation in the study. The study was reviewed and approved by the ethical committee of the School of Psychology of the University of Padua (Protocol No. 2278). Before the study, participants signed an informed consent in accordance with the principles expressed in the Declaration of Helsinki.

The sample size of this study was reduced with respect to what was declared in the pre-registration due to laboratory use limitation. For this reason, we were only able to collect data from 30 participants instead of the 36 declared. Furthermore two participants were rejected because of technical problems during the EEG recording. The final sample consisted of 28 participants. This final sample reduced the preregistered statistical power of our planned data analyses from .90 to .82.

Experimental design

In the present experiment, we used two sensory categories of stimuli (i.e., visual and auditory), which were extracted from two standardized international archives. Visual stimuli consisted of pictures of 28 faces extracted from the NIMSTIM archive (Tottenham et al., 2009), whereas auditory stimuli consisted of 28 sounds chosen from the International Affective Digitized Sounds (IADS) archive (Stevenson & James, 2008). For each sensory category, the stimuli were further extracted according to their arousal value. We selected 14 neutral faces and 14 fearful faces from the NIMSTIM inventory, and 14 low- and 14 high-arousal sounds were selected from the IADS repertoire and balanced by arousal with the NIMSTIM stimuli set. These materials are available here: https://doi.org/10.6084/m9.figshare.6874871.v3 (Tressoldi et al., 2018).

Experimental paradigm. All participants were presented with two different experimental tasks, which were delivered in separate blocks (see Figure 1). The first was a passive and the second was an active task preceded by a warm-up condition where the type of stimuli was anticipated in the cue signal. Both the block presentation order and the response button were counterbalanced between subjects to avoid possible response biases. The two tasks are described in the Figure 1.

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure1.gif

Figure 1. Experimental tasks.

The figure illustrates the sequence of events and the temporal trial structure relative to the passive (top) and the active (bottom) tasks, which were delivered in blocks. Within each task, the stimuli were randomly presented and equally distributed according to either sensory category (faces or sounds) and arousal level (high or low).

Passive task. As shown in Figure 1, at the beginning of each trial, participants were presented with a warning signal, a fixation cross presented centrally on the screen for 300 ms. After that, a fixed 1000ms blank inter-stimulus interval (ISI) was delivered, followed by a 500ms target stimulus. The target stimulus could be either the picture of a face presented on the centre of the screen or a sound delivered bilaterally through two loudspeakers, with a 50% distribution. Half of the stimuli within each category were low-arousal and the other half were high-arousal, equally distributed. Participants were told that they had to guess which kind of stimulus they would be presented with. No behavioural responses were required until they actually received the stimulus target. At target onset, participants had to discriminate between visual or auditory stimuli by pressing two different buttons on the response box. The response buttons were counterbalanced across participants. After the response, the stimulus target disappeared and a blank screen was presented for a jittered duration between 1000 and 1200 ms (inter-trial interval) before the beginning of the next trial.

Active task. In the active task, event sequence and timing were the same as those in the passive task. As illustrated in Figure 1, the only difference in comparison with the passive task was that, after the prestimulus ISI, participants were presented with a slide showing a central question mark. They were then asked to make an explicit choice about the sensory category of the upcoming stimulus by pressing the response box. This allowed us to obtain an overt behavioural measure of the anticipation of random events as the percentage of correct responses compared to chance-level for each stimulus category. Immediately after participants’ response, stimuli were presented for 500 ms. As with the passive task, the response buttons were counterbalanced across participants.

A total of 200 trials sorted by stimulus category and arousal was presented in each task, for an experiment duration of about 18 minutes. In both tasks, stimuli presentation was fully randomized. Specifically, the trial-type randomization was generated online during the ISI by using a true random number generator (TrueRNG-2™). The TrueRNG hardware uses the avalanche effect in a semiconductor junction to generate true random numbers. Randomization via an external TrueRNG device does not rely on seed-based randomization algorithms, but on current fluctuations within the device, assuring a true random distribution. The RNG was interfaced with the stimuli presentation software E-Prime™ 2.0.8.90.

EEG recordings

During the entire experiment, the EEG signal was continuously recorded using a Geodesic high-density EEG system (EGI GES-300) through a pre-cabled 128-channel HydroCel Geodesic Sensor Net (HCGSN-128) and referenced to the vertex. (Cz). An electrode consists of three linked components: a silver chloride–plated carbon-fiber pellet, connected by a 1-meter-long shielded wire to a Hypertronics-compatible, goldplated pin (Electrical Geodesic, Inc.). The amplifier records in DC at 24-bit, applying a gain of 20000. The sampling rate was 500 Hz. The impedance was kept below 60 kΩ for each sensor. To reduce the presence of EOG artefacts, subjects were instructed to limit both eye blinks and eye movements as much as possible.

Pre-registered data analysis

Further detail about analysis, including removal of artefacts, is available from the preregistration record: https://osf.io/uf59a.

Event-related potential (ERP) analysis. The ERP analysis was performed with Matlab toolbox EEGLAB (Delorme & Makeig, 2004). The continuous EEG signal was off-line band-pass filtered (0.1 - 45Hz) using a Hamming windowed sinc finite impulse response filter (filter order = 16500) and downsampled at 250 Hz. The EEG was segmented offline starting from 200 ms before the cue onset and ending 300 ms after the stimulus onset. The length of the analysed epoch was 1600 ms, starting from cue onset and included 300 ms of cue/fixation cross presentation, 1000 ms of ISI, and 300 ms from stimulus onset. Our original hypothesis, driven by the results of our previous study (Duma et al., 2017), was that PPA phenomena may rely on a prestimulus sustained ERP activity, presumably resulting in the amplitude modulation of the CNV component. For this reason, our confirmatory, pre-planned analysis purposely targeted the temporal window between 300 ms and 1300 ms from trial onset.

All epochs were visually inspected to remove bad channels and rare artefacts. Artefact-reduced data were then subjected to Independent Component Analysis (Stone, 2002). All independent components were visually inspected, and those related to eye blinks, eye movements, and muscle artefacts according to their morphology and scalp distribution were discarded. The remaining components were then projected back to the electrode space to obtain cleaner EEG epochs. The remaining epochs containing excessive noise or drift (±100 μV at any electrode) were rejected. After this step, removed bad channels were reconstructed. Data were then re-referenced to the average of all electrodes, and the signal was aligned to the baseline by subtracting the mean signal amplitude in the pre-stimulus interval. Subject average and grand average ERPs were generated for each electrode site and experimental condition. In the Table 1, we report the average epochs and standard deviation for each experimental condition across participants. To provide a spatial representation of the anticipatory ERP activity, we used the Brainstorm software’s dedicated software (Tadel et al., 2011). This allowed us to extract videos of obtained time-resolved scalp map projections of the grand average ERP activity from 0 ms to 1350ms.

Table 1. Mean and standard deviation of epochs of each experimental condition across subjects.

Faces
(Low Arousal)
Faces
(High Arousal)
Sounds
(Low Arousal)
Sounds
(High Arousal)
Passive Task46.61 (6.40)42.97(4.03)46.78(5.93)45.78(7.07)
Active Task45.18(7.24)44.25(7.19)45.14(7.61)43.41(6.60)
Faces (total)Sounds (Total)
Passive Task89.55(7.33)92.55(8.41)
Active Task90.44(10.20)99.44(10.72)

Brain source analysis. Baseline corrected epochs (-200 to 0 ms) were imported to Brainstorm software (Tadel et al., 2011) with the purpose of reconstructing the cortical generators of pre-stimulus ERP activity. Conductive head volume was modelled according to the Boundary Element Method (BEM) using Open MEEG toolbox (Gramfort et al., 2010; Kybic et al., 2005). The solution space was constrained to the cerebral cortex, which was modelled as a three-dimensional grid of 15002 vertices. Furthermore, the inverse transformation was applied to the Montreal Neurological Institute (MNI) canonical mesh (http://brainmap.org/training/BrettTransform.html) of the cortex to approximate real anatomy. The EEG sensor positions were co-registered with the default anatomical mesh by employing rigid rotations and translations of digitized landmarks (anterior and posterior commissure, interhemispheric scissure, nasion, and left and right tragus). The inverse modelling was based on sLORETA implemented as a routine of the Brainstorm platform. A noise covariance matrix was generated for each participant based on the average baseline time window. For each participant, the sources were projected using the standard anatomical template provided by the MNI, and their activity was transformed in Z scores relative to the baseline.

ERP statistical analysis. We compared face vs. sound pre-stimulus ERP activity (300-1300ms) at the sensor level, including all 128 electrodes. Moreover, to further address the role of arousal in anticipation of random events, we also compared the high- and low-arousal stimuli within each sensory category. Given that a 128-channel recording system and a time resolution of 2ms (500 Hz) were employed, performing a systematic comparison of all samples present a severe risk of false positives. Hence, we used a non-parametric, mass-univariate statistical approach based on paired t-test permutations (Groppe et al., 2011) already employed by our group in previous ERP studies (Duma et al., 2017; Mento et al., 2018; Mento, 2017; Mento & Vallesi, 2016; Mento & Valenza, 2016). Specifically, 1000 Monte Carlo permutations with cluster correction were applied, using Fieldtrip (Oostenveld et al., 2011) functions, implemented in Brainstorm.

Exploratory analysis. The above-mentioned statistical analyses were preregistered and hypothesis driven. We expected to find that the presence of anticipatory effects of random stimuli was reflected in an amplitude change of the CNV component elicited during the ISI. However, it should be noted that the real nature of anticipatory brain activity of statistically unpredictable stimuli has not been fully explored. Hence, it is possible that the exact spatial and temporal locus of PPA effects could be outside the time windows expected based on previous evidence. Thus, while the use of a confirmatory approach increases the reliability and reproducibility of the results, it may exclude possible interesting effects extending over temporal windows or spatial areas originally ignored in the pre-declared analyses. For this reason, we implemented additional exploratory analyses extending the epoch of interest to the entire pre-stimulus time window (i.e., from the onset of the fixation cross to the end of stimulus presentation) with the aim of looking for possible earlier effects than those expected. To test for any data-driven difference between experimental conditions, a Support Vector Machine (SVM) analysis was performed. The SVM belongs to the class of supervised machine learning models. Given a set of training data, in which the two categories are labelled, the SVM algorithm generates a model that is able to assign new examples to one category or the other. The K-folds cross-validation technique implemented in Brainstorm (Tadel et al., 2011) has been used to validate the SVM model using the ERP of each subject as data. Cross-validation is a resampling procedure for model selection. K-fold approach ‘involves randomly dividing the set of observations into k groups, or folds, of approximately equal size. The first fold is treated as a validation set, and the method is fit on the remaining k − 1 folds’ (James et al., 2013). For each task, we contrasted face and sound stimuli and high- and low-arousal stimuli separately within each stimulus category. The results of the SVM approach are expressed as the dynamic, time-resolved evolution of the discrimination accuracy between two categories. It worth mentioning that Machine Learning (ML) approach with EEG signal shows different results based one the features of the EEG signal to classify, the feature selection criterion and the classifier algorithm (Lotte et al., 2007). Moreover, to the best of our knowledge, ML approach have never been applied to classify brain activity for statistical unpredictable stimulus presentation. For these reasons, we tested different cut-off frequency (20Hz, 10Hz, 7Hz, 5Hz, 4Hz, and 3Hz) in order to understand which frequency maximized the classification accuracy of the algorithm.

Results

Behavioural findings

The descriptive statistics relative to the percentages of the correct predictions of faces and sounds in the active block are reported in Table 2.

Table 2. Means and standard deviations of the percentages of correct faces and sounds predictions.

FacesSounds
Mean52.651.0
SD5.75.7

The inferential statistics based on a one-tailed, one-sample t-test with the null hypothesis of 50% corresponding to the chance level yielded the following results: Faces, t-test = 2.3; p = .01; effect size d = .45; 95% CI = .019 - .85; Sounds, t-test = .97; p = .16; effect size d = .19; 95% CI = -.20 - .60.

Sensor-level ERP

The mean number of artefact-free trials per subject accepted for averaging was comparable both in the passive (Faces: 90 ± 7.79; Sounds: 92 ± 9.3) as well as in the active (Faces: 90.60 ± 10.1; Sounds: 99 ± 10) task. Likewise, the number of high- and low-arousal stimuli within each stimulus category was comparable both in the passive (Low Arousal Faces: 46.6 ± 6.34; High Arousal Faces: 43.4 ± 4.52; Low Arousal Sounds: 46.5 ± 6.6; High Arousal Sounds: 45.67 ± 6.83) and active task (Low Arousal Faces: 46.21 ± 7.6; High Arousal Faces: 44.4 ± 6.8, Low Arousal Sounds: 45.35 ± 7.57; High Arousal Sounds: 43.68 ± 6.56). This confirmed that the true-random trial sorting procedure was effective in generating an equivalent number of trials per condition, ensuring a comparable ERP signal-to-noise ratio.

As expected based on previous literature (Mento et al., 2013; Walter et al., 1964), the visual inspection of ERP waveforms revealed the presence of a reliable CNV component in all tasks. This component was represented as an increase in fronto-central negativity about 500 ms from trial onset and lasting for the full duration of the ISI duration until stimulus onset. The topographical distribution of this activity for each task is shown in Figure 2 and Figure 3 for face vs. sound and high- vs. low-arousal contrasts, respectively (see also https://doi.org/10.6084/m9.figshare.6874871.v3 (Tressoldi et al., 2018) for a time-resolved dynamic spatial representation of the CNV over the whole scalp).

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure2.gif

Figure 2. Scalp maps of the mean activity in the 300–1300 ms prestimulus time window in passive (central column) and active (right column) tasks for face (first row) and sound (second row) stimuli after collapsing the arousal level.

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure3.gif

Figure 3. Scalp map mean activity in the 300 – 1300ms prestimulus window in the passive (left column) and active (right column) task for faces and sound (high and low arousal, third and fourth row, respectively).

Faces vs. sounds

The visual inspection of the high scalp-resolution maps obtained by averaging the CNV time window (i.e., 300–1300ms) showed prestimulus differences in the topographical distribution between faces and sounds, with a greater fronto-central negativity for face type stimuli (Figure 2). This difference was less evident in the active block.

High- vs. low-arousal stimuli

Concerning arousal level, the scalp distribution maps displayed an increase in the fronto-central negativity for high-arousal face stimuli compared to low-arousal stimuli in the passive task, as well as a differential map localization of the CNV between high- and low-arousal sound stimuli. Notably, this brain activity pattern was not consistent across tasks. In the active task, low- and high- arousal stimuli elicited a comparable fronto-central negativity, although a larger posterior positivity was evident for low-arousal face and high-arousal sound (Figure 3).

Although the visual inspection of the spatial maps revealed qualitative topographical differences, in none of the two tasks did the non-parametric, permutation analyses performed in the pre-registered anticipatory epoch (300–1300ms from warning onset) reveal statistically significant effects, whether when comparing stimulus categories or when contrasting stimuli arousal within categories.

A possible explanation of the lack of significant statistical corroboration of visual differences may be that mass univariate statistical tests are strongly sensitive to the presence of random factors, as in the case of including the whole spatial information (128 electrodes). This may ultimately result in excluding experimental effects strictly localized in specific scalp regions or temporal windows. As mentioned above, the hypotheses about the spatio-temporal properties of PPA induced by the present experimental manipulations were driven by our previous study (Duma et al., 2017), which showed a broad fronto-central and long lasting CNV modulation in anticipation of random simulated car accidents. However, in that study, we used a low spatial resolution EEG system (32 vs. 128 channels) as well as a lower signal acquisition sampling rate (i.e., 250 vs. 500 Hz). In hindsight, this methodological difference may explain the disappearance of significant results due to a strong multiple-comparison correction. In line with this possible explanation, we observed that the fronto-central electrode activity in both tasks showed significant modulatory effects when permutations were performed without applying cluster-based correction for controlling Type 1 error.

Source level results

Our pre-registered analyses included the reconstruction of the source level maps. Although the massive cluster-based correction for multiple comparisons did not yield statistically significant observed differences between the conditions, we report the cortex activation results in Figure 4.

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure4.gif

Figure 4. Normalized source maps of the mean activity in the pre-stimulus time window (between 300–1300ms) relatively to each task and condition.

From the cortical source map reconstruction, it is possible to identify a common activation for both tasks and stimulus categories in the superior frontal gyrus bilaterally, namely the Supplementary Motor Area that in literature has been identified as one of the most reliable neural generators of CNV (Mento et al., 2013; Mento et al., 2015; Mento, 2017). In addition to this, the cortical maps suggest the possible presence of stimulus-driven differences in primary sensory areas. In spite of this, the source-level results can be considered merely descriptive, rather than offering reliable hints for any inferential reasoning. In fact, considering the absence of statistically significant results at the sensor level, any strong interpretation from source space findings is to be discouraged as a precaution. While bearing these methodological issues in mind, one should nonetheless take into account that both sensor- and source-level descriptive results could be deemed suggestive of the possible presence of subtle effects to be further explored with ad-hoc analyses. To follow up on this indication, we performed additional exploratory statistical analyses extending over earlier temporal windows in an attempt to specifically focus on the possible presence of specific, fine-grained experimental effects.

Exploratory results

Support vector machine results. The data were analyzed with SVM algorithm by applying different exploratory frequency thresholds (20Hz, 10Hz, 7Hz, 5Hz, 4Hz, and 3Hz, with a folding parameter of 5). The best algorithm performance in terms of experimental condition discrimination was obtained by applying a 4 Hz threshold, which was then set as the target SVM frequency. As shown in Figure 6, the application of SVM in the passive task succeeded in discriminating between Face and Sound in the time window 100–300ms, reaching a discrimination accuracy value of 71.43% (see Figure 5).

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure5.gif

Figure 5. Support Vector Machine decoding accuracy in time in the passive task.

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure6.gif

Figure 6. Support Vector Machine Decoding accuracy in time in the active task.

In the active task, the SVM was able to correctly differentiate between high- and low-arousal sounds, reaching a decoding accuracy of 68%, but in a later temporal window, between 1100 and 1300ms (see Figure 6).

To statistically confirm the SVM findings while accounting for all spatial information, we applied cluster-based permutation statistics taking into account all 128 channels, this time targeting the specific contrasts and temporal windows indicated by the SVM algorithm as exhibiting effects.

Concerning the passive task, the results showed a bilateral posterior significant cluster of electrodes (p = .01966, cluster statistic = 39, cluster size = 28) when we compared face and sound stimuli in the 100–300ms time window. Concerning the active task, we found a significant left centro-posterior cluster (p = .047, cluster statistic = 25, cluster size = 18) when high-arousal sounds are compared to low-arousal sounds. These differences are presented in Figure 7. The ERP waveforms corresponding to the comparison Faces vs Sounds Passive Task and High vs. Low arousal stimuli in the active task have been added in the Supplementary material as Supplementary Figure 1 and Supplementary Figure 2 respectively available at: https://doi.org/10.6084/m9.figshare.6874871.v6.

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure7.gif

Figure 7. Statistically significant differences in the 100–300ms time window.

a) in the occipital cluster for face vs sound stimuli comparison in the passive task; b) in the parietal cluster for high- vs low-arousal sound comparison in the active task.

SVM guided source level

To further address the functional nature of these phenomena, we performed the reconstruction of the cortical source of both effects described above. Both the source-level topological distribution (source mean activity between 300–1300ms) and temporal evolution over the whole prestimulus epoch are depicted in Figure 8.

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure8.gif

Figure 8. The source activations represent the mean activity in the source space between 100–300ms (neutral fixation cross time window).

The time series below represent the time evolution of the source activation, highlighting the difference between 100–300ms (blue rectangle), respectively of the lateral occipital left (on the left) and superior temporal right (on the right).

Relative to the early anticipatory effect, we observed a higher recruitment of the occipital–parietal left cortical regions, especially the lateral occipital gyrus, which was more activated before the presentation of faces regardless of the arousal they expressed. The visual inspection of the temporal dynamics showed that this region is highly activated at about 200 ms from the presentation of the fixation cross when a face was presented. No other relevant modulations are present in the late prestimulus interval spanning the CNV timing. A second remarkable finding was a larger recruitment of neural activity in the right superior temporal gyrus, again at about 200ms when a sound was presented. Both of the above findings corroborate our original, pre-declared hypothesis that PPA brain activity is category-dependent, since it engages in the same primary sensory areas that will be activated after target presentation. In other words, the anticipation of a face pre-activates visual occipital areas lefts lateralized, whereas the anticipation of a sound pre-activates auditory temporal areas more lateralized in the right hemisphere.

When performed on the second temporal window showing late prestimulus ERP amplitude modulation between high- and low-arousal auditory stimuli in the active task, the cortical reconstruction showed that high-arousal stimuli were preceded by the recruitment of a broader cortical network as compared to low-arousal stimuli. Indeed, in both cases, the fronto-central areas around the SMA were commonly activated. However, when the fixation was actually followed by the presentation of high-arousal stimuli, we observed an additional involvement of the left superior parietal area, maximally expressed between 1100 and 1300ms from its onset (see Figure 9).

38b2545c-9a6c-4e90-88c1-b80dc3cbb5cd_figure9.gif

Figure 9. Mean activity in 1100–1300ms time window of high- and low-arousal sound stimuli in the active block.

Below in the figure, it is represented the time course of the superior parietal left area of the Desikan-Killaney atlas.

Discussion

In a recent study (Duma et al., 2017), we reported evidence of differential anticipatory brain activity preceding unpredictable, simulated car crashes or safe journeys. Here, we sought to further investigate the evidence of psychophysiological predictive activity (PPA; Mossbridge et al., 2014) of random events while further ruling out potential methodological shortcomings due to the randomization process and stimulus timing. As a general consideration, it must be taken into account that the available evidence in existing literature about the neurophysiological mechanisms underpinning the anticipation of random events is limited. Hence, it is difficult to generate clear and reliable hypotheses with regard to the spatial and temporal neural locus of such phenomena. Notwithstanding this caveat, a commonly accepted idea is that if the brain is able to anticipate statistically unpredictable random stimuli, different forthcoming stimuli categories should rely on specific and dissociable anticipatory neural patterns. More precisely, this anticipatory effect might be reflected in the pre-activation of the brain regions that subtend the elaboration of the physical features of upcoming stimuli (e.g., a pre-activation of the auditory cortical regions preceding the onset of a sound as well as of visual regions preceding face presentation). Following this line of reasoning in our previous work, we had argued that the capability of anticipating potentially threatening events (e.g. simulated car accidents) may result in the mobilization of psychophysical resources to implement a possible reaction, this mechanism putatively playing a key role in survival.

Based on the above assumptions, the aim of the present study was two-fold. On the one hand, we tried to address some potential methodological issues that may have somehow biased our previous study. These included either the implementation of a pseudo-random instead of truly random trial sorting procedure or the use of a variable temporal trial structure. On the other hand, we tried to extend our previous results into other stimuli category with the aim of deepening the understanding of the sources of anticipatory brain activity of randomly presented stimuli.

To address these goals in the present study, we recorded the high spatial resolution EEG activity when presenting two different stimulus categories in a random, unpredictable sequential order. These included pictures of faces and sounds as visual and auditory sensory categories, respectively. Moreover, we further manipulated the psychophysiological activation meaning of those categories by matching them by arousal level (high or low). All stimuli were randomly presented by interfacing with a true random number generator. As in our original hypothesis, we expected to identify at the EEG sensor level a stimulus type and/or arousal level dependent difference during the prestimulus time window. Specifically, following our pre-registered hypothesis we expected to observe some stimulus-driven amplitude differential effects arising from about 1000ms before stimulus onset. Moreover, we hypothesized that such differences may stem from specific neural patterns mimicking the sensory nature of the stimulus. That is, we expected to observe source-level pre-activation of visual cortical areas before faces and pre-activation of auditory cortical areas before sounds.

The cluster-based permutation analyses of the target pre-stimulus time window (i.e., 300–1300ms from trial onset) showed only a marginally significant CNV modulation due to experimental manipulation. Indeed, the application of a massive cluster-based multiple-comparison correction taking into account the whole spatial information (128 electrodes) as well as a huge temporal window (as long as 1 second, i.e., between 300 and 1300ms from trial onset) did not confirm this effect from a statistically point of view.

As mentioned above, a possible explanation for this null effect is that the implementation of a whole-scalp analysis may have been too conservative for a subtle experimental effects. In fact, in our previous study (Duma et al., 2017) we used a lower resolution EEG system (32 electrodes), which ultimately resulted in a considerably smaller number of multiple comparisons. In other words, the analysis of a large, complex spatiotemporal dataset may have requested a stronger statistical power.

However, we decided to further analyse our data by applying an exploratory approach. To this purpose we used an SVM as a machine-learning classificatory algorithm. In the passive task, this analysis revealed a data-driven discrimination accuracy of 71.43% between visual and auditory stimuli which occurred in an early temporal window (100–300ms from trial onset). In the active task, the SVM algorithm revealed a later data-driven effect (maximum peak 68%) spanning in the late CNV range (1100–1300ms from trial onset), which was specific for the arousal level. It should be underlined that SVM results have been used as a guide indicating in which conditions and temporal windows focusing the analysis. These results were further confirmed by a cluster-based permutation statistics, which were performed targeting the specific temporal windows identified by the SVM. In fact, by applying cluster-based permutation statistics over the temporal window (100–300ms) and conditions (passive face vs. sound), as evidenced by SVM results, we observed a significant bilateral occipital cluster of electrodes showing larger amplitude when the fixation cross at trial onset was followed by visual than auditory stimuli. These prestimulus activities were supported by different cortical networks. Indeed, we found that the visual areas (i.e., the left lateral occipital lobe) were more activated at about 200ms from trial onset in trials displaying faces than in those delivering sounds. Differently the right auditory cortex was more activated in trials containing sounds than in those delivering faces.

Additionally, we found that in the active task when participants were explicitly asked to guess the category of the forthcoming stimulus (face or sound) the percentage of correct responses (52%) was significantly higher than chance level. This behavioural finding was accompanied by a larger CNV activity in the late prestimulus interval (1100–1300ms) for high- vs. low-arousal stimuli. This effect was localized in the left centro-posterior scalp regions and originated from a specific pre-activation of the left superior parietal cortex, which showed a larger sustained activity before high-arousal stimuli in the late prestimulus interval. Although the exact functional role of the superior parietal cortex in the anticipation of random, high-arousal sounds is not well understood on the basis of current scanty literature, a possible generic explanation may maintain that this region is involved in the pre-allocation of cognitive resources needed to process predicted high-arousal stimuli.

Although obtained by exploratory, rather than originally planned, confirmatory hypotheses, these results are in line with the expectations of a stimulus-dependent pre-activation of those brain regions that will be engaged in processing the upcoming stimulus.

While we feel reasonably confident in excluding that the presence of anticipatory effects of random events may have been biased by possible methodological shortcomings, the interpretation of the possible nature of such phenomena is still debated. In line with one of the most shared theoretical accounts, our results may be explained in the theoretical framework of the Predictive Anticipatory Activity (PAA) of Mossbridge et al. (2014). The underlying assumption of this kind of empirical evidence maintains that PAA might be thought of as an unconscious anticipation of a conscious future events, suggesting the possibility of quantum-like temporal entanglement effects in human physiological processes (Fisher, 2015; Hameroff, 2012; Jedlicka, 2017; Tressoldi et al., 2015). The endorsement of quantum-like phenomena as possible mediating mechanisms of physiological processes taking place in random event prediction, implies the possibility of temporal symmetry in the interpretation of reality (Reznik & Aharonov, 1995) or even possible retrocausal effects (Ma et al., 2012).

Whatever the specific physical and physiological nature of anticipatory mechanisms, which is beyond the original purpose of the present study, we report a methodologically-controlled and replicable experimental setting that suggests the reliability of PPA phenomena. To the best of our knowledge, this is the first work in which advanced techniques, such as high-spatial resolution EEG and source reconstruction, have been applied to the investigation of PPA phenomena in combination with the implementation of both confirmatory and exploratory methodological approaches. This allowed us to present new data complementing previous evidence because we argue that PPA phenomena may be driven by specific brain processes, which involves discrete brain areas according to the sensorial category of the upcoming stimulus.

In scientific literature, criticism have been raised regarding the anticipatory effects for statistically unpredictable stimuli (Galak et al., 2012; Ritchie et al., 2012; Wagenmakers et al., 2011), criticizing the findings reported by Bem (2011). Nonetheless, we believe that those criticisms cannot be related to our work, both for theoretical and methodological reasons. First, Bem’s results were referred to the so called ‘Retroactive Facilitation of Recall’. In fact, as stated by the author, in his experimental task “Participants were first shown a set of words and given a free recall test of those words. They were then given a set of practice exercises on a randomly selected subset of those words. The psi hypothesis was that the practice exercises would retroactively facilitate the recall of those words, and, hence, participants would recall more of the to-be-practiced words than the unpracticed words” (Bem, 2011). By contrast, our theoretical framework emerges from the already published results of Duma et al., 2017, Mossbridge et al. (2012), Mossbridge et al. (2014), and Radin et al. (2011), who investigated physiological activity (EEG, EMG, pupillary response) before stimuli randomly presented, finding positive results. Therefore, considering the evidence already published, and the evident difference between Bem’s study and the one we are presenting, both in the type of measures (behavioural vs. electrophysiological), and the experimental paradigm (words recall vs. face/sound passive presentation), we believe that the possible criticisms raised by the abovementioned authors cannot be by default applied to all the studies investigating anticipatory phenomena, including the present one.

We are aware that the present topic needs additional confirms from scientific literature. For this reason, we believe that the present results may be a stimulus to other researchers to investigate, with a rigorous and fully reproducible methodological approach, the real nature of anticipatory effects for statistically unpredictable stimuli, deepening in this way our understanding.

For example, future replications of the present study may include single-subject MRI scans with the objective of localizing a single subject’s visual and auditory cortex, using those areas as ROI to be entered in a multivariate statistic approach. Taking in account the growing body of literature providing experimental results to the human capability of anticipating randomly presented stimuli, we believe that this topic deserves a precise and rigorous scientific investigation, as it happens for all cognitive human activities, in order to understand this controversial but nevertheless fascinating phenomena.

Data availability

Underlying data

Figshare: EEG anticipation of random high and low arousal faces and sounds, https://doi.org/10.6084/m9.figshare.6874871.v6 (Tressoldi et al., 2018).

This project contains that following underlying data:

  • EEG metafile;

  • EEG data related to the Passive, Active and Predictive conditions;

  • High (H) and Low (L) arousal visual and auditory stimuli;

  • Video clips of the EEG activity before stimulus presentation.

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

NIMSTIM archive materials available from http://www.macbrain.org/resources.htm. Registration and acceptance of the terms and conditions of the website must be completed in order to use the stimulus set.

International Affective Digitized Sounds (IADS) archive materials available from: https://csea.phhp.ufl.edu/media/iadsmessage.html. Those wishing to use these materials must submit the IADS Researcher Information Form and sign the IADS User Agreement.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 27 Aug 2019
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Duma GM, Mento G, Semenzato L and Tressoldi PE. EEG anticipation of random high and low arousal faces and sounds [version 2; peer review: 1 approved, 1 not approved]. F1000Research 2019, 8:1508 (https://doi.org/10.12688/f1000research.20277.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 12 Dec 2019
Revised
Views
39
Cite
Reviewer Report 17 Dec 2019
J. Bruno Debruille, Department of Neuroscience, McGill University, Montreal, QC, Canada 
Not Approved
VIEWS 39
Thank you for your detailed and thoughtful responses. Really appreciated.
It is great to see the kind of electrodes that were used and that DC amplifiers were in charge of amplifying their signals, as is appropriate for getting CNVs, ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Debruille JB. Reviewer Report For: EEG anticipation of random high and low arousal faces and sounds [version 2; peer review: 1 approved, 1 not approved]. F1000Research 2019, 8:1508 (https://doi.org/10.5256/f1000research.23734.r57719)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 05 Feb 2020
    Patrizio Tressoldi, Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy
    05 Feb 2020
    Author Response
    We thank the reviewer for the precious suggestions, it is evident that all the given recommendations are focused on the improvement of the work. His main criticisms derive from the ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 05 Feb 2020
    Patrizio Tressoldi, Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy
    05 Feb 2020
    Author Response
    We thank the reviewer for the precious suggestions, it is evident that all the given recommendations are focused on the improvement of the work. His main criticisms derive from the ... Continue reading
Version 1
VERSION 1
PUBLISHED 27 Aug 2019
Views
31
Cite
Reviewer Report 19 Nov 2019
Xifu Zheng, School of Psychology, South China Normal University, Guangzhou, China 
Jingchu Hu, South China Normal University, Guangzhou, China 
Approved
VIEWS 31
The manuscript "EEG anticipation of random high and low arousal faces and sounds" reports results from a study involving anticipatory activity, wherein sensory characteristic and arousal level are experimentally manipulated. By using a machine learning algorithm (Support Vector Machine), they found ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Zheng X and Hu J. Reviewer Report For: EEG anticipation of random high and low arousal faces and sounds [version 2; peer review: 1 approved, 1 not approved]. F1000Research 2019, 8:1508 (https://doi.org/10.5256/f1000research.22279.r54053)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 12 Dec 2019
    Patrizio Tressoldi, Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy
    12 Dec 2019
    Author Response
    1. The authors should report exact number of participants in last paragraph of their introduction,
    instead of "a group of healthy volunteers".

    Reply: We thank the reviewer for the suggestion we added ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 12 Dec 2019
    Patrizio Tressoldi, Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy
    12 Dec 2019
    Author Response
    1. The authors should report exact number of participants in last paragraph of their introduction,
    instead of "a group of healthy volunteers".

    Reply: We thank the reviewer for the suggestion we added ... Continue reading
Views
30
Cite
Reviewer Report 18 Oct 2019
J. Bruno Debruille, Department of Neuroscience, McGill University, Montreal, QC, Canada 
Not Approved
VIEWS 30
For this first round of review, the first thing to do is to add the ERPs elicited by the cross from the time the baseline started to be computed up to the end of the ERPs elicited by the stimuli ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Debruille JB. Reviewer Report For: EEG anticipation of random high and low arousal faces and sounds [version 2; peer review: 1 approved, 1 not approved]. F1000Research 2019, 8:1508 (https://doi.org/10.5256/f1000research.22279.r54538)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 12 Dec 2019
    Patrizio Tressoldi, Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy
    12 Dec 2019
    Author Response
    We are very grateful to dr. Debruille for his insightful comments and suggestions. In the current revision we tried to address, to the best of our possibility, most of the ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 12 Dec 2019
    Patrizio Tressoldi, Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy
    12 Dec 2019
    Author Response
    We are very grateful to dr. Debruille for his insightful comments and suggestions. In the current revision we tried to address, to the best of our possibility, most of the ... Continue reading

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 27 Aug 2019
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.