EEG/ECoG/EMG publications

This protocol was used to collect data now published in the Journal of Neural Engineering, Sources of off-target effects of vagus nerve stimulation using the helical clinical lead in domestic pigs, see Metadata for citation. Additionally, the dataset is publicly available on Pennsieve 10.26275/qcuk-a8ty.

In speech, listeners extract continuously-varying spectrotemporal cues from the acoustic signal to perceive discrete phonetic categories. Spectral cues are spatially encoded in the amplitude of responses in phonetically-tuned neural populations in auditory cortex. It remains unknown whether similar neurophysiological mechanisms encode temporal cues like voice-onset time (VOT), which distinguishes sounds like / b / and/ p /. We used direct brain recordings in humans to investigate the neural encoding of temporal speech cues with a VOT continuum from / ba / to / pa /. We found that distinct neural populations respond preferentially to VOTs from one phonetic category, and are also sensitive to sub-phonetic VOT differences within a population’s preferred category. In a simple neural network model, simulated populations tuned to detect either temporal gaps or coincidences between spectral cues captured encoding patterns observed in real neural data. These results demonstrate that a spatial/amplitude neural code underlies the cortical representation of both spectral and temporal speech cues.

Numerous studies have investigated the cortical representation and time course of responses to auditory signals with and without pitch. However, little is known regarding the responses evoked by pitch changes. To study the spatial as well as temporal characteristics of cortical activity elicited by voice pitch changes, combined functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) data were obtained from normal-hearing listeners presented with continuous vowel sequences in which the prosodic contours either varied between the individual vowels or were the same throughout. The fNIRS topographies and the EEG source reconstructions indicated additional right-hemispheric activity anterior to the primary auditory cortex and in the superior temporal sulcus for sequences with variable prosody. Additionally, the time courses of the fNIRS signals showed that activity was more sustained in response to sequences with changing prosodic contours. The EEG data revealed a similar pattern for the P2 amplitude, which was smaller during the second half for blocks with fixed prosody, whereas the P1 was consistently larger for sequences with variable prosody. Moreover, the sources of the P2, but not the P1, were lateralised to the right, suggesting that the hemispheric asymmetry in the processing of voice pitch changes develops over time.

BHA (aka high gamma) correlates with neuronal firing, but is generated mainly by dendritic processes separable from firing.

A noninvasive sleep screen uncovers a Vamp2 mouse mutation with synaptic deficits underlying substantial sleep disturbances.

Fragile X Syndrome (FXS) is a leading known genetic cause of intellectual disability. Many symptoms of FXS overlap with those in autism including repetitive behaviors, language delays, anxiety, social impairments and sensory processing deficits. Electroencephalogram (EEG) recordings from humans with FXS and an animal model, the Fmr1 knockout (KO) mouse, show remarkably similar phenotypes suggesting that EEG phenotypes can serve as biomarkers for developing treatments. This includes enhanced resting gamma band power and sound evoked total power, and reduced fidelity of temporal processing and habituation of responses to repeated sounds. Given the therapeutic potential of the antibiotic minocycline in humans with FXS and animal models, it is important to determine sensitivity and selectivity of EEG responses to minocycline. Therefore, in this study, we examined if a 10-day treatment of adult Fmr1 KO mice with minocycline (oral gavage, 30 mg/kg per day) would reduce EEG abnormalities. We tested if minocycline treatment has specific effects based on the EEG measurement type (e.g., resting versus sound-evoked) from the frontal and auditory cortex of the Fmr1 KO mice. We show increased resting EEG gamma power and reduced phase locking to time varying stimuli as well as the 40 Hz auditory steady state response in the Fmr1 KO mice in the pre-drug condition. Minocycline treatment increased gamma band phase locking in response to auditory stimuli, and reduced sound-evoked power of auditory event related potentials (ERP) in Fmr1 KO mice compared to vehicle treatment. Minocycline reduced resting EEG gamma power in Fmr1 KO mice, but this effect was similar to vehicle treatment. We also report frequency band-specific effects on EEG responses. Taken together, these data indicate that sound-evoked EEG responses may serve as more sensitive measures, compared to resting EEG measures, to isolate minocycline effects from placebo in humans with FXS. Given the use of minocycline and EEG recordings in a number of neurodegenerative and neurodevelopmental conditions, these findings may be more broadly applicable in translational neuroscience.

Objectives. Cochlear implant (CI) users typically report impaired ability to understand speech in noise. Speech understanding in CI users decreases with noise due to reduced temporal processing ability, and speech perceptual errors involve stop consonants distinguished by voice onset time (VOT). The current study examined the effects of noise on various speech perception tests while at the same time used cortical auditory evoked potentials (CAEPs) to quantify the change of neural processing of speech sounds caused by noise. We hypothesized that the noise effects on VOT processing can be reflected in N1/P2 measures, the neural changes relate to behavioral speech perception performances.Methods. Ten adult CI users and 15 normal-hearing (NH) people participated in this study. CAEPs were recorded from 64 scalp electrodes in both quiet and noise (signal-to-noise ratio +5 dB) and in passive and active (requiring consonant discrimination) listening. Speech stimulus was synthesized consonant-vowels with VOTs of 0 and 50 ms. N1-P2 amplitudes and latencies were analyzed as a function of listening condition. For the active condition, the P3b also was analyzed. Behavioral measures included a variety of speech perception tasks.Results. For good performing CI users, performance in most speech test was lower in the presence of noise masking. N1 and P2 latencies became prolonged with noise masking. The P3b amplitudes were smaller in CI groups compared to NH. The degree of P2 latency change (0 vs. 50 ms VOT) was correlated with consonant perception in noise.Conclusion. The effects of noise masking on temporal processing can be reflected in cortical responses in CI users. N1/P2 latencies were more sensitive to noise masking than amplitude measures. Additionally, P2 responses appear to have a better relationship to speech perception in CI users compared to N1.

Objective Clinical data suggest that efficacious vagus nerve stimulation (VNS) is limited by side effects such as cough and dyspnea that have stimulation thresholds lower than those for therapeutic outcomes. VNS side effects are putatively caused by activation of nearby muscles within the neck, via direct muscle activation or activation of nerve fibers innervating those muscles. Our goal was to determine the thresholds at which various VNS-evoked effects occur in the domestic pig—an animal model with vagus anatomy similar to human—using the bipolar helical lead deployed clinically. Approach Intrafascicular electrodes were placed within the vagus nerve to record electroneurographic (ENG) responses, and needle electrodes were placed in the vagal-innervated neck muscles to record electromyographic (EMG) responses. Main results Contraction of the cricoarytenoid muscle occurred at low amplitudes (∼0.3 mA) and resulted from activation of motor nerve fibers in the cervical vagus trunk within the electrode cuff which bifurcate into the recurrent laryngeal branch of the vagus. At higher amplitudes (∼1.4 mA), contraction of the cricoarytenoid and cricothyroid muscles was generated by current leakage outside the cuff to activate motor nerve fibers running within the nearby superior laryngeal branch of the vagus. Activation of these muscles generated artifacts in the ENG recordings that may be mistaken for compound action potentials representing slowly conducting Aδ-, B-, and C-fibers. Significance Our data resolve conflicting reports of the stimulation amplitudes required for C-fiber activation in large animal studies (>10 mA) and human studies (<250 μ A). After removing muscle-generated artifacts, ENG signals with post-stimulus latencies consistent with Aδ- and B-fibers occurred in only a small subset of animals, and these signals had similar thresholds to those that caused bradycardia. By identifying specific neuroanatomical pathways that cause off-target effects and characterizing the stimulation dose-response curves for on- and off-target effects, we hope to guide interpretation and optimization of clinical VNS.

Sleep homeostasis manifests as a relative constancy of its daily amount and intensity. Theoretical descriptions define ‘Process S’, a variable with dynamics dependent on global sleep-wake history, and reflected in electroencephalogram (EEG) slow wave activity (SWA, 0.5–4 Hz) during sleep. The notion of sleep as a local, activity-dependent process suggests that activity history must be integrated to determine the dynamics of global Process S. Here, we developed novel mathematical models of Process S based on cortical activity recorded in freely behaving mice, describing local Process S as a function of the deviation of neuronal firing rates from a locally defined set-point, independent of global sleep-wake state. Averaging locally derived Processes S and their rate parameters yielded values resembling those obtained from EEG SWA and global vigilance states. We conclude that local Process S dynamics reflects neuronal activity integrated over time, and global Process S reflects local processes integrated over space.

Our understanding of nonlinear stimulus transformations by neural circuits is hindered by the lack of comprehensive yet interpretable computational modeling frameworks. Here, we propose a data-driven approach based on deep neural networks to directly model arbitrarily nonlinear stimulus-response mappings. Reformulating the exact function of a trained neural network as a collection of stimulus-dependent linear functions enables a locally linear receptive field interpretation of the neural network. Predicting the neural responses recorded invasively from the auditory cortex of neurosurgical patients as they listened to speech, this approach significantly improves the prediction accuracy of auditory cortical responses, particularly in nonprimary areas. Moreover, interpreting the functions learned by neural networks uncovered three distinct types of nonlinear transformations of speech that varied considerably from primary to nonprimary auditory regions. The ability of this framework to capture arbitrary stimulus-response mappings while maintaining model interpretability leads to a better understanding of cortical processing of sensory signals.

The mechanical mismatch between implantable interfaces and neural tissues may be reduced by employing soft polymeric materials. Here, we report on a simple strategy to prepare and pattern a soft electrode coating of neural interfacing devices based on a screen-printable conducting hydrogel. The coating formulation, based on polyacrylamide and poly(3,4-ethylenedioxythiophene) polystyrene sulfonate, is suitable to additive manufacturing and exhibits excellent adhesion to polydimethylsiloxane, an elastomer commonly used as a substrate in soft neural interfaces. The soft conductive coating displays a tunable elastic modulus in the 10–100 kPa range and electrochemical properties on a par with stiff conductive inks while supporting good neural cell attachment and proliferation in vitro. Next, the soft printable hydrogel is integrated within a 4 × 4 microelectrode array for electrocorticography with 250 μm-diameter contacts. Acute recording of cortical local field potentials and electrochemical characterization preimplantation and postimplantation highlight the stability of the soft organic conductor. The overall robustness of the soft coating and its patterning method provide a promising route for a range of implantable bioelectronic applications.

Repeated stimulus presentations commonly produce decreased neural responses—a phenomenon known as repetition suppression (RS) or adaptation—in ventral temporal cortex (VTC) of humans and nonhuman primates. However, the temporal features of RS in human VTC are not well understood. To fill this gap in knowledge, we utilized the precise spatial localization and high temporal resolution of electrocorticography (ECoG) from nine human subjects implanted with intracranial electrodes in the VTC. The subjects viewed nonrepeated and repeated images of faces with long-lagged intervals and many intervening stimuli between repeats. We report three main findings: 1) robust RS occurs in VTC for activity in high-frequency broadband (HFB), but not lower-frequency bands; 2) RS of the HFB signal is associated with lower peak magnitude (PM), lower total responses, and earlier peak responses; and 3) RS effects occur early within initial stages of stimulus processing and persist for the entire stimulus duration. We discuss these findings in the context of early and late components of visual perception, as well as theoretical models of repetition suppression.

Listeners differ in their ability to attend to a speech stream in the presence of a competing sound. Differences in speech intelligibility in noise cannot be fully explained by the hearing ability which suggests the involvement of additional cognitive factors. A better understanding of the temporal fluctuations in the ability to pay selective auditory attention to a desired speech stream may help in explaining these variabilities. In order to better understand the temporal dynamics of selective auditory attention, we developed an online auditory attention decoding (AAD) processing pipeline based on speech envelope tracking in the electroencephalogram (EEG). Participants had to attend to one audiobook story while a second one had to be ignored. Online AAD was applied to track the attention toward the target speech signal. Individual temporal attention profiles were computed by combining an established AAD method with an adaptive staircase procedure. The individual decoding performance over time was analyzed and linked to behavioral performance as well as subjective ratings of listening effort, motivation, and fatigue. The grand average attended speaker decoding profile derived in the online experiment indicated performance above chance level. Parameters describing the individual AAD performance in each testing block indicated significant differences in decoding performance over time to be closely related to the behavioral performance in the selective listening task. Further, an exploratory analysis indicated that subjects with poor decoding performance reported higher listening effort and fatigue compared to good performers. Taken together our results show that online EEG based AAD in a complex listening situation is feasible. Adaptive attended speaker decoding profiles over time could be used as an objective measure of behavioral performance and listening effort. The developed online processing pipeline could also serve as a basis for future EEG based near real-time auditory neurofeedback systems.

Cortical injuries (e.g. – strokes or traumatic brain injuries) can create a host of secondary events that further impair the brain’s sensory, motor, or cognitive capabilities. Here, we attempted to isolate the acute effects of the primary injury – the loss of cortical activity – on rodent motor cortex (caudal forelimb area, CFA) without the secondary effects that arise from damage to cortical tissue. We then observed the effects of this loss of activity on the rodent premotor cortex (rostral forelimb area, RFA). In anesthetized rats, CFA was temporarily inactivated with the GABA-A agonist muscimol, disrupting motor network function while leaving neural connectivity intact. Using intracortical microstimulation (ICMS) techniques, we found that CFA inactivation completely abolished ICMS-evoked forelimb movement from RFA yet spared some CFA evoked-movement. Neural recordings confirmed that neural suppression by muscimol was isolated to CFA and did not spread into RFA. We next observed how CFA inactivation suppressed RFA influence on forelimb muscles by obtaining intramuscular electromyographical (EMG) recordings from forelimb muscles during ICMS. EMG recordings showed that despite the presence of evoked movement in CFA, but not RFA, muscle activation in both areas were similarly reduced. These results suggest that the primary reason for the loss of ICMS-evoked movement in RFA is not reduced forelimb muscle activity, but rather a loss of the specific activity between RFA and CFA. Therefore, within the intact motor network of the rat, RFA’s influence on forelimb movement is mediated by CFA, similar to the premotor and motor organization observed in non-human primates.

Individuals with Fragile X Syndrome (FXS) and autism spectrum disorder (ASD) exhibit cognitive impairments, social deficits, increased anxiety, and sensory hyperexcitability. Previously, we showed that elevated levels of matrix metalloproteinase‐9 (MMP‐9) may contribute to abnormal development of parvalbumin (PV) interneurons and perineuronal nets (PNNs) in the developing auditory cortex (AC) of Fmr1 knock‐out (KO) mice, which likely underlie auditory hypersensitivity. Thus, MMP‐9 may serve as a potential target for treatment of auditory hypersensitivity in FXS. Here, we used the MMP‐2/9 inhibitor, SB‐3CT, to pharmacologically inhibit MMP‐9 activity during a specific developmental period and to test whether inhibition of MMP‐9 activity reverses neural oscillation deficits and behavioral impairments by enhancing PNN formation around PV cells in Fmr1 KO mice. Electroencephalography (EEG) was used to measure resting state and sound‐evoked electrocortical activity in auditory and frontal cortices of postnatal day (P)22–23 male mice before and one‐day after treatment with SB‐3CT (25 mg/kg) or vehicle. At P27‐28, animal behaviors were tested to measure the effects of the treatment on anxiety and hyperactivity. Results show that acute inhibition of MMP‐9 activity improved evoked synchronization to auditory stimuli and ameliorated mouse behavioral deficits. MMP‐9 inhibition enhanced PNN formation, increased PV levels and TrkB phosphorylation yet reduced Akt phosphorylation in the AC of Fmr1 KO mice. Our results show that MMP‐9 inhibition during early postnatal development is beneficial in reducing some auditory processing deficits in the FXS mouse model and may serve as a candidate therapeutic for reversing sensory hypersensitivity in FXS and possibly other ASDs. image

In audiovisual music perception, visual information from a musical instrument being played is available prior to the onset of the corresponding musical sound and consequently allows a perceiver to form a prediction about the upcoming audio music. This prediction in audiovisual music perception, compared to auditory music perception, leads to lower N1 and P2 amplitudes and latencies. Although previous research suggests that audiovisual experience, such as previous musical experience may enhance this prediction, a remaining question is to what extent musical experience modifies N1 and P2 amplitudes and latencies. Furthermore, corresponding event-related phase modulations quantified as inter-trial phase coherence (ITPC) have not previously been reported for audiovisual music perception. In the current study, audio video recordings of a keyboard key being played were presented to musicians and non-musicians in audio only (AO), video only (VO), and audiovisual (AV) conditions. With predictive movements from playing the keyboard isolated from AV music perception (AV-VO), the current findings demonstrated that, compared to the AO condition, both groups had a similar decrease in N1 amplitude and latency, and P2 amplitude, along with correspondingly lower ITPC values in the delta, theta, and alpha frequency bands. However, while musicians showed lower ITPC values in the beta-band in AV-VO compared to the AO, non-musicians did not show this pattern. Findings indicate that AV perception may be broadly correlated with auditory perception, and differences between musicians and non-musicians further indicate musical experience to be a specific factor influencing AV perception. Predicting an upcoming sound in AV music perception may involve visual predictory processes, as well as beta-band oscillations, which may be influenced by years of musical training. This study highlights possible interconnectivity in AV perception as well as potential modulation with experience.

Unsupervised learning of visual temporal statistics drives postnatal development of position invariance in visual cortex.

Sleep and wakefulness are not simple homogenous all-or-none states, but instead are characterized by rich dynamics of brain activity across many temporal and spatial scales. Rapid global state transitions between waking and sleeping are believed to be controlled by hypothalamic circuits, but the contribution of the hypothalamus to within-state changes of sleep and wake “intensity” remains largely unexplored. Here we show that stimulation of inhibitory neurons in the preoptic hypothalamus does not merely trigger awakening from sleep, but the resulting awake state is also characterized by increased cortical activity. This activation is associated with a faster build-up of sleep pressure, proportional to the arousal level. These findings show that hypothalamic systems thought to exclusively control global state switching, also regulate within-state “intensity”, which we propose as a key intrinsic variable in shaping the architecture of sleep/wake states across the 24h day.

Alpha rhythms (9–11 Hz) are a dominant feature of EEG recordings, particularly over occipital cortex on cessation of a visual stimulation. Little is known about underlying neocortical mechanisms so here we constructed alpha rhythm models that follow cessation of cortical stimulation. The rhythm manifests following a period of gamma frequency activity in local V1 networks in layer 4. It associates with network level bias of excitatory synaptic activity in favour of NMDA- rather than AMPA-mediated signalling and reorganisation of synaptic inhibition in favour of fast GABA A receptor-mediated events. At the cellular level the alpha rhythm depended upon the generation of layer 4 pyramidal neuron dendritic bursting mediated primarily by PPDA-sensitive NR2C/D-containing NMDA receptors, which lack the magnesium-dependent open channel block. Subthreshold potassium conductances are also critical. The rhythm dynamically filters outputs from sensory relay neurons (stellate neurons in layer 4) such that they become temporally uncoupled from downstream population activity.

Fragile X Syndrome (FXS) is a leading known genetic cause of intellectual disability with symptoms that include increased anxiety and social and sensory processing deficits. Recent EEG studies in humans with FXS have identified neural oscillation deficits that include increased resting state gamma power, increased amplitude of auditory evoked potentials, and reduced inter-trial phase coherence of sound-evoked gamma oscillations. Identification of comparable EEG biomarkers in mouse models of FXS could facilitate the pre-clinical to clinical therapeutic pipeline. However, while human EEG studies have involved 128-channel scalp EEG acquisition, no mouse studies have been performed with more than three EEG channels. In the current study, we employed a recently developed 30-channel mouse multielectrode array (MEA) system to record and analyze resting and stimulus-evoked EEG signals in WT vs. Fmr1 KO mice. Using this system, we now report robust MEA-derived phenotypes including higher resting EEG power, altered event-related potentials (ERPs) and reduced inter-trial phase coherence to auditory chirp stimuli in Fmr1 KO mice that are remarkably similar to those reported in humans with FXS. We propose that the MEA system can be used for: (i) derivation of higher-level EEG parameters; (ii) EEG biomarkers for drug testing; and (ii) mechanistic studies of FXS pathophysiology.