Electrophysiology publications

Auditory stimulus reconstruction is a technique that finds the best approximation of the acoustic stimulus from the population of evoked neural activity. Reconstructing speech from the human auditory cortex creates the possibility of a speech neuroprosthetic to establish a direct communication with the brain and has been shown to be possible in both overt and covert conditions. However, the low quality of the reconstructed speech has severely limited the utility of this method for brain-computer interface (BCI) applications. To advance the state-of-the-art in speech neuroprosthesis, we combined the recent advances in deep learning with the latest innovations in speech synthesis technologies to reconstruct closed-set intelligible speech from the human auditory cortex. We investigated the dependence of reconstruction accuracy on linear and nonlinear (deep neural network) regression methods and the acoustic representation that is used as the target of reconstruction, including auditory spectrogram and speech synthesis parameters. In addition, we compared the reconstruction accuracy from low and high neural frequency ranges. Our results show that a deep neural network model that directly estimates the parameters of a speech synthesizer from all neural frequencies achieves the highest subjective and objective scores on a digit recognition task, improving the intelligibility by 65% over the baseline method which used linear regression to reconstruct the auditory spectrogram. These results demonstrate the efficacy of deep learning and speech synthesis algorithms for designing the next generation of speech BCI systems, which not only can restore communications for paralyzed patients but also have the potential to transform human-computer interaction technologies.

Active listening involves dynamically switching attention between competing talkers and is essential to following conversations in everyday environments. Previous investigations in human listeners have examined the neural mechanisms that support switching auditory attention within the acoustic featural cues of pitch and auditory space. Here, we explored the cortical circuitry underlying endogenous switching of auditory attention between pitch and spatial cues necessary to discern target from masker words. Because these tasks are of unequal difficulty, we expected an asymmetry in behavioral switch costs for hard-to-easy versus easy-to-hard switches, mirroring prior evidence from vision-based cognitive task-switching paradigms. We investigated the neural correlates of this behavioral switch asymmetry and associated cognitive control operations in the present auditory paradigm. Behaviorally, we observed no switch-cost asymmetry, i.e., no performance difference for switching from the more difficult attend-pitch to the easier attend-space condition (P→S) versus switching from easy-to-hard (S→P). However, left lateral prefrontal cortex activity, correlated with improved performance, was observed during a silent gap period when listeners switched attention from P→S, relative to switching within pitch cues. No such differential activity was seen for the analogous easy-to-hard switch. We hypothesize that this neural switch asymmetry reflects proactive cognitive control mechanisms that successfully reconfigured neurally-specified task parameters and resolved competition from other such "task sets," thereby obviating the expected behavioral switch-cost asymmetry. The neural switch activity observed was generally consistent with that seen in cognitive paradigms, suggesting that established cognitive models of attention switching may be productively applied to better understand similar processes in audition.

Fifty percent of inner ear disorders are caused by genetic mutations. To develop treatments for genetic inner ear disorders, we designed gene replacement therapies using synthetic adeno-associated viral vectors to deliver the coding sequence for Transmembrane Channel-Like ( Tmc ) 1 or 2 into sensory hair cells of mice with hearing and balance deficits due to mutations in Tmc1 and closely related Tmc2 . Here we report restoration of function in inner and outer hair cells, enhanced hair cell survival, restoration of cochlear and vestibular function, restoration of neural responses in auditory cortex and recovery of behavioral responses to auditory and vestibular stimulation. Secondarily, we find that inner ear Tmc gene therapy restores breeding efficiency, litter survival and normal growth rates in mouse models of genetic inner ear dysfunction. Although challenges remain, the data suggest that Tmc gene therapy may be well suited for further development and perhaps translation to clinical application.

This paper describes a technique to assess the correspondence between patterns of similarity in the brain's response to speech sounds and the patterns of similarity encoded in phonological feature systems, by quantifying the recoverability of phonological features from the neural data using supervised learning. The technique is applied to EEG recordings collected during passive listening to consonant-vowel syllables. Three published phonological feature systems are compared, and are shown to differ in their ability to recover certain speech sound contrasts from the neural data. For the phonological feature system that best reflects patterns of similarity in the neural data, a leave-one-out analysis indicates some consistency across subjects in which features have greatest impact on the fit, but considerable across-subject heterogeneity remains in the rank ordering of features in this regard.

Central serotonin (5-HT) orchestrates myriad cognitive processes and lies at the core of many stress-related psychiatric illnesses. However, the basic relationship between its brain-wide axonal projections and functional dynamics is not known. Here we combine optogenetics and fMRI to produce a brain-wide 5-HT evoked functional map. We find that DRN photostimulation leads to an increase in the hemodynamic response in the DRN itself, while projection areas predominately exhibit a reduction of cerebral blood volume mirrored by suppression of cortical delta oscillations. We find that the regional distribution of post-synaptically expressed 5-HT receptors better correlates with DRN 5-HT functional connectivity than anatomical projections. Our work suggests that neuroarchitecture is not the primary determinant of function for the DRN 5-HT. With respect to two 5-HT elevating stimuli, we find that acute stress leads to circuit-wide blunting of the DRN output, while the SSRI fluoxetine noticeably enhances DRN functional connectivity. These data provide fundamental insight into the brain-wide functional dynamics of the 5-HT projection system.

Microelectrode arrays designed to map and modulate neuronal circuitry have enabled greater understanding and treatment of neurological injury and disease. Reliable detection of neuronal activity over time is critical for the successful application of chronic recording devices. Here, we assess device-related plasticity by exploring local changes in ion channel expression and their relationship to device performance over time. We investigated four voltage-gated ion channels (Kv1.1, Kv4.3, Kv7.2, and Nav1.6) based on their roles in regulating action potential generation, firing patterns, and synaptic efficacy. We found that a progressive increase in potassium channel expression and reduction in sodium channel expression accompanies signal loss over 6 weeks (both LFP amplitude and number of units). This motivated further investigation into a mechanistic role of ion channel expression in recorded signal instability. We employed siRNA in neuronal culture to find that Kv7.2 knockdown (as a model for the transient downregulation observed at 1 day in vivo) mimics excitatory synaptic remodeling around devices. This work provides new insight into the mechanisms underlying signal loss over time.

Processing incentive and drive is essential for control of goal-directed behavior. The limbic part of the basal ganglia has been emphasized in these processes, yet the exact neuronal mechanism has remained elusive. In this study, we examined the neuronal activity of the ventral pallidum (VP) and its upstream area, the rostromedial caudate (rmCD), while two male macaque monkeys performed an instrumental lever release task in which a visual cue indicated the forthcoming reward size. We found that the activity of some neurons in VP and rmCD reflected the expected reward size transiently following the cue. Reward size coding appeared earlier and stronger in VP than in rmCD. We also found that the activity in these areas was modulated by the satiation level of monkeys, which also occurred more frequently in VP than in rmCD. The information regarding reward size and satiation level was independently signaled in the neuronal populations of these areas. The data thus highlighted the neuronal coding of key variables for goal-directed behavior in VP. Furthermore, pharmacological inactivation of VP induced more severe deficit of goal-directed behavior than inactivation of rmCD, which was indicated by abnormal error repetition and diminished satiation effect on the performance. These results suggest that VP encodes incentive value and internal drive and plays a pivotal role in the control of motivation to promote goal-directed behavior. SIGNIFICANCE STATEMENT The limbic part of the basal ganglia has been implicated in the motivational control of goal-directed action. Here, we investigated how the ventral pallidum (VP) and the rostromedial caudate (rmCD) encode incentive value and internal drive and control goal-directed behavior. Neuronal recording and subsequent pharmacological inactivation revealed that VP had stronger coding of reward size and satiation level than rmCD. Reward size and satiation level were independently encoded in the neuronal population of these areas. Furthermore, VP inactivation impaired goal-directed behavior more severely than rmCD inactivation. These results highlight the central role of VP in the motivational control of goal-directed action.

Neurovascular coupling, cerebrovascular remodeling and hemodynamic changes are critical to brain function, and dysregulated in neuropathologies such as brain tumors. Interrogating these phenomena in freely behaving animals requires a portable microscope with multiple optical contrast mechanisms. Therefore, we developed a miniaturized microscope with: a fluorescence (FL) channel for imaging neural activity (e.g., GCaMP) or fluorescent cancer cells (e.g., 9L-GFP); an intrinsic optical signal (IOS) channel for imaging hemoglobin absorption (i.e., cerebral blood volume); and a laser speckle contrast (LSC) channel for imaging perfusion (i.e., cerebral blood flow). Following extensive validation, we demonstrate the microscope’s capabilities via experiments in unanesthetized murine brains that include: (i) multi-contrast imaging of neurovascular changes following auditory stimulation; (ii) wide-area tonotopic mapping; (iii) EEG-synchronized imaging during anesthesia recovery; and (iv) microvascular connectivity mapping over the life-cycle of a brain tumor. This affordable, flexible, plug-and-play microscope heralds a new era in functional imaging of freely behaving animals.

Transcranial direct current stimulation (tDCS) is a non-invasive neuromodulation technique that is widely used to stimulate the sensorimotor cortex, and yet the mechanism by which it influences the natural activity of cortical networks is still under debate. Here, we characterize the effects of anodal and cathodal tDCS on underlying neurons in active macaque sensorimotor cortex across a range of doses. We find changes in spike rates that are sensitive to both current intensity and polarity, behavioral state, and that are cell-type specific. At high currents, effects persist after the offset of stimulation, and the spatiotemporal activity associated with motor activity of the contralateral limb, measured by dynamics of neural ensembles, are altered. These data suggest that tDCS induces reproducible and noticeable changes in cortical neuron activity and support the theory that it affects brain activity through a combination of single neuron polarization and network interactions.

How does the human brain rapidly process incoming information in working memory? In growing divergence from a single-region focus on the prefrontal cortex (PFC), recent work argues for emphasis on how distributed neural networks are rapidly coordinated in support of this central neurocognitive function. Previously, we showed that working memory for everyday "what," "where," and "when" associations depends on multiplexed oscillatory systems, in which signals of different frequencies simultaneously link the PFC to parieto-occipital and medial temporal regions, pointing to a complex web of sub-second, bidirectional interactions. Here, we used direct brain recordings to delineate the frontoparietal oscillatory correlates of working memory with high spatiotemporal precision. Seven intracranial patients with electrodes simultaneously localized to prefrontal and parietal cortices performed a visuospatial working memory task that operationalizes the types of identity and spatiotemporal information we encounter every day. First, task-induced oscillations in the same delta-theta (2-7 Hz) and alpha-beta (9-24 Hz) frequency ranges previously identified using scalp electroencephalography (EEG) carried information about the contents of working memory. Second, maintenance was linked to directional connectivity from the parietal cortex to the PFC. However, presentation of the test prompt to cue identity, spatial, or temporal information changed delta-theta coordination from a unidirectional, parietal-led system to a bidirectional, frontoparietal system. Third, the processing of spatiotemporal information was more bidirectional in the delta-theta range than was the processing of identity information, where alpha-beta connectivity did not exhibit sensitivity to the contents of working memory. These findings implicate a bidirectional delta-theta mechanism for frontoparietal control over the contents of working memory.

Evidence shows that selective attention to visual stimuli modulates the gain of cochlear responses, probably through auditory-cortex descending pathways. At the cerebral cortex level, amplitude and phase changes of neural oscillations have been proposed as a correlate of selective attention. However, whether sensory receptors are also influenced by the oscillatory network during attention tasks remains unknown. Here, we searched for oscillatory attention-related activity at the cochlear receptor level in humans. We used an alternating visual/auditory selective attention task and measured electroencephalographic activity simultaneously to distortion product otoacoustic emissions (a measure of cochlear receptor-cell activity). In order to search for cochlear oscillatory activity, the otoacoustic emission signal, was included as an additional channel in the electroencephalogram analyses. This method allowed us to evaluate dynamic changes in cochlear oscillations within the same range of frequencies (1-35 Hz) in which cognitive effects are commonly observed in electroencephalogram works. We found the presence of low frequency (<10 Hz) brain and cochlear amplifier oscillations during selective attention to visual and auditory stimuli. Notably, switching between auditory and visual attention modulates the amplitude and the temporal order of brain and inner ear oscillations. These results extend the role of the oscillatory activity network during cognition in neural systems to the receptor level.

In rodents, the progression of extrastriate areas located laterally to primary visual cortex (V1) has been assigned to a putative object-processing pathway (homologous to the primate ventral stream), based on anatomical considerations. Recently, we found functional support for such attribution (Tafazoli et al., 2017), by showing that this cortical progression is specialized for coding object identity despite view changes, the hallmark property of a ventral-like pathway. Here, we sought to clarify what computations are at the base of such specialization. To this aim, we performed multielectrode recordings from V1 and laterolateral area LL (at the apex of the putative ventral-like hierarchy) of male adult rats, during the presentation of drifting gratings and noise movies. We found that the extent to which neuronal responses were entrained to the phase of the gratings sharply dropped from V1 to LL, along with the quality of the receptive fields inferred through reverse correlation. Concomitantly, the tendency of neurons to respond to different oriented gratings increased, whereas the sharpness of orientation tuning declined. Critically, these trends are consistent with the nonlinear summation of visual inputs that is expected to take place along the ventral stream, according to the predictions of hierarchical models of ventral computations and a meta-analysis of the monkey literature. This suggests an intriguing homology between the mechanisms responsible for building up shape selectivity and transformation tolerance in the visual cortex of primates and rodents, reasserting the potential of the latter as models to investigate ventral stream functions at the circuitry level.SIGNIFICANCE STATEMENT Despite the growing popularity of rodents as models of visual functions, it remains unclear whether their visual cortex contains specialized modules for processing shape information. To addresses this question, we compared how neuronal tuning evolves from rat primary visual cortex (V1) to a downstream visual cortical region (area LL) that previous work has implicated in shape processing. In our experiments, LL neurons displayed a stronger tendency to respond to drifting gratings with different orientations while maintaining a sustained response across the whole duration of the drift cycle. These trends match the increased complexity of pattern selectivity and the augmented tolerance to stimulus translation found in monkey visual temporal cortex, thus revealing a homology between shape processing in rodents and primates.

Mesoscale cortical activity can be defined as the organization of activity of large neuron populations into collective action, forming time-dependent patterns such as traveling waves. Although collective action may play an important role in the cross-scale integration of brain activity and in the emergence of cognitive behavior, a comprehensive formulation of the laws governing its dynamics is still lacking. Because collective action processes are macroscopic with respect to neuronal activity, these processes cannot be described directly with methods and models developed for the microscale (individual neurons).To identify the characteristic features of mesoscopic dynamics, and to lay the foundations for a theoretical description of mesoscopic activity in the hippocampus, we conduct a comprehensive examination of observational data of hippocampal local field potential (LFP) recordings. We use the strong correlation between rat running-speed and the LFP power to parameterize the energy input into the hippocampus, and show that both the power and non-linearity of collective action (e.g., theta and gamma rhythms) increase with increased speed. Our results show that collective-action dynamics are stochastic (the precise state of a single neuron is irrelevant), weakly non-linear, and weakly dissipative. These are the principles of the theory of weak turbulence. Therefore, we propose weak turbulence a theoretical framework for the description of mesoscopic activity in the hippocampus. The weak turbulence framework provides a complete description of the cross-scale energy exchange (the energy cascade). It uncovers the mechanism governing major features of LFP spectra and bispectra, such as the physical meaning of the exponent α of power-law LFP spectra (e.g., f -α, where f is the frequency), the strengthening of theta-gamma coupling with energy input into the hippocampus, as well as specific phase lags associated with their interaction. Remarkably, the weak turbulence framework is consistent with the theory of self organized criticality, which provides a simple explanation for the existence of the power-law background spectrum. Together with self-organized criticality, weak turbulence could provide a unifying approach to modeling the dynamics of mesoscopic activity.

The caudomedial nidopallium (NCM) is a higher level region of auditory cortex in songbirds that has been implicated in encoding learned vocalizations and mediating perception of complex sounds. We made cell-attached recordings in awake adult male zebra finches ( Taeniopygia guttata) to characterize responses of single NCM neurons to playback of tones and songs. Neurons fell into two broad classes: narrow fast-spiking cells and broad sparsely firing cells. Virtually all narrow-spiking cells responded to playback of pure tones, compared with approximately half of broad-spiking cells. In addition, narrow-spiking cells tended to have lower thresholds and faster, less variable spike onset latencies than did broad-spiking cells, as well as higher firing rates. Tonal responses of narrow-spiking cells also showed broader ranges for both frequency and amplitude compared with broad-spiking neurons and were more apt to have V-shaped tuning curves compared with broad-spiking neurons, which tended to have complex (discontinuous), columnar, or O-shaped frequency response areas. In response to playback of conspecific songs, narrow-spiking neurons showed high firing rates and low levels of selectivity whereas broad-spiking neurons responded sparsely and selectively. Broad-spiking neurons in which tones failed to evoke a response showed greater song selectivity compared with those with a clear tuning curve. These results are consistent with the idea that narrow-spiking neurons represent putative fast-spiking interneurons, which may provide a source of intrinsic inhibition that contributes to the more selective tuning in broad-spiking cells. NEW & NOTEWORTHY The response properties of neurons in higher level regions of auditory cortex in songbirds are of fundamental interest because processing in such regions is essential for vocal learning and plasticity and for auditory perception of complex sounds. Within a region of secondary auditory cortex, neurons with narrow spikes exhibited high firing rates to playback of both tones and multiple conspecific songs, whereas broad-spiking neurons responded sparsely and selectively to both tones and songs.

Hearing impairment in older people is thought to arise from impaired temporal processing in auditory circuits. We used a systems-level (scalp recordings) and a microcircuit-level (extracellular recordings) approach to investigate how aging affects the sensitivity to temporal envelopes of speech-like sounds in rats. Scalp-recorded potentials suggest an age-related increase in sensitivity to temporal regularity along the ascending auditory pathway. The underlying cellular changes in the midbrain were examined using extracellular recordings from inferior colliculus neurons. We observed an age-related increase in sensitivity to the sound's onset and temporal regularity (i.e., periodicity envelope) in the spiking output of inferior colliculus neurons, relative to their synaptic inputs (local field potentials). This relative enhancement for aged animals was most prominent for multi-unit (relative to single-unit) spiking activity. Spontaneous multi-unit, but not single-unit, activity was also enhanced in aged compared with young animals. Our results suggest that aging is associated with altered sensitivity to a sound's temporal regularities, and that these effects may be due to increased gain of neural network activity in the midbrain.

A 'pattern alternation paradigm' has been previously used in human ERP recordings to investigate the brain encoding of complex auditory regularities, but prior studies on regularity encoding in animal models to examine mechanisms of adaptation of auditory neuronal responses have used primarily oddball stimulus sequences to study stimulus-specific adaptation alone. In order to examine the sensitivity of neuronal adaptation to expected and unexpected events embedded in a complex sound sequence, we used a similar patterned sequence of sounds. We recorded single unit activity and compared neuronal responses in the rat inferior colliculus (IC) to sound stimuli conforming to pattern alternation regularity with those to stimuli in which occasional sound repetitions violated that alternation. Results show that some neurons in the rat inferior colliculus are sensitive to the history of patterned stimulation and to violations of patterned regularity, demonstrating that there is a population of subcortical neurons, located as early as the level of the midbrain, that can detect more complex stimulus regularities than previously supposed and that are as sensitive to complex statistics as some neurons in primary auditory cortex. Our findings indicate that these pattern-sensitive neurons can extract temporal and spectral regularities between successive acoustic stimuli. This is important because the extraction of regularities from the sound sequences will result in the development of expectancies for future sounds and hence, the present results are compatible with predictive coding models. Our results demonstrate that some collicular neurons, located as early as in the midbrain level, are involved in the generation and shaping of prediction errors in ways not previously considered and thus, the present findings challenge the prevailing view that perceptual organization of sound only emerges at the auditory cortex level.