Auditory Research publications

Significance Syllables are important building blocks of speech. They occur at a rate between 4 and 8 Hz, corresponding to the theta frequency range of neural activity in the cerebral cortex. When listening to speech, the theta activity becomes aligned to the syllabic rhythm, presumably aiding in parsing a speech signal into distinct syllables. However, this neural activity cannot only be influenced by sound, but also by somatosensory information. Here, we show that the presentation of vibrotactile signals at the syllabic rate can enhance the comprehension of speech in background noise. We further provide evidence that this multisensory enhancement of speech comprehension reflects the multisensory integration of auditory and tactile information in the auditory cortex.

Mechanosensation – by which mechanical stimuli are converted into a neuronal signal – is the basis for the sensory systems of hearing, balance, and touch. Mechanosensation is unmatched in speed and its diverse range of sensitivities, reaching its highest temporal limits with the sense of hearing; however, hair cells (HCs) and the auditory nerve (AN) serve as obligatory bottlenecks for sounds to engage the brain. Like other sensory neurons, auditory neurons use the canonical pathway for neurotransmission and millisecond-duration action potentials (APs). How the auditory system utilizes the relatively slow transmission mechanisms to achieve ultrafast speed, and high audio-frequency hearing remains an enigma. Here, we address this paradox and report that the mouse, and chinchilla, AN are mechanically sensitive, and minute mechanical displacement profoundly affects its response properties. Sound-mimicking sinusoidal mechanical and electrical current stimuli affect phase-locked responses. In a phase-dependent manner, the two stimuli can also evoke suppressive responses. We propose that mechanical sensitivity interacts with synaptic responses to shape responses in the AN, including frequency tuning and temporal phase locking. Combining neurotransmission and mechanical sensation to control spike patterns gives the mammalian AN a secondary receptor role, an emerging theme in primary neuronal functions.

Spatial hearing is crucial in real life but deteriorates in participants with severe sensorineural hearing loss or single-sided deafness. This ability can potentially be improved with a unilateral cochlear implant (CI). The present study investigated measures of sound localization in participants with single-sided deafness provided with a CI. Sound localization was measured separately at eight loudspeaker positions (4°, 30°, 60°, and 90°) on the CI side and on the normal-hearing side. Low- and high-frequency noise bursts were used in the tests to investigate possible differences in the processing of interaural time and level differences. Data were compared to normal-hearing adults aged between 20 and 83. In addition, the benefit of the CI in speech understanding in noise was compared to the localization ability. Fifteen out of 18 participants were able to localize signals on the CI side and on the normal-hearing side, although performance was highly variable across participants. Three participants always pointed to the normal-hearing side, irrespective of the location of the signal. The comparison with control data showed that participants had particular difficulties localizing sounds at frontal locations and on the CI side. In contrast to most previous results, participants were able to localize low-frequency signals, although they localized high-frequency signals more accurately. Speech understanding in noise was better with the CI compared to testing without CI, but only at a position where the CI also improved sound localization. Our data suggest that a CI can, to a large extent, restore localization in participants with single-sided deafness. Difficulties may remain at frontal locations and on the CI side. However, speech understanding in noise improves when wearing the CI. The treatment with a CI in these participants might provide real-world benefits, such as improved orientation in traffic and speech understanding in difficult listening situations.

Slow waves and cognitive output have been modulated in humans by phase-targeted auditory stimulation. However, to advance its technical development and further our understanding, implementation of the method in animal models is indispensable. Here, we report the successful employment of slow waves’ phase-targeted closed-loop auditory stimulation (CLAS) in rats. To validate this new tool both conceptually and functionally, we tested the effects of up- and down-phase CLAS on proportions and spectral characteristics of sleep, and on learning performance in the single-pellet reaching task, respectively. Without affecting 24 hr sleep-wake behavior, CLAS specifically altered delta (slow waves) and sigma (sleep spindles) power persistently over chronic periods of stimulation. While up-phase CLAS does not elicit a significant change in behavioral performance, down-phase CLAS exerted a detrimental effect on overall engagement and success rate in the behavioral test. Overall CLAS-dependent spectral changes were positively correlated with learning performance. Altogether, our results provide proof-of-principle evidence that phase-targeted CLAS of slow waves in rodents is efficient, safe, and stable over chronic experimental periods, enabling the use of this high-specificity tool for basic and preclinical translational sleep research.

Listening to speech in noise is effortful for individuals with hearing loss, even if they have received a hearing prosthesis such as a hearing aid or cochlear implant (CI). At present, little is known about the neural functions that support listening effort. One form of neural activity that has been suggested to reflect listening effort is the power of 8–12 Hz (alpha) oscillations measured by electroencephalography (EEG). Alpha power in two cortical regions has been associated with effortful listening—left inferior frontal gyrus (IFG), and parietal cortex—but these relationships have not been examined in the same listeners. Further, there are few studies available investigating neural correlates of effort in the individuals with cochlear implants. Here we tested 16 CI users in a novel effort-focused speech-in-noise listening paradigm, and confirm a relationship between alpha power and self-reported effort ratings in parietal regions, but not left IFG. The parietal relationship was not linear but quadratic, with alpha power comparatively lower when effort ratings were at the top and bottom of the effort scale, and higher when effort ratings were in the middle of the scale. Results are discussed in terms of cognitive systems that are engaged in difficult listening situations, and the implication for clinical translation.

Locomotion generates adventitious sounds which enable detection and localization of predators and prey. Such sounds contain brisk changes or transients in amplitude. We investigated the hypothesis that ill-understood temporal specializations in binaural circuits subserve lateralization of such sound transients, based on different time of arrival at the ears (interaural time differences, ITDs). We find that Lateral Superior Olive (LSO) neurons show exquisite ITD-sensitivity, reflecting extreme precision and reliability of excitatory and inhibitory postsynaptic potentials, in contrast to Medial Superior Olive neurons, traditionally viewed as the ultimate ITD-detectors. In vivo, inhibition blocks LSO excitation over an extremely short window, which, in vitro, required synaptically evoked inhibition. Light and electron microscopy revealed inhibitory synapses on the axon initial segment as the structural basis of this observation. These results reveal a neural vetoing mechanism with extreme temporal and spatial precision and establish the LSO as the primary nucleus for binaural processing of sound transients.

Hearing deficits impact on the communication with the external world and severely compromise perception of the surrounding. Deafness can be caused by particular mutations in the neuroplastin ( Nptn ) gene, which encodes a transmembrane recognition molecule of the immunoglobulin (Ig) superfamily and plasma membrane Calcium ATPase (PMCA) accessory subunit. This study investigates whether the complete absence of neuroplastin or the loss of neuroplastin in the adult after normal development lead to hearing impairment in mice analyzed by behavioral, electrophysiological, and in vivo imaging measurements. Auditory brainstem recordings from adult neuroplastin-deficient mice ( Nptn −/− ) show that these mice are deaf. With age, hair cells and spiral ganglion cells degenerate in Nptn −/− mice. Adult Nptn −/− mice fail to behaviorally respond to white noise and show reduced baseline blood flow in the auditory cortex (AC) as revealed by single-photon emission computed tomography (SPECT). In adult Nptn −/− mice, tone-evoked cortical activity was not detectable within the primary auditory field (A1) of the AC, although we observed non-persistent tone-like evoked activities in electrophysiological recordings of some young Nptn −/− mice. Conditional ablation of neuroplastin in Nptn lox/loxEmx1Cre mice reveals that behavioral responses to simple tones or white noise do not require neuroplastin expression by central glutamatergic neurons. Loss of neuroplastin from hair cells in adult Nptn Δlox/loxPrCreERT mice after normal development is correlated with increased hearing thresholds and only high prepulse intensities result in effective prepulse inhibition (PPI) of the startle response. Furthermore, we show that neuroplastin is required for the expression of PMCA 2 in outer hair cells. This suggests that altered Ca 2+ homeostasis underlies the observed hearing impairments and leads to hair cell degeneration. Our results underline the importance of neuroplastin for the development and the maintenance of the auditory system.

Variation in the acoustic structure of vocal signals is important to communicate social information. However, relatively little is known about the features that receivers extract to decipher relevant social information. Here, we took an expansive, bottom-up approach to delineate the feature space that could be important for processing social information in zebra finch song. Using operant techniques, we discovered that female zebra finches can consistently discriminate brief song phrases (“motifs”) from different social contexts. We then applied machine learning algorithms to classify motifs based on thousands of time-series features and to uncover acoustic features for motif discrimination. In addition to highlighting classic acoustic features, the resulting algorithm revealed novel features for song discrimination, for example, measures of time irreversibility (i.e., the degree to which the statistical properties of the actual and time-reversed signal differ). Moreover, the algorithm accurately predicted female performance on individual motif exemplars. These data underscore and expand the promise of broad time-series phenotyping to acoustic analyses and social decision-making.

Multisensory integration of auditory and tactile information occurs already at the level of the cochlear nucleus. Rodents use their whiskers for tactile perception to guide them in their exploration of the world. As nocturnal animals with relatively poor vision, audiotactile interactions are of great importance for this species. Here, the influence of whisker deflections on sound-evoked spiking in the cochlear nucleus was investigated in vivo in anesthetized mice. Multichannel, silicon-probe electrophysiological recordings were obtained from both the dorsal and ventral cochlear nucleus. Whisker deflections evoked an increased spiking activity in fusiform cells of the dorsal cochlear nucleus and t-stellate cells in ventral cochlear nucleus, whereas bushy cells in the ventral cochlear nucleus showed a more variable response. The response to broadband noise stimulation increased in fusiform cells and primary-like bushy cells when the sound stimulation was preceded (~ 20 ms) by whisker stimulation. Multi-sensory integration of auditory and whisker input can thus occur already in this early brainstem nucleus, emphasizing the importance of early integration of auditory and somatosensory information.

Hearing impairment disrupts processes of selective attention that help listeners attend to one sound source over competing sounds in the environment. Hearing prostheses (hearing aids and cochlear implants, CIs), do not fully remedy these issues. In normal hearing, mechanisms of selective attention arise through the facilitation and suppression of neural activity that represents sound sources. However, it is unclear how hearing impairment affects these neural processes, which is key to understanding why listening difficulty remains. Here, severely-impaired listeners treated with a CI, and age-matched normal-hearing controls, attended to one of two identical but spatially separated talkers while multichannel EEG was recorded. Whereas neural representations of attended and ignored speech were differentiated at early (~ 150 ms) cortical processing stages in controls, differentiation of talker representations only occurred later (~250 ms) in CI users. CI users, but not controls, also showed evidence for spatial suppression of the ignored talker through lateralized alpha (7–14 Hz) oscillations. However, CI users’ perceptual performance was only predicted by early-stage talker differentiation. We conclude that multi-talker listening difficulty remains for impaired listeners due to deficits in early-stage separation of cortical speech representations, despite neural evidence that they use spatial information to guide selective attention.

The ability to recognize sounds in noise is a key part of hearing, and the mechanisms by which the brain identifies sounds in noise are of considerable interest to scientists, clinicians and engineers. Yet we know little about the necessity of regions such as auditory cortex for hearing in noise, or how cortical processing of sounds is adversely affected by noise. Here we used reversible cortical inactivation and extracellular electrophysiology in ferrets performing a vowel discrimination task to identify and understand the causal contribution of auditory cortex to hearing in noise. Cortical inactivation by cooling impaired task performance in noisy but not clean conditions, while responses of auditory cortical neurons were less informative about vowel identity in noise. Simulations mimicking cortical inactivation indicated that effects of inactivation were related to the loss of information about sounds represented across neural populations. The addition of noise to target sounds drove spiking activity in auditory cortex and recruitment of additional neural populations that were linked to degraded behavioral performance. To suppress noise-related activity, we used continuous exposure to background noise to adapt the auditory system and recover behavioral performance in both ferrets and humans. Inactivation by cooling revealed that the benefits of continuous exposure were not cortically dependent. Together our results highlight the importance of auditory cortex in sound discrimination in noise and the underlying mechanisms through which noise-related activity and adaptation shape hearing.

Although information theoretic approaches have been used extensively in the analysis of the neural code, they have yet to be used to describe how information is accumulated in time while sensory systems are categorizing dynamic sensory stimuli such as speech sounds or visual objects. Here, we present a novel method to estimate the cumulative information for stimuli or categories. We further define a time-varying categorical information index that, by comparing the information obtained for stimuli versus categories of these same stimuli, quantifies invariant neural representations. We use these methods to investigate the dynamic properties of avian cortical auditory neurons recorded in zebra finches that were listening to a large set of call stimuli sampled from the complete vocal repertoire of this species. We found that the time-varying rates carry 5 times more information than the mean firing rates even in the first 100 ms. We also found that cumulative information has slow time constants (100-600 ms) relative to the typical integration time of single neurons, reflecting the fact that the behaviorally informative features of auditory objects are time-varying sound patterns. When we correlated firing rates and information values, we found that average information correlates with average firing rate but that higher-rates found at the onset response yielded similar information values as the lower-rates found in the sustained response: the onset and sustained response of avian cortical auditory neurons provide similar levels of independent information about call identity and call-type. Finally, our information measures allowed us to rigorously define categorical neurons; these categorical neurons show a high degree of invariance for vocalizations within a call-type. Peak invariance is found around 150 ms after stimulus onset. Surprisingly, call-type invariant neurons were found in both primary and secondary avian auditory areas.

Auditory cortex is required for sound localisation, but how neural firing in auditory cortex underlies our perception of sound sources in space remains unclear. Specifically, whether neurons in auditory cortex represent spatial cues or an integrated representation of auditory space across cues is not known. Here, we measured the spatial receptive fields of neurons in primary auditory cortex (A1) while ferrets performed a relative localisation task. Manipulating the availability of binaural and spectral localisation cues had little impact on ferrets’ performance, or on neural spatial tuning. A subpopulation of neurons encoded spatial position consistently across localisation cue type. Furthermore, neural firing pattern decoders outperformed two-channel model decoders using population activity. Together, these observations suggest that A1 encodes the location of sound sources, as opposed to spatial cue values.

Frequency tuning and phase-locking are two fundamental properties generated in the cochlea, enabling but also limiting the coding of sounds by the auditory nerve (AN). In humans, these limits are unknown, but high resolution has been postulated for both properties. Electrophysiological recordings from the AN of normal-hearing volunteers indicate that human frequency tuning, but not phase-locking, exceeds the resolution observed in animal models.

The ventriloquism aftereffect (VAE) refers to a shift in auditory spatial perception following exposure to a spatial disparity between auditory and visual stimuli. The VAE has been previously measured on two distinct time scales. Hundreds or thousands of exposures to a an audio-visual spatial disparity produces enduring VAE that persists after exposure ceases. Exposure to a single audio-visual spatial disparity produces immediate VAE that decays over seconds. To determine if these phenomena are two extremes of a continuum or represent distinct processes, we conducted an experiment with normal hearing listeners that measured VAE in response to a repeated, constant audio-visual disparity sequence, both immediately after exposure to each audio-visual disparity and after the end of the sequence. In each experimental session, subjects were exposed to sequences of auditory and visual targets that were constantly offset by +8° or -8° in azimuth from one another, then localized auditory targets presented in isolation following each sequence. Eye position was controlled throughout the experiment, to avoid the effects of gaze on auditory localization. In contrast to other studies that did not control eye position, we found both a large shift in auditory perception that decayed rapidly after each AV disparity exposure, along with a gradual shift in auditory perception that grew over time and persisted after exposure to the AV disparity ceased. We modeled the temporal and spatial properties of the measured auditory shifts using grey box nonlinear system identification, and found that two models could explain the data equally well. In the power model, the temporal decay of the ventriloquism aftereffect was modeled with a power law relationship. This causes an initial rapid drop in auditory shift, followed by a long tail which accumulates with repeated exposure to audio-visual disparity. In the double exponential model, two separate processes were required to explain the data, one which accumulated and decayed exponentially and the other which slowly integrated over time. Both models fit the data best when the spatial spread of the ventriloquism aftereffect was limited to a window around the location of the audio-visual disparity. We directly compare the predictions made by each model, and suggest additional measurements that could help distinguish which model best describes the mechanisms underlying the VAE.

Noise exposure is one of the most common causes of hearing loss and peripheral damage to the auditory system. A growing literature suggests that the auditory system can compensate for peripheral loss through increased central neural activity. The current study sought to investigate the link between noise exposure, increases in central gain, synaptic reorganization, and auditory function. All axons of the auditory nerve project to the cochlear nucleus, making it a requisite nucleus for sound detection. As the first synapse in the central auditory system, the cochlear nucleus is well positioned to respond plastically to loss of peripheral input. To investigate noise-induced compensation in the central auditory system, we measured auditory brainstem responses (ABRs) and auditory perception and collected tissue from mice exposed to broadband noise. Noise-exposed mice showed elevated ABR thresholds, reduced ABR wave 1 amplitudes, and spiral ganglion neuron loss. Despite peripheral damage, noise-exposed mice were hyperreactive to loud sounds and showed nearly normal behavioral sound detection thresholds. Ratios of late ABR peaks (2–4) relative to the first ABR peak indicated that brainstem pathways were hyperactive in noise-exposed mice, while anatomical analysis indicated there was an imbalance between expression of excitatory and inhibitory proteins in the ventral cochlear nucleus. The results of the current study suggest that a reorganization of excitation and inhibition in the ventral cochlear nucleus may drive hyperactivity in the central auditory system. This increase in central gain can compensate for peripheral loss to restore some aspects of auditory function.

Vocal communication is a sensory-motor process requiring auditory self-monitoring to correct errors and to ensure accurate vocal production. When presented with altered speech feedback, humans rapidly change their speech to compensate. Although previous evidence has demonstrated suppression of auditory cortex during both speech and animal vocalization, the specific role of auditory cortex in such feedback-dependent control is unknown. Here we show the relationship between neural activity in the auditory cortex and feedback-dependent vocal control in marmoset monkeys. We demonstrate that marmosets, like humans, exhibit feedback control of vocal acoustics. We further show that feedback-sensitive activity of auditory cortex neurons predict such compensatory vocal changes. Finally, we demonstrate that electrical microstimulation of auditory cortex rapidly evokes similar changes in vocal production. These results are evidence for a causal role of auditory cortex in vocal self-monitoring and feedback-dependent control, and have implications for understanding human speech motor control.

The brainstem’s lateral superior olive (LSO) is thought to be crucial for localizing high-frequency sounds by coding interaural sound level differences (ILD). Its neurons weigh contralateral inhibition against ipsilateral excitation, making their firing rate a function of the azimuthal position of a sound source. Since the very first in vivo recordings, LSO principal neurons have been reported to give sustained and temporally integrating ‘chopper’ responses to sustained sounds. Neurons with transient responses were observed but largely ignored and even considered a sign of pathology. Using the Mongolian gerbil as a model system, we have obtained the first in vivo patch clamp recordings from labeled LSO neurons and find that principal LSO neurons, the most numerous projection neurons of this nucleus, only respond at sound onset and show fast membrane features suggesting an importance for timing. These results provide a new framework to interpret previously puzzling features of this circuit.

A function of the auditory system is to accurately determine the location of a sound source. The main cues for sound location are interaural time (ITD) and level (ILD) differences. Humans use both ITD and ILD to determine the azimuth. Thus far, the conception of sound localization in barn owls was that their facial ruff and asymmetrical ears generate a two-dimensional grid of ITD for azimuth and ILD for elevation. We show that barn owls also use ILD for azimuthal sound localization when ITDs are ambiguous. For high-frequency narrowband sounds, midbrain neurons can signal multiple locations, leading to the perception of an auditory illusion called a phantom source. Owls respond to such an illusory percept by orienting toward it instead of the true source. Acoustical measurements close to the eardrum reveal a small ILD component that changes with azimuth, suggesting that ITD and ILD information could be combined to eliminate the illusion. Our behavioral data confirm that perception was robust against ambiguities if ITD and ILD information was combined. Electrophysiological recordings of ILD sensitivity in the owl’s midbrain support the behavioral findings indicating that rival brain hemispheres drive the decision to orient to either true or phantom sources. Thus, the basis for disambiguation, and reliable detection of sound source azimuth, relies on similar cues across species as similar response to combinations of ILD and narrowband ITD has been observed in humans.

A key function of the brain is to provide a stable representation of an object's location in the world. In hearing, sound azimuth and elevation are encoded by neurons throughout the auditory system, and auditory cortex is necessary for sound localization. However, the coordinate frame in which neurons represent sound space remains undefined: classical spatial receptive fields in head-fixed subjects can be explained either by sensitivity to sound source location relative to the head (egocentric) or relative to the world (allocentric encoding). This coordinate frame ambiguity can be resolved by studying freely moving subjects; here we recorded spatial receptive fields in the auditory cortex of freely moving ferrets. We found that most spatially tuned neurons represented sound source location relative to the head across changes in head position and direction. In addition, we also recorded a small number of neurons in which sound location was represented in a world-centered coordinate frame. We used measurements of spatial tuning across changes in head position and direction to explore the influence of sound source distance and speed of head movement on auditory cortical activity and spatial tuning. Modulation depth of spatial tuning increased with distance for egocentric but not allocentric units, whereas, for both populations, modulation was stronger at faster movement speeds. Our findings suggest that early auditory cortex primarily represents sound source location relative to ourselves but that a minority of cells can represent sound location in the world independent of our own position.