Psychoacoustics publications

How and where in the brain audio-visual signals are bound to create multimodal objects remains unknown. One hypothesis is that temporal coherence between dynamic multisensory signals provides a mechanism for binding stimulus features across sensory modalities. Here, we report that when the luminance of a visual stimulus is temporally coherent with the amplitude fluctuations of one sound in a mixture, the representation of that sound is enhanced in auditory cortex. Critically, this enhancement extends to include both binding and non-binding features of the sound. We demonstrate that visual information conveyed from visual cortex via the phase of the local field potential is combined with auditory information within auditory cortex. These data provide evidence that early cross-sensory binding provides a bottom-up mechanism for the formation of cross-sensory objects and that one role for multisensory binding in auditory cortex is to support auditory scene analysis.

For patients with bilateral cochlear implants (BiCIs), understanding a target talker in a noisy situation can be difficult. Current efforts for improving speech-in-noise understanding have focused on improving signal-to-noise ratio by using multiple microphones or signal processing, with only moderate improvements in speech understanding performance. However, BiCI users typically report having a better ear for listening which can lead to an asymmetry in speech unmasking performance. This work proposes a novel listening strategy for improving speech-in-noise understanding by combining (a) a priori knowledge of a better ear and having a BiCI user selectively attend to a target talker in that ear with (b) signal processing that delivers the target talker to the better ear and the noisy background to the opposite ear. This strategy is different from traditional noise reduction strategies because it maintains situational awareness (background sounds are delivered to the ear contralateral to the better ear) while improving speech understanding. Speech recognition performance was evaluated with and without the better ear strategy in a speech-in-noise listening test using a virtual auditory space created from individualized head-related transfer functions. Listeners showed an average improvement of 4.4 dB signal-to-noise ratio in their speech reception threshold when using the better ear strategy with no listener showing a decrement in performance. This implies that the strategy has the potential to boost speech-in-noise recognition in BiCI users and may be useful in other hearing assistance devices such as hearing aids.

In a complex auditory scene, signals of interest can be distinguished from masking sounds by differences in source location [spatial release from masking (SRM)] and by differences between masker-alone and masker-plus-signal envelopes. This study investigated interactions between those factors in release of masking of 700-Hz tones in an open sound field. Signal and masker sources were colocated in front of the listener, or the signal source was shifted 90° to the side. In Experiment 1, the masker contained a 25-Hz-wide on-signal band plus flanking bands having envelopes that were either mutually uncorrelated or were comodulated. Comodulation masking release (CMR) was largely independent of signal location at a higher masker sound level, but at a lower level CMR was reduced for the lateral signal location. In Experiment 2, a brief signal was positioned at the envelope maximum (peak) or minimum (dip) of a 50-Hz-wide on-signal masker. Masking was released in dip more than in peak conditions only for the 90° signal. Overall, open-field SRM was greater in magnitude than binaural masking release reported in comparable closed-field studies, and envelope-related release was somewhat weaker. Mutual enhancement of masking release by spatial and envelope-related effects tended to increase with increasing masker level.

The mechanisms underlying multi-sensory interactions are still poorly understood despite considerable progress made since the first neurophysiological recordings of multi-sensory neurons. While the majority of single-cell neurophysiology has been performed in anesthetized or passive-awake laboratory animals, the vast majority of behavioral data stems from studies with human subjects. Interpretation of neurophysiological data implicitly assumes that laboratory animals exhibit perceptual phenomena comparable or identical to those observed in human subjects. To explicitly test this underlying assumption, we here characterized how two rhesus macaques and four humans detect changes in intensity of auditory, visual, and audio-visual stimuli. These intensity changes consisted of a gradual envelope modulation for the sound, and a luminance step for the LED. Subjects had to detect any perceived intensity change as fast as possible. By comparing the monkeys' results with those obtained from the human subjects we found that (1) unimodal reaction times differed across modality, acoustic modulation frequency, and species, (2) the largest facilitation of reaction times with the audio-visual stimuli was observed when stimulus onset asynchronies were such that the unimodal reactions would occur at the same time (response, rather than physical synchrony), and (3) the largest audio-visual reaction-time facilitation was observed when unimodal auditory stimuli were difficult to detect, i.e., at slow unimodal reaction times. We conclude that despite marked unimodal heterogeneity, similar multisensory rules applied to both species. Single-cell neurophysiology in the rhesus macaque may therefore yield valuable insights into the mechanisms governing audio-visual integration that may be informative of the processes taking place in the human brain.

The hippocampus is known as a neuronal structure involved in learning, memory and spatial navigation using multi-sensory cues. However, the basic features of its response to acoustic stimuli without any behavioral tasks (conditioning) remains poorly studied. Here, we investigated the CA3 response to auditory stimuli using in vivo loose-patch recordings in awake and anesthetized C57 mice. Different acoustic stimuli in addition to broadband noise such as click, FM sound and pure tone were applied to test the response of CA3 in awake animals. It was found that the wakefulness of the animal is important for the recorded neurons to respond. The CA3 neurons showed a stronger response to broadband noise rather than the other type of stimuli which suggested that auditory information arrived at CA3 via broadband pathways. Finally, we investigated the excitatory and inhibitory inputs to CA3 neurons by using in vivo whole-cell voltage-clamp techniques with the membrane potential holding at -70 and 0 mV, respectively. In awake animals, the excitatory and inhibitory inputs CA3 neurons receive induced by noise are balanced by showing stable intervals and proportional changes of their latencies and peak amplitudes as a function of the stimulation intensities.

Blast-induced tinitus is the number one service-connected disability that currently affects military personnel and veterans. To elucidate its underlying mechanisms, we subjected 13 Sprague Dawley adult rats to unilateral 14 psi blast exposure to induce tinnitus and measured auditory and limbic brain activity using manganese-enhanced MRI (MEMRI). Tinnitus was evaluated with a gap detection acoustic startle reflex paradigm, while hearing status was assessed with prepulse inhibition (PPI) and auditory brainstem responses (ABRs). Both anxiety and cognitive functioning were assessed using elevated plus maze and Morris water maze, respectively. Five weeks after blast exposure, 8 of the 13 blasted rats exhibited chronic tinnitus. While acoustic PPI remained intact and ABR thresholds recovered, the ABR wave P1-N1 amplitude reduction persisted in all blast-exposed rats. No differences in spatial cognition were observed, but blasted rats as a whole exhibited increased anxiety. MEMRI data revealed a bilateral increase in activity along the auditory pathway and in certain limbic regions of rats with tinnitus compared to age-matched controls. Taken together, our data suggest that while blast-induced tinnitus may play a role in auditory and limbic hyperactivity, the non-auditory effects of blast and potential traumatic brain injury may also exert an effect.

The objective of this study was to demonstrate the efficacy of acute inactivation of brain areas by cooling in the behaving ferret and to demonstrate that cooling auditory cortex produced a localisation deficit that was specific to auditory stimuli. The effect of cooling on neural activity was measured in anesthetized ferret cortex. The behavioural effect of cooling was determined in a benchmark sound localisation task in which inactivation of primary auditory cortex (A1) is known to impair performance. Cooling strongly suppressed the spontaneous and stimulus-evoked firing rates of cortical neurons when the cooling loop was held at temperatures below 10°C, and this suppression was reversed when the cortical temperature recovered. Cooling of ferret auditory cortex during behavioural testing impaired sound localisation performance, with unilateral cooling producing selective deficits in the hemifield contralateral to cooling, and bilateral cooling producing deficits on both sides of space. The deficit in sound localisation induced by inactivation of A1 was not caused by motivational or locomotor changes since inactivation of A1 did not affect localisation of visual stimuli in the same context.

Tinnitus chronically affects between 10–15% of the population but, despite its prevalence, the underlying mechanisms are still not properly understood. One experimental model involves administration of high doses of sodium salicylate, as this is known to reliably induce tinnitus in both humans and animals. Guinea pigs were implanted with chronic electrocorticography ( EC oG) electrode arrays, with silver‐ball electrodes placed on the dura over left and right auditory cortex. Two more electrodes were positioned over the cerebellum to monitor auditory brainstem responses ( ABR s). We recorded resting‐state and auditory evoked neural activity from awake animals before and 2 h following salicylate administration (350 mg/kg; i.p.). Large increases in click‐evoked responses (> 100%) were evident across the whole auditory cortex, despite significant reductions in wave I ABR amplitudes (in response to 20 kHz tones), which are indicative of auditory nerve activity. In the same animals, significant decreases in 6–10 Hz spontaneous oscillations (alpha waves) were evident over dorsocaudal auditory cortex. We were also able to demonstrate for the first time that cortical evoked potentials can be inhibited by a preceding gap in background noise [gap‐induced pre‐pulse inhibition ( PPI )], in a similar fashion to the gap‐induced inhibition of the acoustic startle reflex that is used as a behavioural test for tinnitus. Furthermore, 2 h following salicylate administration, we observed significant deficits in PPI of cortical responses that were closely aligned with significant deficits in behavioural responses to the same stimuli. Together, these data are suggestive of neural correlates of tinnitus and oversensitivity to sound (hyperacusis).

Many audio applications perform perception-based time-frequency (TF) analysis by decomposing sounds into a set of functions with good TF localization (i.e. with a small essential support in the TF domain) using TF transforms and applying psychoacoustic models of auditory masking to the transform coefficients. To accurately predict masking interactions between coefficients, the TF properties of the model should match those of the transform. This involves having masking data for stimuli with good TF localization. However, little is known about TF masking for mathematically well-localized signals. Most existing masking studies used stimuli that are broad in time and/or frequency and few studies involved TF conditions. Consequently, the present study had two goals. The first was to collect TF masking data for well-localized stimuli in humans. Masker and target were 10-ms Gaussian-shaped sinusoids with a bandwidth of approximately one critical band. The overall pattern of results is qualitatively similar to existing data for long maskers. To facilitate implementation in audio processing algorithms, a dataset provides the measured TF masking function. The second goal was to assess the potential effect of auditory efferents on TF masking using a modeling approach. The temporal window model of masking was used to predict present and existing data in two configurations: (1) with standard model parameters (i.e. without efferents), (2) with cochlear gain reduction to simulate the activation of efferents. The ability of the model to predict the present data was quite good with the standard configuration but highly degraded with gain reduction. Conversely, the ability of the model to predict existing data for long maskers was better with than without gain reduction. Overall, the model predictions suggest that TF masking can be affected by efferent (or other) effects that reduce cochlear gain. Such effects were avoided in the experiment of this study by using maximally-compact stimuli.

Numerous behavioral paradigms have been developed to assess tinnitus-like behavior in animals. Nevertheless, they are often limited by prolonged training requirements, as well as an inability to simultaneously assess onset and lasting tinnitus behavior, tinnitus pitch or duration, or tinnitus presence without grouping data from multiple animals or testing sessions. To enhance behavioral testing of tinnitus, we developed a conditioned licking suppression paradigm to determine the pitch(s) of both onset and lasting tinnitus-like behavior within individual animals. Rats learned to lick water during broadband or narrowband noises, and to suppress licking to avoid footshocks during silence. After noise exposure, rats significantly increased licking during silent trials, suggesting onset tinnitus-like behavior. Lasting tinnitus-behavior, however, was exhibited in about half of noise-exposed rats through 7 weeks post-exposure tested. Licking activity during narrowband sound trials remained unchanged following noise exposure, while ABR hearing thresholds fully recovered and were comparable between tinnitus(+) and tinnitus(-) rats. To assess another tinnitus inducer, rats were injected with sodium salicylate. They demonstrated high pitch tinnitus-like behavior, but later recovered by 5 days post-injection. Further control studies showed that 1): sham noise-exposed rats tested with footshock did not exhibit tinnitus-like behavior, and 2): noise-exposed or sham rats tested without footshocks showed no fundamental changes in behavior compared to those tested with shocks. Together, these results demonstrate that this paradigm can efficiently test the development of noise- and salicylate-induced tinnitus behavior. The ability to assess tinnitus individually, over time, and without averaging data enables us to realistically address tinnitus in a clinically relevant way. Thus, we believe that this optimized behavioral paradigm will facilitate investigations into the mechanisms of tinnitus and development of effective treatments.

Enhanced detection and discrimination, along with faster reaction times, are the most typical behavioural manifestations of the brain's capacity to integrate multisensory signals arising from the same object. In this study, we examined whether multisensory behavioural gains are observable across different components of the localization response that are potentially under the command of distinct brain regions. We measured the ability of ferrets to localize unisensory (auditory or visual) and spatiotemporally coincident auditory–visual stimuli of different durations that were presented from one of seven locations spanning the frontal hemifield. During the localization task, we recorded the head movements made following stimulus presentation, as a metric for assessing the initial orienting response of the ferrets, as well as the subsequent choice of which target location to approach to receive a reward. Head‐orienting responses to auditory–visual stimuli were more accurate and faster than those made to visual but not auditory targets, suggesting that these movements were guided principally by sound alone. In contrast, approach‐to‐target localization responses were more accurate and faster to spatially congruent auditory–visual stimuli throughout the frontal hemifield than to either visual or auditory stimuli alone. Race model inequality analysis of head‐orienting reaction times and approach‐to‐target response times indicates that different processes, probability summation and neural integration, respectively, are likely to be responsible for the effects of multisensory stimulation on these two measures of localization behaviour.

Previous research demonstrated that while selectively attending to relevant aspects of the external world, the brain extracts pertinent information by aligning its neuronal oscillations to key time points of stimuli or their sampling by sensory organs. This alignment mechanism is termed oscillatory entrainment. We investigated the global, long-timescale dynamics of this mechanism in the primary auditory cortex of nonhuman primates, and hypothesized that lapses of entrainment would correspond to lapses of attention. By examining electrophysiological and behavioral measures, we observed that besides the lack of entrainment by external stimuli, attentional lapses were also characterized by high-amplitude alpha oscillations, with alpha frequency structuring of neuronal ensemble and single-unit operations. Entrainment and alpha-oscillation-dominated periods were strongly anticorrelated and fluctuated rhythmically at an ultra-slow rate. Our results indicate that these two distinct brain states represent externally versus internally oriented computational resources engaged by large-scale task-positive and task-negative functional networks.

Age-related temporal-processing declines of rapidly presented sequences may involve contributions of sensory memory. This study investigated recall for rapidly presented auditory (vowel) and visual (letter) sequences presented at six different stimulus onset asynchronies (SOA) that spanned threshold SOAs for sequence identification. Younger, middle-aged, and older adults participated in all tasks. Results were investigated at both equivalent performance levels (i.e., SOA threshold) and at identical physical stimulus values (i.e., SOAs). For four-item sequences, results demonstrated best performance for the first and last items in the auditory sequences, but only the first item for visual sequences. For two-item sequences, adults identified the second vowel or letter significantly better than the first. Overall, when temporal-order performance was equated for each individual by testing at SOA thresholds, recall accuracy for each position across the age groups was highly similar. These results suggest that modality-specific processing declines of older adults primarily determine temporal-order performance for rapid sequences. However, there is some evidence for a second amodal processing decline in older adults related to early sensory memory for final items in a sequence. This selective deficit was observed particularly for longer sequence lengths and was not accounted for by temporal masking.

Listeners can perceive interleaved sequences of sounds from two or more sources as segregated streams. In humans, physical separation of sound sources is a major factor enabling such stream segregation. Here, we examine spatial stream segregation with a psychophysical measure in domestic cats. Cats depressed a pedal to initiate a target sequence of brief sound bursts in a particular rhythm and then released the pedal when the rhythm changed. The target bursts were interleaved with a competing sequence of bursts that could differ in source location but otherwise were identical to the target bursts. This task was possible only when the sources were heard as segregated streams. When the sound bursts had broad spectra, cats could detect the rhythm change when target and competing sources were separated by as little as 9.4°. Essentially equal levels of performance were observed when frequencies were restricted to a high, 4-to-25-kHz, band in which the principal spatial cues presumably were related to sound levels. When the stimulus band was restricted from 0.4 to 1.6 kHz, leaving interaural time differences as the principal spatial cue, performance was severely degraded. The frequency sensitivity of cats in this task contrasts with that of humans, who show better spatial stream segregation with low- than with high-frequency sounds. Possible explanations for the species difference includes the smaller interaural delays available to cats due to smaller sizes of their heads and the potentially greater sound-level cues available due to the cat's frontally directed pinnae and higher audible frequency range.

We used the rat primary auditory cortex (A1) as a model to probe the effects of cholinergic enhancement on perceptual learning and auditory processing mechanisms in both young and old animals. Rats learned to perform a two-tone frequency discrimination task over the course of two weeks, combined with either the administration of a cholinesterase inhibitor or saline. We found that while both age groups learned the task more quickly through cholinergic enhancement, the young did so by improving target detection, whereas the old did so by inhibiting erroneous responses to nontarget stimuli. We also found that cholinergic enhancement led to marked functional and structural changes within A1 in both young and old rats. Importantly, we found that several functional changes observed in the old rats, particularly those relating to the processing and inhibition of nontargets, produced cortical processing features that resembled those of young untrained rats more so than those of older adult rats. Overall, these findings demonstrate that combining auditory training with neuromodulation of the cholinergic system can restore many of the auditory cortical functional deficits observed as a result of normal aging and add to the growing body of evidence demonstrating that many age-related perceptual and neuroplastic changes are reversible.

With increasing numbers of children and adults receiving bilateral cochlear implants, there is an urgent need for assessment tools that enable testing of binaural hearing abilities. Current test batteries are either limited in scope or are of an impractical duration for routine testing. Here, we report a behavioral test that enables combined testing of speech identification and spatial discrimination in noise. In this task, multitalker babble was presented from all speakers, and pairs of speech tokens were sequentially presented from two adjacent speakers. Listeners were required to identify both words from a closed set of four possibilities and to determine whether the second token was presented to the left or right of the first. In Experiment 1, normal-hearing adult listeners were tested at 15° intervals throughout the frontal hemifield. Listeners showed highest spatial discrimination performance in and around the frontal midline, with a decline at more eccentric locations. In contrast, speech identification abilities were least accurate near the midline and showed an improvement in performance at more lateral locations. In Experiment 2, normal-hearing listeners were assessed using a restricted range of speaker locations designed to match those found in clinical testing environments. Here, speakers were separated by 15° around the midline and 30° at more lateral locations. This resulted in a similar pattern of behavioral results as in Experiment 1. We conclude, this test offers the potential to assess both spatial discrimination and the ability to use spatial information for unmasking in clinical populations.

Vulnerability to noise-induced tinnitus is associated with increased spontaneous firing rate in dorsal cochlear nucleus principal neurons, fusiform cells. This hyperactivity is caused, at least in part, by decreased Kv7.2/3 (KCNQ2/3) potassium currents. However, the biophysical mechanisms underlying resilience to tinnitus, which is observed in noise-exposed mice that do not develop tinnitus (non-tinnitus mice), remain unknown. Our results show that noise exposure induces, on average, a reduction in KCNQ2/3 channel activity in fusiform cells in noise-exposed mice by 4 days after exposure. Tinnitus is developed in mice that do not compensate for this reduction within the next 3 days. Resilience to tinnitus is developed in mice that show a re-emergence of KCNQ2/3 channel activity and a reduction in HCN channel activity. Our results highlight KCNQ2/3 and HCN channels as potential targets for designing novel therapeutics that may promote resilience to tinnitus.

Localizing sounds in our environment is one of the fundamental perceptual abilities that enable humans to communicate, and to remain safe. Because the acoustic cues necessary for computing source locations consist of differences between the two ears in signal intensity and arrival time, sound localization is fairly poor when a single ear is available. In adults who become deaf and are fitted with cochlear implants (CIs) sound localization is known to improve when bilateral CIs (BiCIs) are used compared to when a single CI is used. The aim of the present study was to investigate the emergence of spatial hearing sensitivity in children who use BiCIs, with a particular focus on the development of behavioral localization patterns when stimuli are presented in free-field horizontal acoustic space. A new analysis was implemented to quantify patterns observed in children for mapping acoustic space to a spatially relevant perceptual representation. Children with normal hearing were found to distribute their responses in a manner that demonstrated high spatial sensitivity. In contrast, children with BiCIs tended to classify sound source locations to the left and right; with increased bilateral hearing experience, they developed a perceptual map of space that was better aligned with the acoustic space. The results indicate experience-dependent refinement of spatial hearing skills in children with CIs. Localization strategies appear to undergo transitions from sound source categorization strategies to more fine-grained location identification strategies. This may provide evidence for neural plasticity, with implications for training of spatial hearing ability in CI users.

The precise encoding of temporal features of auditory stimuli by the mammalian auditory system is critical to the perception of biologically important sounds, including vocalizations, speech, and music. In this study, auditory gap-detection behavior was evaluated in adult pigmented ferrets (Mustelid putorius furo) using bandpassed stimuli designed to widely sample the ferret's behavioral and physiological audiogram. Animals were tested under positive operant conditioning, with psychometric functions constructed in response to gap-in-noise lengths ranging from 3 to 270 ms. Using a modified version of this gap-detection task, with the same stimulus frequency parameters, we also tested a cohort of normal-hearing human subjects. Gap-detection thresholds were computed from psychometric curves transformed according to signal detection theory, revealing that for both ferrets and humans, detection sensitivity was worse for silent gaps embedded within low-frequency noise compared with high-frequency or broadband stimuli. Additional psychometric function analysis of ferret behavior indicated effects of stimulus spectral content on aspects of behavioral performance related to decision-making processes, with animals displaying improved sensitivity for broadband gap-in-noise detection. Reaction times derived from unconditioned head-orienting data and the time from stimulus onset to reward spout activation varied with the stimulus frequency content and gap length, as well as the approach-to-target choice and reward location. The present study represents a comprehensive evaluation of gap-detection behavior in ferrets, while similarities in performance with our human subjects confirm the use of the ferret as an appropriate model of temporal processing.