Auditory Research publications

We investigated the auditory responses of anesthetized rhesus macaques to complex natural sounds using functional magnetic resonance imaging (fMRI) and a near-awake anesthesia protocol combining low-dose sevoflurane and dexmedetomidine. Eleven animals were scanned while listening to macaque vocalizations and non-vocal sounds. Robust activation was observed in primary and belt auditory cortices as well as subcortical structures, indicating preserved auditory responsiveness under anesthesia. However, unlike in awake animals, selective responses to vocalizations in anterior temporal voice areas (aTVAs) were absent. Instead, vocalization sensitivity emerged in the ventral premotor cortex, prefrontal cortex, and posterior middle temporal gyrus, regions associated with the dorsal auditory stream and multisensory integration. These findings suggest that while anesthesia preserves basic auditory processing, it modulates higher-order cortical responses involved in voice perception. Anesthetized fMRI thus offers a valuable tool for large-scale studies of primary auditory functions, while it must be approached with caution when studying higher-order auditory functions.

Survival relies on an organism's intrinsic ability to instinctively react to stimuli such as food, water, and threats, ensuring the fundamental ability to feed, drink, and avoid danger even in the absence of prior experience. These natural, unconditioned stimuli can also facilitate associative learning, where pairing them consistently with neutral cues will elicit responses to these cues. Threat conditioning, a well-explored form of associative learning, commonly employs painful electric shocks, mimicking injury, as unconditioned stimuli. It remains elusive whether actual injury or pain is necessary for effective learning, or whether the threat of harm is sufficient. Approaching predators create looming shadows and sounds, triggering strong innate defensive responses like escape and freezing. This study investigates whether visual looming stimuli can induce learned freezing or learned escape responses to a conditioned stimulus in male rats. Surprisingly, pairing a neutral tone with a looming stimulus only weakly evokes learned defensive responses, in contrast to the strong responses observed when the looming stimulus is replaced by a shock. This dissociation sheds light on the boundaries for learned defensive responses thereby impacting our comprehension of learning processes and defensive strategies.

Anticipating positive outcomes is a core cognitive function in the process of reward prediction. However, no neurophysiological method objectively assesses reward prediction in basic medical research. In the present study, we established a physiological paradigm using cortical direct current (DC) potential responses in rats to assess reward prediction. This paradigm consisted of five daily 1-h sessions with two tones, wherein the rewarded tone was followed by electrical stimulation of the medial forebrain bundle (MFB) scheduled at 1000 ms later, whereas the unrewarded tone was not. On day 1, both tones induced a negative DC shift immediately after auditory responses, persisting up to MFB stimulation. This negative shift progressively increased and peaked on day 4. Starting from day 3, the negative shift from 600 to 1000 ms was significantly larger following the rewarded tone than that following the unrewarded tone. This negative DC shift was particularly prominent in the frontal cortex, suggesting its crucial role in discriminative reward prediction. During the extinction sessions, the shift diminished significantly on extinction day 1. These findings suggest that cortical DC potential is related to reward prediction and could be a valuable tool for evaluating animal models of depression, providing a testing system for anhedonia.

Background External-ear amplification (EEA) has been shown to vary from 5–19 dB-A in large datasets of pediatric, adolescent, and adult human participants. However, variable EEA is an overlooked characteristic that likely plays a role in individual noise-induced hearing loss (NIHL) susceptibility. A noise exposure varying 5–19 dB-A translates to high-EEA individuals theoretically experiencing 3–4 times greater NIHL risk than low-EEA individuals. Objective The purpose of this preliminary analysis was to test the hypothesis that higher EEA is correlated with increased noise-induced threshold shift susceptibility. Design Nine chinchillas were exposed to 4-kHz octave-band noise at 89 dB-SPL for 24 h. Auditory brainstem response thresholds were obtained pre-exposure, 24-h post-exposure, and 4-week post-exposure. Relationships between EEA and threshold shift were analyzed. Results Open-ear EEA ranged 11–19 dB-SPL, and occluded-ear EEA ranged 10–21 dB-SPL. Higher occluded-ear EEA was correlated with increased NIHL susceptibility ( p = 0.04), as was lower body weight ( p = 0.01). Male animals exhibited more threshold shift than female animals ( p = 0.02), lower body weight than female animals ( p = 0.02), and higher occluded-ear EEA (male mean = 18 dB; female mean = 15 dB). Conclusions Taken together, increased threshold shift susceptibility was observed in the smallest animals, animals with the highest occluded-ear EEA, and in male animals (which tended to have higher occluded-ear EEA). Given the established relationship between smaller body size and higher occluded-ear EEA, these preliminary results suggest that body size (and occluded-ear EEA; a function of body size) could be a potential, underlying driver of NIHL susceptibility differences, rather than true sex differences.

This project investigated whether pediatric (5–14 years) and adult (30–60 years) cochlear implant (CI) users benefit from a target/masker sex-mismatch for speech-in-speech recognition. Speech recognition thresholds were estimated in a two-male-talker or a two-female-talker masker. Target and masker speech were either sex-matched or sex-mismatched. For both age groups, performance for sex-matched talkers was worse for male than female speech. Sex-mismatch benefit was observed for the two-male-talker masker, indicating CI users can benefit from a target/masker sex mismatch. No benefit was observed for the two-female-talker masker, suggesting this effect may depend on the relative contributions of energetic and informational masking.

Non-native listeners deal with adverse listening conditions in their daily life much harder than native listeners. However, previous work in our laboratories found that native Chinese listeners with native English exposure may improve the use of temporal fluctuations of noise for English vowel identification. The purpose of this study was to investigate whether Chinese listeners can generalize the use of temporal cues for the English sentence recognition in noise. Institute of Electrical and Electronics Engineers (IEEE) sentence recognition in quiet condition, stationary noise, and temporally-modulated noise were measured for native American English listeners (EN), native Chinese listeners in the United States (CNU), and native Chinese listeners in China (CNC). Results showed that in general, EN listeners outperformed the two groups of CN listeners in quiet and noise, while CNU listeners had better scores of sentence recognition than CNC listeners. Moreover, the native English exposure helped CNU listeners use high-level linguistic cues more effectively and take more advantage of temporal fluctuations of noise to process English sentence in severely degraded listening conditions [i.e., the signal-to-noise ratio (SNR) of −12 dB] than CNC listeners. These results suggest a significant effect of language experience on the auditory processing of both speech and noise.

Animals use auditory cues generated by defensive responses of others to detect impending danger. Here we identify a neural circuit in rats involved in the detection of one such auditory cue, the cessation of movement-evoked sound resulting from freezing. This circuit comprises the dorsal subnucleus of the medial geniculate body (MGD) and downstream areas, the ventral area of the auditory cortex (VA), and the lateral amygdala (LA). This study suggests a role for the auditory offset pathway in processing a natural sound cue of threat.

The ability to recognize sounds in noise is a key part of hearing, and the mechanisms by which the brain identifies sounds in noise are of considerable interest to scientists, clinicians and engineers. Yet we know little about the necessity of regions such as auditory cortex for hearing in noise, or how cortical processing of sounds is adversely affected by noise. Here we used reversible cortical inactivation and extracellular electrophysiology in ferrets performing a vowel discrimination task to identify and understand the causal contribution of auditory cortex to hearing in noise. Cortical inactivation by cooling impaired task performance in noisy but not clean conditions, while responses of auditory cortical neurons were less informative about vowel identity in noise. Simulations mimicking cortical inactivation indicated that effects of inactivation were related to the loss of information about sounds represented across neural populations. The addition of noise to target sounds drove spiking activity in auditory cortex and recruitment of additional neural populations that were linked to degraded behavioral performance. To suppress noise-related activity, we used continuous exposure to background noise to adapt the auditory system and recover behavioral performance in both ferrets and humans. Inactivation by cooling revealed that the benefits of continuous exposure were not cortically dependent. Together our results highlight the importance of auditory cortex in sound discrimination in noise and the underlying mechanisms through which noise-related activity and adaptation shape hearing.

Human listeners are able to recognize accurately an impressive range of complex sounds, such as musical instruments or voices. The underlying mechanisms are still poorly understood. Here, we aimed to characterize the processing time needed to recognize a natural sound. To do so, by analogy with the “rapid visual sequential presentation paradigm”, we embedded short target sounds within rapid sequences of distractor sounds. The core hypothesis is that any correct report of the target implies that sufficient processing for recognition had been completed before the time of occurrence of the subsequent distractor sound. We conducted four behavioral experiments using short natural sounds (voices and instruments) as targets or distractors. We report the effects on performance, as measured by the fastest presentation rate for recognition, of sound duration, number of sounds in a sequence, the relative pitch between target and distractors and target position in the sequence. Results showed a very rapid auditory recognition of natural sounds in all cases. Targets could be recognized at rates up to 30 sounds per second. In addition, the best performance was observed for voices in sequences of instruments. These results give new insights about the remarkable efficiency of timbre processing in humans, using an original behavioral paradigm to provide strong constraints on future neural models of sound recognition.

The ability to spontaneously feel a beat in music is a phenomenon widely believed to be unique to humans. Though beat perception involves the coordinated engagement of sensory, motor and cognitive processes in humans, the contribution of low-level auditory processing to the activation of these networks in a beat-specific manner is poorly understood. Here, we present evidence from a rodent model that midbrain preprocessing of sounds may already be shaping where the beat is ultimately felt. For the tested set of musical rhythms, on-beat sounds on average evoked higher firing rates than off-beat sounds, and this difference was a defining feature of the set of beat interpretations most commonly perceived by human listeners over others. Basic firing rate adaptation provided a sufficient explanation for these results. Our findings suggest that midbrain adaptation, by encoding the temporal context of sounds, creates points of neural emphasis that may influence the perceptual emergence of a beat.

Signals in one sensory modality can influence perception of another, for example the bias of visual timing by audition: temporal ventriloquism. Strong accounts of temporal ventriloquism hold that the sensory representation of visual signal timing changes to that of the nearby sound. Alternatively, underlying sensory representations do not change. Rather, perceptual grouping processes based on spatial, temporal, and featural information produce best-estimates of global event properties. In support of this interpretation, when feature-based perceptual grouping conflicts with temporal information-based in scenarios that reveal temporal ventriloquism, the effect is abolished. However, previous demonstrations of this disruption used long-range visual apparent-motion stimuli. We investigated whether similar manipulations of feature grouping could also disrupt the classical temporal ventriloquism demonstration, which occurs over a short temporal range. We estimated the precision of participants’ reports of which of two visual bars occurred first. The bars were accompanied by different cross-modal signals that onset synchronously or asynchronously with each bar. Participants’ performance improved with asynchronous presentation relative to synchronous - temporal ventriloquism - however, unlike the long-range apparent motion paradigm, this was unaffected by different combinations of cross-modal feature, suggesting that featural similarity of cross-modal signals may not modulate cross-modal temporal influences in short time scales.

Animal models are widely used to examine the neurophysiological basis of human pitch perception, and it is therefore important to understand the similarities and differences in pitch processing across species. Pitch discrimination performance is usually measured using two-alternative forced choice (2AFC) procedures in humans and go/no-go tasks in animals, potentially confounding human-to-animal comparisons. We have previously shown that pitch discrimination thresholds of ferrets on a 2AFC task are markedly poorer than those reported for go/no-go tasks in other non-human species (Walker et al ., 2009). To better compare the pitch discrimination performance of ferret with other species, here we measure pitch change detection thresholds of ferrets and humans on a common, appetitive go/no-go task design. We found that ferrets’ pitch thresholds were ~10 times larger than that of humans on the go/no-go task, and were within the range of thresholds reported in other non-human species. Interestingly, ferrets’ thresholds were 100 times larger than human thresholds on a 2AFC pitch discrimination task using the same stimuli. These results emphasize that sensory discrimination thresholds can differ across tasks, particularly for non-human animals. Performance on our go/no-go task is likely to reflect different neurobiological processes than that on our 2AFC task, as the former required the subjects only to detect a pitch change while the latter required them to label the direction of the pitch change. ABBREVIATIONS 2AFC 2-Alternative Forced Choice F0 Fundamental Frequency HIGHLIGHTS Pitch discrimination thresholds of ferrets were 10 times larger than those of humans on a go/no-go task Ferrets’ pitch thresholds are similar to those reported for a range of other mammals Pitch thresholds of ferrets, but not humans, were drastically better on the go/no-go task than a 2AFC task using the same stimuli

Difficulties with second-language vowel perception may be related to the significant challenges in using acoustic-phonetic cues. This study investigated the effects of perception training with duration-equalized vowels on native Chinese listeners' English vowel perception and their use of acoustic-phonetic cues. Seventeen native Chinese listeners were perceptually trained with duration-equalized English vowels, and another 17 native Chinese listeners watched English videos as a control group. Both groups were tested with English vowel identification and vowel formant discrimination before training, immediately after training, and three months later. The results showed that the training effect was greater for the vowel training group than for the control group, while both groups improved their English vowel identification and vowel formant discrimination after training. Moreover, duration-equalized vowel perception training significantly reduced listeners' reliance on duration cues and improved their use of spectral cues in identifying English vowels, but video-watching did not help. The results suggest that duration-equalized English vowel perception training may improve non-native listeners' English vowel perception by changing their perceptual weights of acoustic-phonetic cues.

A unique sound that deviates from a repetitive background sound induces signature neural responses, such as mismatch negativity and novelty P3 response in electro-encephalography studies. Here we show that a deviant auditory stimulus induces a human pupillary dilation response (PDR) that is sensitive to the stimulus properties and irrespective whether attention is directed to the sounds or not. In an auditory oddball sequence, we used white noise and 2000-Hz tones as oddballs against repeated 1000-Hz tones. Participants' pupillary responses were recorded while they listened to the auditory oddball sequence. In Experiment 1, they were not involved in any task. Results show that pupils dilated to the noise oddballs for approximately 4 s, but no such PDR was found for the 2000-Hz tone oddballs. In Experiments 2, two types of visual oddballs were presented synchronously with the auditory oddballs. Participants discriminated the auditory or visual oddballs while trying to ignore stimuli from the other modality. The purpose of this manipulation was to direct attention to or away from the auditory sequence. In Experiment 3, the visual oddballs and the auditory oddballs were always presented asynchronously to prevent residuals of attention on to-be-ignored oddballs due to the concurrence with the attended oddballs. Results show that pupils dilated to both the noise and 2000-Hz tone oddballs in all conditions. Most importantly, PDRs to noise were larger than those to the 2000-Hz tone oddballs regardless of the attention condition in both experiments. The overall results suggest that the stimulus-dependent factor of the PDR appears to be independent of attention.

This study investigates the influence of temporal regularity on human listeners' ability to detect a repeating noise pattern embedded in statistically identical non-repeating noise. Human listeners were presented with white noise stimuli that either contained a frozen segment of noise that repeated in a temporally regular or irregular manner, or did not contain any repetition at all. Subjects were instructed to respond as soon as they detected any repetition in the stimulus. Pattern detection performance was best when repeated targets occurred in a temporally regular manner, suggesting that temporal regularity plays a facilitative role in pattern detection. A modulation filterbank model could account for these results.

Previous research suggests that within Mandarin-speaking congenital amusics, only a subgroup has behavioral lexical tone perception impairments (tone agnosia), whereas the rest of amusics do not. The purpose of the current study was to investigate the categorical nature of lexical tone perception in Mandarin-speaking amusics with and without behavioral lexical tone deficits. Three groups of listeners (controls, pure amusics, and amusics with tone agnosia) participated in tone identification and discrimination tasks. Indexes of the categorical perception (CP) of a physical continuum of fundamental frequencies ranging from a rising to level tone were measured. Specifically, the stimulus durations were manipulated at 100 and 200 ms. For both stimulus durations, all groups exhibited similar categorical boundaries. The pure amusics showed sharp identification slopes and significantly peaked discrimination functions similar to those of normal controls. However, such essential characteristics for the CP of lexical tones were not observed in amusics with tone agnosia. An enlarged step-size from 20 to 35 Hz was not able to produce any discrimination peaks in tone agnosics either. The current study revealed that only amusics with tone agnosia showed a lack of categorical tone perception, while the pure amusics demonstrated typical CP of lexical tones, indicating that the deficit of pitch processing in music does not necessarily result in the deficit in the CP of lexical tones. The different performance between congenital amusics with and without tone agnosia provides a new perspective on the proposition of the relationship between music and speech perception.

Recent sensory experience modifies subjective timing perception. For example, when visual events repeatedly lead auditory events, such as when the sound and video tracks of a movie are out of sync, subsequent vision-leads-audio presentations are reported as more simultaneous. This phenomenon could provide insights into the fundamental problem of how timing is represented in the brain, but the underlying mechanisms are poorly understood. Here, we show that the effect of recent experience on timing perception is not just subjective; recent sensory experience also modifies relative timing discrimination. This result indicates that recent sensory history alters the encoding of relative timing in sensory areas, excluding explanations of the subjective phenomenon based only on decision-level changes. The pattern of changes in timing discrimination suggests the existence of two sensory components, similar to those previously reported for visual spatial attributes: a lateral shift in the nonlinear transducer that maps relative timing into perceptual relative timing and an increase in transducer slope around the exposed timing. The existence of these components would suggest that previous explanations of how recent experience may change the sensory encoding of timing, such as changes in sensory latencies or simple implementations of neural population codes, cannot account for the effect of sensory adaptation on timing perception.

Despite extensive evidence of the possible interactions between multisensory signals, it remains unclear at what level of sensory processing these interactions take place. When two identical auditory beeps (inducers) are presented in quick succession accompanied by a single visual flash, observers often report seeing two visual flashes, rather than the physical one - the double flash illusion. This compelling illusion has often been considered to reflect direct interactions between neural activations in different primary sensory cortices. Against this simple account, here we show that by simply changing the inducer signals between featurally distinct signals (e.g. high- and low-pitch beeps) the illusory double flash is abolished. This result suggests that a critical component underlying the illusion is perceptual grouping of the inducer signals, consistent with the notion that multisensory combination is preceded by determination of whether the relevant signals share a common source of origin.

It has now been well established that the point of subjective synchrony for audio and visual events can be shifted following exposure to asynchronous audio-visual presentations, an effect often referred to as temporal recalibration. Recently it was further demonstrated that it is possible to concurrently maintain two such recalibrated estimates of audio-visual temporal synchrony. However, it remains unclear precisely what defines a given audio-visual pair such that it is possible to maintain a temporal relationship distinct from other pairs. It has been suggested that spatial separation of the different audio-visual pairs is necessary to achieve multiple distinct audio-visual synchrony estimates. Here we investigated if this is necessarily true. Specifically, we examined whether it is possible to obtain two distinct temporal recalibrations for stimuli that differed only in featural content. Using both complex (audio visual speech; see Experiment 1) and simple stimuli (high and low pitch audio matched with either vertically or horizontally oriented Gabors; see Experiment 2) we found concurrent, and opposite, recalibrations despite there being no spatial difference in presentation location at any point throughout the experiment. This result supports the notion that the content of an audio-visual pair alone can be used to constrain distinct audio-visual synchrony estimates regardless of spatial overlap.