Psychoacoustics publications

This study examined whether interaural amplitude modulation (AM) coherence influences binaural pitch fusion in cochlear implant (CI) users. Fourteen adults, including seven bimodal and seven bilateral CI users, completed fusion-range measurements using dichotic stimuli under unmodulated, coherent AM and two incoherent AM conditions involving interaural AM-phase and AM-rate mismatches. Coherent AM consistently broadened fusion ranges, often doubling those in the unmodulated condition, even with shallow modulation depth. In contrast, incoherent AM, including interaural phase or rate mismatches, narrowed fusion. These findings indicate that temporal-envelope coherence facilitates binaural integration in CI users, emphasizing its importance for auditory processing and CI sound-processing design.

In the auditory cortex, neural responses to stimuli inside receptive fields (RFs) can be further facilitated by behavioral demands, such as attending to a spatial location. It is less clear how off-RF stimuli modulate neural responses and contribute to behavioral tasks. Our recent study revealed a particular form of location-specific facilitation evoked by repeated stimulation from an off-RF location, suggesting behavioral modulation of spatial RFs. To further explore this question, we trained marmosets to attend to sound locations that were either inside or outside the RFs of auditory cortical neurons. The majority of neurons showed increased firing rates at target locations inside their RFs. Interestingly, this increase also occurred outside the RFs, sometimes exceeding the responses at the RF center during passive listening. This task-related off-RF facilitation was much more common in the caudal area than in the rostral area and the primary auditory cortex. A normalization model reproduced the off-RF facilitation using widespread suppression. The model’s prediction was confirmed by experimental observations of widespread reductions in firing rate and hyperpolarized membrane potentials for off-RF stimuli. These results suggest that behavioral task demands recruit a broader range of neurons than those that are responsive to a target sound in the passive state.

Deep neural network (DNN)-based noise reduction has emerged as a promising advancement in hearing aid signal processing as a means to improve speech intelligibility in noisy environments for hearing aid wearers. The aim of this study was to investigate the impact of the DNN on speech intelligibility in speech-shaped noise (SSN) and multitalker babble (MTB) when the target speech was coming from the front and from the side. Subjective ratings of clarity, total impression, listening effort, and background noise awareness were also collected. Twenty adult participants with mild to moderately severe sensorineural hearing loss were fitted with hearing aids from a single manufacturer, programmed with four different settings that varied across combinations of microphone directionality (omnidirectional and directional beamforming) and noise reduction (off, traditional, DNN). Results showed that DNN, when combined with beamforming, consistently outperformed the other programs across all metrics. Outcomes were influenced by both noise type and spatial configuration. DNN was more effective in SSN than MTB. Beamforming was especially beneficial when the target speech came from the front. Listening in programs that included both DNN and beamforming together resulted in additional benefits shown in the outcome measures, most likely due to the beamforming improving the signal-to-noise ratio and providing a cleaner signal for the DNN to work with.

As the Arctic warms and becomes more accessible to human activities and associated noise sources, it is important to understand the auditory capabilities of ice-associated marine mammals that rely on sound. In this study, the in-air hearing of one adult bearded seal ( Erignathus barbatus ) was measured in ambient outdoor conditions using psychophysical methods. 50% detection thresholds were measured for 10 frequencies (0.04–51.2 kHz) that extend across the subject’s hearing range. For low to mid frequencies (0.04–12.8 kHz), thresholds were constrained, or masked, by ambient noise. Thresholds obtained at higher frequencies (25.6–51.2 kHz) were sufficiently elevated above background noise to provide absolute measures of hearing sensitivity. These measurements reveal that the high-frequency roll-off for bearded seals is in alignment with available auditory data for related species despite more than 11 million years of evolutionary isolation. Further, the data collected at low and mid frequencies enable an unconventional estimation of critical ratios, which can be applied in masking models. Collectively, these findings for bearded seals listening for airborne sounds highlight auditory similarities within the northern clade of phocid Carnivores and improve predictions of potential noise effects for seals in changing Arctic soundscapes.

Introduction Bilateral cochlear implants (BiCIs) do not restore sound localization abilities to the full extent exhibited by typical hearing (TH) listeners, partly due to poor encoding of interaural time differences (ITDs). ITD cues have been provided and investigated using synchronized research processors that ensure the precise delivery of ITD cues. These studies have been conducted in a direct stimulation setting, which bypasses the processor microphones and, in most cases, removes interaural level difference cues (ILDs). To our knowledge, this is the first study that evaluated the efficacy of synchronized stimulation in restoring sensitivity to ITDs in a free field localization experiment. This was made possible by the CCi-MOBILE, a portable and real-time processing research platform that allows for synchronizing microphone inputs. Methods Fourteen BiCI listeners were tested with experimental real-time coding strategies in comparison to unsynchronized clinical processors. We calculated the binaural cues from the acoustic stimuli at the level of microphone input. Results The recordings show that the experimental coding strategies in this study deliver ITDs with greater precision than the clinical strategy. However, psychophysical testing did not show the benefit of an ITD-encoding strategy in improving localization in a free field. The ITD encoding strategies preserved ITDs, which better differentiated unique loudspeaker locations than interaural level differences (ILDs), suggesting that listeners could achieve improved performance if they accessed these cues. As expected, ILDs were similar across all strategies, including the ITD encoding strategies. The lack of improvement in localization performance is likely because ILDs remained to be the dominant cue in acute localization testing, even when ITD cues were available. Discussion Providing BiCI listeners with adequate experiences with ITD cues may be necessary to shift their reliance from ILD dominance to a combined reliance on ILD and ITD cues in free-field conditions. The CCi-MOBILE could enable take-home practice with novel stimulation strategies for extended experiences and long-term evaluation in real-world listening environments.

We describe here a mode of activity of neurons in auditory cortex of freely moving rats consisting of large, slow firing rate modulations, which were not driven by sounds, were larger than the sound evoked responses, and were locked to specific time points during the task, similar to responses of hippocampal time-sensitive neurons. This activity mode had important functional consequences to sound processing during task performance. We show that the slow firing rate modulations caused the ongoing activity just before sound presentations to be higher during task performance than during passive listening. Concurrently, during task performance, the responses to target stimuli were weaker but more informative about the task-relevant sounds. In a model, higher ongoing activity caused more synaptic depression of the cortico-cortical synapses, reducing the tendency of the network to produce population spikes and resulting in weaker but more informative responses to sounds.

Purpose Best practices in audiology recommend assessing speech understanding in noisy environments, especially for those with communication difficulties. Speech-in-noise (SiN) assessments such as the QuickSIN are used for validating signal processing in hearing aids (HAs) and are linked to HA satisfaction. This project seeks to enhance QuickSIN test efficiency by applying recent advancements in automatic speech recognition (ASR) technologies. Method Twenty-three adults with sensorineural hearing loss were fitted bilaterally with Unitron Moxi HAs and were administered the QuickSIN test in low and high reverberation environments. Testing was performed with two different HA programs: an omnidirectional program and a fixed directional microphone program. QuickSIN sentences were presented from 0° azimuth and competing babble from either 0°, laterally from 90° or 270°, or simultaneously from 90°, 180°, and 270° azimuths. Participants’ verbal responses to QuickSIN stimuli were scored by an audiologist and were recorded in parallel for offline transcription and scoring by ASR models from Amazon, Microsoft, NVIDIA, and Picovoice. The ASR-derived QuickSIN scores were compared to the corresponding audiologist-derived scores. Results Repeated Measures ANOVA results revealed that all ASR models overestimated the QuickSIN scores across most test conditions. Bland-Altman analyses showed that the Amazon ASR model had the least bias and the narrowest range for the limits of agreement, in comparison to the manual scoring by an experienced audiologist. Conclusions Some ASR models, such as Amazon, demonstrated performance comparable to that of an audiologist in automatically scoring QuickSIN tests. However, further refinements are necessary to increase the robustness of the ASR models in scoring low SNR loss test conditions.

Atypical sensory processing, particularly in the auditory domain, is one of the most common and quality-of-life affecting symptoms seen in autism spectrum disorders (ASD). Fragile X Syndrome (FXS) is a leading inherited cause of ASD and a majority of FXS individuals present with auditory processing alterations. While auditory hypersensitivity is a common phenotype observed in FXS and Fmr1 knockout (KO) rodent models, it is important to consider other auditory coding impairments that could contribute to sound processing difficulties and disrupted language comprehension in FXS. We have shown previously that a Fmr1 KO rat model of FXS exhibits heightened sound sensitivity that coincided with abnormal perceptual integration of stimulus bandwidth, indicative of altered spectral processing. Frequency discrimination is a fundamental aspect of sound encoding that is important for a range of auditory processes, such as source segregation and speech comprehension, and disrupted frequency coding could thus contribute to a range of auditory issues in FXS and ASD. Here we explicitly characterized spectral processing deficits in male Fmr1 KO rats using an operant conditioning tone discrimination assay and in vivo electrophysiological recordings from the auditory cortex and inferior colliculus. We found that Fmr1 KO rats exhibited poorer frequency resolution, which corresponded with neuronal hyperactivity and broader frequency tuning in auditory cortical but not collicular neurons. Using an experimentally informed population model, we show that these cortical physiological differences can recapitulate the observed behavior discrimination deficits, with decoder performance being tightly linked to differences in cortical tuning width and signal-to-noise ratios. Together, these findings indicate that cortical hyperexcitability in Fmr1 KO rats may act to preserve signal-to-noise ratios and signal detection threshold at the expense of sound sensitivity and fine feature discrimination, highlighting a potential mechanistic locus for a range of auditory behavioral phenotypes in FXS.

Background: Acoustic trauma is a common cause of acute sensorineural hearing loss associated with tinnitus; however, the underlying molecular mechanisms remain unclear. Extracellular signal-regulated kinase 2 (ERK2), a member of the mitogen-activated protein kinase family, is crucial in cellular signaling, especially in the nervous system, where it helps regulate neuroprotection, neurogenesis, and neuronal plasticity. ERK2 is activated in the cochlea by acoustic stimuli and plays a protective role in cochlear hair cells (HCs), which are the primary sensory receptors for hearing. However, the significance of ERK2 expression in HCs associated with development and etiology of tinnitus is largely unexplored. Methods: To investigate the role of ERK2 in tinnitus development, the gap detection test (GAP) was used to evaluate HC-specific ERK2-conditional knockout mice (HC-E2CKO) exposed to moderate acoustic stimuli. Results: Both control and HC-E2CKO mice showed normal prepulse inhibition levels (<0.6) before and after auditory damage, indicating normal functioning of sensorimotor gating pathways, excluding gross sensorimotor deficits. This confirmed that the animals were eligible for the GAP. HC-E2CKO mice showed a transient increase in the GAP ratio, indicating tinnitus development, 1 week after noise exposure, although the hearing threshold was not significantly elevated. The GAP ratio returned to normal after 2 weeks. In contrast, control mice did not exhibit elevation in hearing threshold and the GAP ratio remained normal. Conclusion: Our findings suggest that ERK2 in the inner ear plays a role in tinnitus onset or perception after acoustic stress, potentially through inhibitory mechanisms.

Frequency analysis by the cochlea forms a key foundation for all subsequent auditory processing. Stimulus-frequency otoacoustic emissions (SFOAEs) are a potentially powerful alternative to traditional behavioral experiments for estimating cochlear tuning without invasive testing, as is necessary in humans. Which methods accurately predict cochlear tuning remains controversial due to only a single animal study comparing SFOAE-based, behavioral, and cochlear frequency tuning in the same species. The budgerigar ( Melopsittacus undulatus ) is a parakeet species with human-like behavioral sensitivity to many sounds and the capacity to mimic speech. Intriguingly, previous studies of critical bands, psychophysical tuning curves, and critical ratios in budgerigars show that behavioral tuning sharpness increases dramatically with increasing frequency from 1 to 3.5 kHz, doubling once per octave with peak tuning sharpness from 3.5 to 4 kHz. The pattern contrasts with slower monotonic growth of behavioral tuning sharpness with increasing frequency in other animals, including most avian species, suggesting a possible auditory specialization in budgerigars. We measured SFOAE-based and cochlear-afferent tuning in budgerigars, for comparison to previously reported behavioral results. SFOAE-based and cochlear-afferent tuning sharpness both increased monotonically and relatively slowly for higher frequencies, in contrast to the behavioral pattern. SFOAE-based tuning in budgerigars accurately predicted cochlear frequency tuning, and both measures aligned with typical patterns of cochlear tuning in other species. Divergent behavioral tuning in budgerigars is unlikely attributable to the periphery and could reflect specializations for central processing of masked signals. Our findings highlight the value of SFOAEs for estimating cochlear tuning and caution against direct inference of peripheral tuning from behavioral critical bands, psychophysical tuning curves, and critical ratios.

Introduction Perceived loudness is challenging to study in non-human animals. However, reaction time to an acoustic stimulus is a useful behavioral proxy for the assessment of perceived loudness. Understanding the effect of sound frequency and level on perceived loudness would improve prediction and modeling of anthropogenic noise impacts on marine mammals. Methods In this study, behavioral hearing tests conducted with two killer whales were analyzed to capture conditioned vocal response latency, which is the time between the onset of the acoustic signal and the onset of the response (i.e., reaction time). Results The results showed that vocal reaction times decreased with increasing sensation level (i.e., sound pressure level above the baseline hearing threshold), while the effect of frequency on reaction time varied between the subjects. Reaction time as a function of sound duration is described, and equal-latency contours are presented. Discussion The data suggest that vocal reaction time decreases with increasing sensation level, therefore supporting the use of reaction time as a proxy for loudness perception in killer whales.

Binaural speech intelligibility in rooms is a complex process that is affected by many factors including room acoustics, hearing loss, and hearing aid (HA) signal processing. Intelligibility is evaluated in this paper for a simulated room combined with a simulated hearing aid. The test conditions comprise three spatial configurations of the speech and noise sources, simulated anechoic and concert hall acoustics, three amounts of multitalker babble interference, the hearing status of the listeners, and three degrees of simulated HA processing provided to compensate for the noise and/or hearing loss. The impact of these factors and their interactions is considered for normal-hearing (NH) and hearing-impaired (HI) listeners for sentence stimuli. Both listener groups showed a significant reduction in intelligibility as the signal-to-noise ratio (SNR) decreased, and showed a reduction in intelligibility in reverberation when compared to anechoic listening. There was no significant improvement in intelligibility for the NH group for the noise suppression algorithm used here, and no significant improvement in intelligibility for the HI group for more advanced HA processing algorithms as opposed to linear amplification in either of the two acoustic spaces or at any of the three SNRs.

Speech intelligibility declines with age and sensorineural hearing damage (SNHL). However, it remains unclear whether cochlear synaptopathy (CS), a recently discovered form of SNHL, significantly contributes to this issue. CS refers to damaged auditory-nerve synapses that innervate the inner hair cells and there is currently no go-to diagnostic test available. Furthermore, age-related hearing damage can comprise various aspects (e.g., hair cell damage, CS) that each can play a role in impaired sound perception. To explore the link between cochlear damage and speech intelligibility deficits, this study examines the role of CS for word recognition among older listeners. We first validated an envelope-following response (EFR) marker for CS using a Budgerigar model. We then applied this marker in human experiments, while restricting the speech material’s frequency content to ensure that both the EFR and the behavioral tasks engaged similar cochlear frequency regions. Following this approach, we identified the relative contribution of hearing sensitivity and CS to speech intelligibility in two age-matched (65-year-old) groups with clinically normal ( n = 15, 8 females) or impaired audiograms ( n = 13, 8 females). Compared to a young normal-hearing control group ( n = 13, 7 females), the older groups demonstrated lower EFR responses and impaired speech reception thresholds. We conclude that age-related CS reduces supra-threshold temporal envelope coding with subsequent speech coding deficits in noise that cannot be explained based on hearing sensitivity alone.

Two adaptations of the Single-Interval Adjust-Matrix Yes-No (SIAM-YN) task, designed to increase the efficiency of absolute threshold estimation, are described. The first, the SIAM Twin Track (SIAM-TT) task, consists of two interleaved tracks of the standard SIAM-YN that are run in the same trial with a single response. The second new task modifies the binary SIAM-YN task by using a six-point rating-scale (SIAM-Rating). In Experiment 1, data from three tasks estimating absolute thresholds were obtained using a 10-ms tone, the 2-IFC up-down procedure, SIAM-YN task, and the SIAM-TT task. The data support the use of the SIAM-TT as an alternative to the conventional two-interval and one-interval (SIAM-YN) tasks when used to estimate absolute thresholds. By presenting two interleaved SIAM-YN tracks on a single experimental trial, the SIAM-TT task possesses greater efficiency alongside its signal-detection tradition which confers less response bias. Similarly, in Experiment 2, which compared the 2-IFC adaptive, SIAM-YN, and SIAM-Rating tasks, there was no main effect of task upon threshold estimates. The findings replicate previous studies supporting the validity and efficiency of the SIAM-YN task, and extends the SIAM-YN toolbox to efficiently facilitate the generation of psychometric functions (the SIAM-TT task) and Receiver Operating Characteristic Curves (the SIAM-Rating task).

Salicylate is commonly used to induce tinnitus in animals, but its underlying mechanism of action is still debated. We therefore tested its effects on the firing properties of neurons in the mouse inferior colliculus (IC). Salicylate induced a large decrease in the spontaneous activity and an increase of ∼20 dB SPL in the minimum threshold of single units. In response to sinusoidally modulated noise (SAM noise) single units showed both an increase in phase locking and improved rate coding. Mice also became better at detecting amplitude modulations, and a simple threshold model based on the IC population response could reproduce this improvement. The responses to dynamic random chords (DRCs) suggested that the improved AM encoding was due to a linearization of the cochlear output, resulting in larger contrasts during SAM noise. These effects of salicylate are not consistent with the presence of tinnitus, but should be taken into account when studying hyperacusis.

Introduction Musical roundness perception relies on consonance/dissonance within a rule-based harmonic context, but also on individual characteristics of the listener. The present work tackles these aspects in a combined psychoacoustic and neurophysiological study, taking into account participant’s musical aptitude. Methods Our paradigm employed cadence-like four-chord progressions, based on Western music theory. Chord progressions comprised naturalistic and artificial sounds; moreover, their single chords varied regarding consonance/dissonance and harmonic function. Thirty participants listened to the chord progressions while their cortical activity was measured with magnetoencephalography; afterwards, they rated the individual chord progressions with respect to their perceived roundness. Results Roundness ratings differed according to the degree of dissonance in the dominant chord at the progression’s third position; this effect was pronounced in listeners with high musical aptitude. Interestingly, a corresponding pattern occurred in the neuromagnetic N1m response to the fourth chord (i.e., at the progression’s resolution), again with somewhat stronger differentiation among musical listeners. The N1m magnitude seemed to increase during chord progressions that were considered particularly round, with the maximum difference after the final chord; here, however, the musical aptitude effect just missed significance. Discussion The roundness of chord progressions is reflected in participant’s psychoacoustic ratings and in their transient cortical activity, with stronger differentiation among listeners with high musical aptitude. The concept of roundness might help to reframe consonance/dissonance to a more holistic, gestalt-like understanding that covers chord relations in Western music.

Background Behavior consists of the interaction between an organism and its environment, and is controlled by the brain. Brain activity varies at sub-second time scales, but behavioral measures are usually coarse (often consisting of only binary trial outcomes). Results To overcome this mismatch, we developed the Rat Interactive Foraging Facility (RIFF): a programmable interactive arena for freely moving rats with multiple feeding areas, multiple sound sources, high-resolution behavioral tracking, and simultaneous electrophysiological recordings. The paper provides detailed information about the construction of the RIFF and the software used to control it. To illustrate the flexibility of the RIFF, we describe two complex tasks implemented in the RIFF, a foraging task and a sound localization task. Rats quickly learned to obtain rewards in both tasks. Neurons in the auditory cortex as well as neurons in the auditory field in the posterior insula had sound-driven activity during behavior. Remarkably, neurons in both structures also showed sensitivity to non-auditory parameters such as location in the arena and head-to-body angle. Conclusions The RIFF provides insights into the cognitive capabilities and learning mechanisms of rats and opens the way to a better understanding of how brains control behavior. The ability to do so depends crucially on the combination of wireless electrophysiology and detailed behavioral documentation available in the RIFF.

How humans and animals segregate sensory information into discrete, behaviorally meaningful categories is one of the hallmark questions in neuroscience. Much of the research around this topic in the auditory system has centered around human speech perception, in which categorical processes result in an enhanced sensitivity for acoustically meaningful differences and a reduced sensitivity for nonmeaningful distinctions. Much less is known about whether nonhuman primates process their species-specific vocalizations in a similar manner. We address this question in the common marmoset, a small arboreal New World primate with a rich vocal repertoire produced across a range of behavioral contexts. We first show that marmosets perceptually categorize their vocalizations in ways that correspond to previously defined call types for this species. Next, we show that marmosets are differentially sensitive to changes in particular acoustic features of their most common call types and that these sensitivity differences are matched to the population statistics of their vocalizations in ways that likely maximize category formation. Finally, we show that marmosets are less sensitive to changes in these acoustic features when within the natural range of variability of their calls, which possibly reflects perceptual specializations which maintain existing call categories. These findings suggest specializations for categorical vocal perception in a New World primate species and pave the way for future studies examining their underlying neural mechanisms.

Brainstem degeneration is a prominent feature of spinocerebellar ataxia type 3 (SCA3), involving structures that execute binaural synchronization with microsecond precision. As a consequence, auditory processing may deteriorate during the course of disease. We tested whether the binaural “Huggins pitch” effect is suitable to study the temporal precision of brainstem functioning in SCA3 mutation carriers. We expected that they would have difficulties perceiving Huggins pitch at high frequencies, and that they would show attenuated neuromagnetic responses to Huggins pitch. The upper limit of Huggins pitch perception was psychoacoustically determined in 18 pre-ataxic and ataxic SCA3 mutation carriers and in 18 age-matched healthy controls. Moreover, the cortical N100 response following Huggins pitch onset was acquired by means of magnetoencephalography (MEG). MEG recordings were analyzed using dipole source modeling and comprised a monaural pitch condition and a no-pitch condition with simple binaural correlation changes. Compared with age-matched controls, ataxic but not pre-ataxic SCA3 mutation carriers had significantly lower frequency limits up to which Huggins pitch could be heard. Listeners with lower frequency limits also showed diminished MEG responses to Huggins pitch, but not in the two control conditions. Huggins pitch is a promising tool to assess brainstem functioning in ataxic SCA3 patients. Future studies should refine the psychophysiological setup to capture possible performance decrements also in pre-ataxic mutation carriers. Longitudinal observations will be needed to prove the potential of the assessment of Huggins pitch as a biomarker to track brainstem functioning during the disease course in SCA3.

The common marmoset ( Callithrix jacchus ) is a small arboreal New World primate which has emerged as a promising model in auditory neuroscience. One potentially useful application of this model system is in the study of the neural mechanism underlying spatial hearing in primate species, as the marmoset’s visually occluded natural habitat in the forest would make sound localization an essential behavior for survival. However, interpretation of neurophysiological data on sound localization requires an understanding of perceptual abilities, and the sound localization behavior of marmosets has not been well studied. The present experiment measured sound localization acuity using an operant conditioning procedure in which marmosets were trained to discriminate changes in sound location in the horizontal (azimuth) or vertical (elevation) dimension. Our results showed that the minimum audible angle (MAA) for horizontal discrimination was on average 15° for band-passed Gaussian noise and 13° for Random Spectral Shape (RSS) stimuli, whereas the MAA for vertical locations was at 17° and 22° for band-passed Gaussian noises containing more and less high frequency energy, respectively.