Psychoacoustics publications

Listening in an acoustically cluttered scene remains a difficult task for both machines and hearing-impaired listeners. Normal-hearing listeners accomplish this task with relative ease by segregating the scene into its constituent sound sources, then selecting and attending to a target source. An assistive listening device that mimics the biological mechanisms underlying this behavior may provide an effective solution for those with difficulty listening in acoustically cluttered environments (e.g., a cocktail party). Here, we present a binaural sound segregation algorithm based on a hierarchical network model of the auditory system. In the algorithm, binaural sound inputs first drive populations of neurons tuned to specific spatial locations and frequencies. The spiking response of neurons in the output layer are then reconstructed into audible waveforms via a novel reconstruction method. We evaluate the performance of the algorithm with a speech-on-speech intelligibility task in normal-hearing listeners. This two-microphone-input algorithm is shown to provide listeners with perceptual benefit similar to that of a 16-microphone acoustic beamformer. These results demonstrate the promise of this biologically inspired algorithm for enhancing selective listening in challenging multi-talker scenes.

Recent studies on loudness perception of binaural broadband signals in hearing impaired listeners found large individual differences, suggesting the use of such signals in hearing aid fitting. Likewise, clinical cochlear implant (CI) fitting with narrowband/single-electrode signals might cause suboptimal loudness perception in bilateral and bimodal CI listeners. Here spectral and binaural loudness summation in normal hearing (NH) listeners, bilateral CI (biCI) users, and unilateral CI (uCI) users with normal hearing in the unaided ear was investigated to assess the relevance of binaural/bilateral fitting in CI users. To compare the three groups, categorical loudness scaling was performed for an equal categorical loudness noise (ECLN) consisting of the sum of six spectrally separated third-octave noises at equal loudness. The acoustical ECLN procedure was adapted to an equivalent procedure in the electrical domain using direct stimulation. To ensure the same broadband loudness in binaural measurements with simultaneous electrical and acoustical stimulation, a modified binaural ECLN was introduced and cross validated with self-adjusted loudness in a loudness balancing experiment. Results showed a higher (spectral) loudness summation of the six equally loud narrowband signals in the ECLN in CI compared to NH. Binaural loudness summation was found for all three listener groups (NH, uCI, and biCI). No increased binaural loudness summation could be found for the current uCI and biCI listeners compared to the NH group. In uCI loudness balancing between narrowband signals and single electrodes did not automatically result in a balanced loudness perception across ears, emphasizing the importance of binaural/bilateral fitting.

Low-frequency interaural time differences and high-frequency interaural level differences (ILDs) are used to localize sounds in the horizontal plane. Older listeners appear to be worse at horizontal-plane sound localization to compared younger listeners, but little is understood about age-related changes to across-frequency binaural processing. This study investigated if the frequency dependence of across-frequency ILD processing is altered for older compared to younger listeners, which was done by using an across-frequency binaural interference task (when the interaural difference sensitivity for a target sound is decreased by a spectrally remote interfering sound with zero interaural differences). It was hypothesized that as listeners experience advancing age and age-related high-frequency hearing loss (i.e., presbycusis), they will demonstrate worse binaural performance and experience more across-channel binaural interference (because of age-related temporal processing deficits), and will increasingly be affected by interferers at lower frequencies (because of age-related hearing loss) when compared to younger listeners. There were 11 older (>65 yrs) and 20 younger (<30 yrs) listeners with normal to near-normal audiometric thresholds up to 2 kHz. They were tested using a left-right ILD lateralization discrimination task. Single-tone ILD discrimination thresholds and across-frequency binaural interference were measured at 0.5, 1, 2, 4, and 8 kHz. ILD thresholds and interference were about twice as large for older compared to younger listeners. Interferers ≤1 kHz produced 2–3 times as much across-frequency binaural interference for older compared to younger listeners. Hearing thresholds were significant predictors of single-tone ILD thresholds; in addition, both target and interferer hearing thresholds were significant predictors of binaural interference. The results suggest a reweighting of binaural information that occurs with advancing age and age-related high-frequency hearing loss. This evidence of plasticity may help explain some of the age-related changes in spatial-hearing abilities.

We describe a scalp-recorded measure of tonotopic selectivity, the “cortical onset response” (COR) and compare the results between humans and cats. The COR results, in turn, were compared with psychophysical masked-detection thresholds obtained using similar stimuli and obtained from both species. The COR consisted of averaged responses elicited by 50-ms tone-burst probes presented at 1-s intervals against a continuous noise masker. The noise masker had a bandwidth of 1 or 1/8th octave, geometrically centred on 4000 Hz for humans and on 8000 Hz for cats. The probe frequency was either − 0.5, − 0.25, 0, 0.25 or 0.5 octaves re the masker centre frequency. The COR was larger for probe frequencies more distant from the centre frequency of the masker, and this effect was greater for the 1/8th-octave than for the 1-octave masker. This pattern broadly reflected the masked excitation patterns obtained psychophysically with similar stimuli in both species. However, the positive signal-to-noise ratio used to obtain reliable COR measures meant that some aspects of the data differed from those obtained psychophysically, in a way that could be partly explained by the upward spread of the probe’s excitation pattern. Our psychophysical measurements also showed that the auditory filter width obtained at 8000 Hz using notched-noise maskers was slightly wider in cat than previous measures from humans. We argue that although conclusions from COR measures differ in some ways from conclusions based on psychophysics, the COR measures provide an objective, noninvasive, valid measure of tonotopic selectivity that does not require training and that may be applied to acoustic and cochlear-implant experiments in humans and laboratory animals.

The ability to determine a sound’s location is critical in everyday life. However, sound source localization is severely compromised for patients with hearing loss who receive bilateral cochlear implants (BiCIs). Several patient factors relate to poorer performance in listeners with BiCIs, associated with auditory deprivation, experience, and age. Critically, characteristic errors are made by patients with BiCIs (e.g., medial responses at lateral target locations), and the relationship between patient factors and the type of errors made by patients has seldom been investigated across individuals. In the present study, several different types of analysis were used to understand localization errors and their relationship with patient-dependent factors (selected based on their robustness of prediction). Binaural hearing experience is required for developing accurate localization skills, auditory deprivation is associated with degradation of the auditory periphery, and aging leads to poorer temporal resolution. Therefore, it was hypothesized that earlier onsets of deafness would be associated with poorer localization acuity and longer periods without BiCI stimulation or older age would lead to greater amounts of variability in localization responses. A novel machine learning approach was introduced to characterize the types of errors made by listeners with BiCIs, making them simple to interpret and generalizable to everyday experience. Sound localization performance was measured in 48 listeners with BiCIs using pink noise trains presented in free-field. Our results suggest that older age at testing and earlier onset of deafness are associated with greater average error, particularly for sound sources near the center of the head, consistent with previous research. The machine learning analysis revealed that variability of localization responses tended to be greater for individuals with earlier compared to later onsets of deafness. These results suggest that early bilateral hearing is essential for best sound source localization outcomes in listeners with BiCIs.

A previous investigation demonstrated differences between younger adult normal-hearing listeners and older adult hearing-impaired listeners in the perceived emotion of clear and conversational speech. Specifically, clear speech sounded angry more often than conversational speech for both groups, but the effect was smaller for the older listeners. These listener groups differed by two confounding factors, age (younger vs. older adults) and hearing status (normal vs. impaired). The objective of the present study was to evaluate the contributions of aging and hearing loss to the reduced perception of anger in older adults with hearing loss. We investigated perceived anger in clear and conversational speech in younger adults with and without a simulated age-related hearing loss, and in older adults with normal hearing. Younger adults with simulated hearing loss performed similarly to normal-hearing peers, while normal-hearing older adults performed similarly to hearing-impaired peers, suggesting that aging was the primary contributor to the decreased anger perception seen in previous work. These findings confirm reduced anger perception for older adults compared to younger adults, though the significant speaking style effect—regardless of age and hearing status—highlights the need to identify methods of producing clear speech that is emotionally neutral or positive.

Listening to speech in noisy environments is challenging and effortful. Factors like the signal-to-noise ratio (SNR), the spatial separation between target speech and noise interferer(s), and possibly also the listener's age might influence perceived listening effort (LE). This study measured and modeled the effect of the spatial separation of target speech and interfering stationary speech-shaped noise on the perceived LE and its relation to the age of the listeners. Reference ranges for the relationship between subjectively perceived LE and SNR for different noise azimuths were established. For this purpose, 70 listeners with normal hearing and from three age groups rated the perceived LE using the Adaptive Categorical Listening Effort Scaling method (ACALES, Krueger et al., 2017a) with speech from the front and noise from 0°, 90°, 135°, or 180° azimuth. Based on these data, the spatial release from listening effort (SRLE) was calculated. The noise azimuth had a strong effect on SRLE, with the highest release for 135°. The binaural speech intelligibility model (BSIM2020, Hauth et al., 2020) predicted SRLE very well at negative SNRs, but overestimated for positive SNRs. No significant effect of age was found on the respective subjective ratings. Therefore, the reference ranges were determined independently of age. These reference ranges can be used for the classification of LE measurements. However, when the increase of the perceived LE with SNR was analyzed, a significant age difference was found between the listeners of the youngest and oldest group when considering the upper range of the LE function.

Speech recognition in rooms requires the temporal integration of reflections which arrive with a certain delay after the direct sound. It is commonly assumed that there is a certain temporal window of about 50–100 ms, during which reflections can be integrated with the direct sound, while later reflections are detrimental to speech intelligibility. This concept was challenged in a recent study by employing binaural room impulse responses (RIRs) with systematically varied interaural phase differences (IPDs) and amplitude of the direct sound and a variable number of reflections delayed by up to 200 ms. When amplitude or IPD favored late RIR components, normal-hearing (NH) listeners appeared to be capable of focusing on these components rather than on the precedent direct sound, which contrasted with the common concept of considering early RIR components as useful and late components as detrimental. The present study investigated speech intelligibility in the same conditions in hearing-impaired (HI) listeners. The data indicate that HI listeners were generally less able to “ignore” the direct sound than NH listeners, when the most useful information was confined to late RIR components. Some HI listeners showed a remarkable inability to integrate across multiple reflections and to optimally “shift” their temporal integration window, which was quite dissimilar to NH listeners. This effect was most pronounced in conditions requiring spatial and temporal integration and could provide new challenges for individual prediction models of binaural speech intelligibility.

Humans are sensitive to interaural time differences (ITDs) conveyed by slow modulations on high-frequency carrier signals. Sensitivity appears to be affected by temporal envelope sharpness, but it is unclear if there is a limit to which sharpness affects sensitivity. Pulse trains were varied in relative bandwidth (re: critical bandwidths) and center frequency. ITD sensitivity increased with increasing bandwidth. There was no effect of center frequency when relative bandwidths were analyzed, suggesting that the temporal envelope sharpness (concomitantly absolute bandwidth in Hz) did not affect performance. Rather, sensitivity was most easily explained by recruitment of additional auditory channels.

Current clinical strategies to assess benefits from hearing aids (HAs) are based on self-reported questionnaires and speech-in-noise (SIN) tests; which require behavioural cooperation. Instead, objective measures based on Auditory Brainstem Responses (ABRs) to speech stimuli would not require the individuals’ cooperation. Here, we re-analysed an existing dataset to predict behavioural measures with speech-ABRs using regression trees. Ninety-two HA users completed a self-reported questionnaire (SSQ-Speech) and performed two aided SIN tests: sentences in noise (BKB-SIN) and vowel-consonant-vowels (VCV) in noise. Speech-ABRs were evoked by a 40 ms [da] and recorded in 2x2 conditions: aided vs. unaided and quiet vs. background noise. For each recording condition, two sets of features were extracted: 1) amplitudes and latencies of speech-ABR peaks, 2) amplitudes and latencies of speech-ABR F0 encoding. Two regression trees were fitted for each of the three behavioural measures with either feature set and age, digit-span forward and backward, and pure tone average (PTA) as possible predictors. The PTA was the only predictor in the SSQ-Speech trees. In the BKB-SIN trees, performance was predicted by the aided latency of peak F in quiet for participants with PTAs between 43 and 61 dB HL. In the VCV trees, performance was predicted by the aided F0 encoding latency and the aided amplitude of peak VA in quiet for participants with PTAs ≤ 47 dB HL. These findings indicate that PTA was more informative than any speech-ABR measure, as these were relevant only for a subset of the participants. Therefore, speech-ABRs evoked by a 40 ms [da] are not a clinical predictor of behavioural measures in HA users.

Speech-on-speech informational masking arises because the interferer disrupts target processing (e.g., capacity limitations) or corrupts it (e.g., intrusions into the target percept); the latter should produce predictable errors. Listeners identified the consonant in monaural buzz-excited three-formant analogues of approximant-vowel syllables, forming a place of articulation series (/w/-/l/-/j/). There were two 11-member series; the vowel was either high-front or low-back. Series members shared formant-amplitude contours, fundamental frequency, and F1+F3 frequency contours; they were distinguished solely by the F2 frequency contour before the steady portion. Targets were always presented in the left ear. For each series, F2 frequency and amplitude contours were also used to generate interferers with altered source properties—sine-wave analogues of F2 (sine bleats) matched to their buzz-excited counterparts. Accompanying each series member with a fixed mismatched sine bleat in the contralateral ear produced systematic and predictable effects on category judgments; these effects were usually largest for bleats involving the fastest rate or greatest extent of frequency change. Judgments of isolated sine bleats using the three place labels were often unsystematic or arbitrary. These results indicate that informational masking by interferers involved corruption of target processing as a result of mandatory dichotic integration of F2 information, despite the grouping cues disfavoring this integration.

It is generally assumed that listeners with normal audiograms have relatively symmetric hearing, and more specifically that diotic stimuli (having zero interaural differences) are heard as centered in the head. While measuring intracranial lateralization with a visual pointing task for tones and 50-Hz-wide narrowband noises from 300 to 700 Hz, examples of systematic and large (>50% from midline to the ear) lateralization biases were found. In a group of ten listeners, five showed consistent lateralization bias to the right or left side at all or a subset of frequencies. Asymmetries in hearing, not apparent in audiometric thresholds, may explain these lateralization biases.

Many older adults have difficulty understanding speech in noisy backgrounds. In this study, we examined peripheral auditory, higher-level auditory, and cognitive factors that may contribute to such difficulties. A convenience sample of 137 volunteer older adults, 90 women, and 47 men, ranging in age from 47 to 94 years ( M = 69.2 and SD = 10.1 years) completed a large battery of tests. Auditory tests included measures of pure-tone threshold, clinical and psychophysical, as well as two measures of gap-detection threshold and four measures of temporal-order identification. The latter included two monaural and two dichotic listening conditions. In addition, cognition was assessed using the complete Wechsler Adult Intelligence Scale-3rd Edition (WAIS-III). Two monaural measures of speech-recognition threshold (SRT) in noise, the QuickSIN, and the WIN, were obtained from each ear at relatively high presentation levels of 93 or 103 dB SPL to minimize audibility concerns. Group data, both aggregate and by age decade, were evaluated initially to allow comparison to data in the literature. Next, following the application of principal-components factor analysis for data reduction, individual differences in speech-recognition-in-noise performance were examined using multiple-linear-regression analyses. Excellent fits were obtained, accounting for 60–77% of the total variance, with most accounted for by the audibility of the speech and noise stimuli and the severity of hearing loss with the balance primarily associated with cognitive function.

Three experiments explored the effects of abrupt changes in stimulus properties on streaming dynamics. Listeners monitored 20-s-long low- and high-frequency (LHL–) tone sequences and reported the number of streams heard throughout. Experiments 1 and 2 used pure tones and examined the effects of changing triplet base frequency and level, respectively. Abrupt changes in base frequency (±3–12 semitones) caused significant magnitude-related falls in segregation (resetting), regardless of transition direction, but an asymmetry occurred for changes in level (±12 dB). Rising-level transitions usually decreased segregation significantly, whereas falling-level transitions had little or no effect. Experiment 3 used pure tones (unmodulated) and narrowly spaced (±25 Hz) tone pairs (dyads); the two evoke similar excitation patterns, but dyads are strongly modulated with a distinctive timbre. Dyad-only sequences induced a strongly segregated percept, limiting scope for further build-up. Alternation between groups of pure tones and dyads produced large, asymmetric changes in streaming. Dyad-to-pure transitions caused substantial resetting, but pure-to-dyad transitions sometimes elicited even greater segregation than for the corresponding interval in dyad-only sequences (overshoot). The results indicate that abrupt changes in timbre can strongly affect the likelihood of stream segregation without introducing significant peripheral-channeling cues. These asymmetric effects of transition direction are reminiscent of subtractive adaptation in vision.

Hallucinations and illusions are two instances of perceptual experiences illustrating how perception might diverge from external sensory stimulations and be generated or altered based on internal brain states. The occurrence of these phenomena is not constrained to patient populations. Similar experiences can be elicited in healthy subjects by means of suitable experimental procedures. Studying the neural mechanisms underlying these experiences not only has the potential to expand our understanding of the brain’s perceptual machinery but also of how it might get impaired. In the current study, we employed an auditory signal detection task to induce auditory illusions by presenting speech snippets at near detection threshold intensity embedded in noise. We investigated the neural correlates of auditory false perceptions by examining the EEG activity preceding the responses in speech absent (false alarm, FA) trials and comparing them to speech present (hit) trials. The results of the comparison of event-related potentials (ERPs) in the activation period vs. baseline revealed the presence of an early negativity (EN) and a late positivity (LP) similar in both hits and FAs, which were absent in misses, correct rejections (CR) and control button presses (BPs). We postulate that the EN and the LP might represent the auditory awareness negativity (AAN) and centro-parietal positivity (CPP) or P300, respectively. The event-related spectral perturbations (ERSPs) exhibited a common power enhancement in low frequencies (<4 Hz) in hits and FAs. The low-frequency power enhancement has been frequently shown to be accompanied with P300 as well as separately being a marker of perceptual awareness, referred to as slow cortical potentials (SCP). Furthermore, the comparison of hits vs. FAs showed a significantly higher LP amplitude and low frequency power in hits compared to FAs. Generally, the observed patterns in the present results resembled some of the major neural correlates associated with perceptual awareness in previous studies. Our findings provide evidence that the neural correlates associated with conscious perception, can be elicited in similar ways in both presence and absence of externally presented sensory stimuli. The present findings did not reveal any pre-stimulus alpha and beta modulations distinguishing conscious vs. unconscious perceptions.

Individual estimates of cochlear compression may provide complementary information to traditional audiometric hearing thresholds in disentangling different types of peripheral cochlear damage. Here we investigated the use of the slope of envelope following response (EFR) magnitude-level functions obtained from four simultaneously presented amplitude modulated tones with modulation frequencies of 80–100 Hz as a proxy of peripheral level compression. Compression estimates in individual normal hearing (NH) listeners were consistent with previously reported group-averaged compression estimates based on psychoacoustical and distortion-product oto-acoustic emission (DPOAE) measures in human listeners. They were also similar to basilar membrane (BM) compression values measured invasively in non-human mammals. EFR-based compression estimates in hearing-impaired listeners were less compressive than those for the NH listeners, consistent with a reduction of BM compression. Cochlear compression was also estimated using DPOAEs in the same NH listeners. DPOAE estimates were larger (less compressive) than EFRs estimates, showing no correlation. Despite the numerical concordance between EFR-based compression estimates and group-averaged estimates from other methods, simulations using an auditory nerve (AN) model revealed that compression estimates based on EFRs might be highly influenced by contributions from off-characteristic frequency (CF) neural populations. This compromises the possibility to estimate on-CF (i.e., frequency-specific or “local”) peripheral level compression with EFRs.

Purpose This article aimed to document longitudinal changes in auditory function, including measures of temporal processing, and to examine the associations between observed changes in auditory and cognitive function in middle-aged and older adults. Method This was a prospective longitudinal study of 98 adults (66 women) with baseline ages ranging from 40 to 85 years. The mean interval between T1 baseline and T2 follow-up measurements was 8.8 years with a range of 7–11 years. Measures of hearing threshold, gap detection, and auditory temporal-order identification were completed at T1 and T2. Cognitive measures completed at T1 and T2 were the 13 scales of the Wechsler Adult Intelligence Scale–Third Edition. Three approaches were taken to analyze these data: (a) examination of changes over time in group performance, (b) correlations and slopes between auditory and cognitive measures to examine concomitant rates of decline over the 9-year T1-to-T2 period, and (c) regression analyses examining associations between auditory performance at T1 and cognitive performance 9 years later at T2. Results For the group data, there were significant declines in hearing loss, gap-detection thresholds at one frequency, and process-type measures of cognitive function from T1 to T2 matching the trends in the baseline cross-sectional data. Regression analyses of the longitudinal data revealed the strongest connection between auditory temporal-order processing and cognitive processing typically explaining 10%–15% of the variance. Conclusions A significant amount of variance in rates of cognitive decline, T1 to T2, and subsequent cognitive performance (T2) was explained by measures of auditory function. Although hearing loss occasionally emerged as a significant factor, auditory temporal-order identification emerged much more frequently as the auditory measure most strongly associated with cognitive function.

A sequential dual-task design was used to assess the impacts of spoken sentence context and cognitive load on listening effort. Young adults with normal hearing listened to sentences masked by multitalker babble in which sentence-final words were either predictable or unpredictable. Each trial began with visual presentation of a short (low-load) or long (high-load) sequence of to-be-remembered digits. Words were identified more quickly and accurately in predictable than unpredictable sentence contexts. In addition, digits were recalled more quickly and accurately on trials on which the sentence was predictable, indicating reduced listening effort for predictable compared to unpredictable sentences. For word and digit recall response time but not for digit recall accuracy, the effect of predictability remained significant after exclusion of trials with incorrect word responses and was thus independent of speech intelligibility. In addition, under high cognitive load, words were identified more slowly and digits were recalled more slowly and less accurately than under low load. Participants’ working memory and vocabulary were not correlated with the sentence context benefit in either word recognition or digit recall. Results indicate that listening effort is reduced when sentences are predictable and that cognitive load affects the processing of spoken words in sentence contexts.

The sound-field auditory steady-state response (ASSR) is a promising measure for the objective validation of hearing-aid fitting in patients who are unable to respond to behavioral testing reliably. To record the sound-field ASSR, the stimulus is reproduced through a loudspeaker placed in front of the patient. However, the reverberation and background noise of the measurement room could reduce the stimulus modulation used for eliciting the ASSR. As the ASSR level is heavily dependent on the stimulus modulation, any reduction due to room acoustics could affect the clinical viability of sound-field ASSR testing. This study investigated the effect of room acoustics on the level and detection rate of sound-field ASSR. The study also analyzed whether early decay time and an auditory-inspired relative modulation power model could be used to predict the changes in the recorded ASSR in rooms. A monaural auralization approach was used to measure sound-field ASSR via insert earphones. ASSR was measured for 15 normal-hearing adult subjects using narrow-band CE-Chirps® centered at the octave bands of 500, 1000, 2000, and 4000 Hz. These stimuli were convolved with simulated impulse responses of three rooms inspired by audiological testing rooms. The results showed a significant reduction of the ASSR level for the room conditions compared with the reference anechoic condition. Despite this reduction, the detection rates for the first harmonics of the ASSR were unaffected when sufficiently long recordings (up to 6 min) were made. Furthermore, the early decay time and relative modulation power appear to be useful predictors of the ASSR level in the measurement rooms.

A vocoder is used to simulate cochlear-implant sound processing in normal-hearing listeners. Typically, there is rapid improvement in vocoded speech recognition, but it is unclear if the improvement rate differs across age groups and speech materials. Children (8–10 years) and young adults (18–26 years) were trained and tested over 2 days (4 hours) on recognition of eight-channel noise-vocoded words and sentences, in quiet and in the presence of multi-talker babble at signal-to-noise ratios of 0, +5, and +10 dB. Children achieved poorer performance than adults in all conditions, for both word and sentence recognition. With training, vocoded speech recognition improvement rates were not significantly different between children and adults, suggesting that improvement in learning how to process speech cues degraded via vocoding is absent of developmental differences across these age groups and types of speech materials. Furthermore, this result confirms that the acutely measured age difference in vocoded speech recognition persists after extended training.