Psychoacoustics publications

The purpose of this study is to take preliminary steps to unify psychoacoustic techniques with reaction-time methodologies to address the perceptual mechanisms responsible for the detection of one vs. multiple sounds. We measured auditory redundancy gains for auditory detection of pure tones widely spaced in frequency using the tools of Systems Factorial Technology to evince the system architecture and workload capacity in two different scenarios (SOFT and LOUD). We adopted an experimental design in which the presence or absence of a target at each of two frequencies was combined factorially with two stimulus levels. Replicating previous work, results did not allow an assessment of system architecture due to a failure to observe factor influence at the level of distribution ordering for dual-target stimuli for both SOFT and LOUD scenarios. All subjects demonstrated very modest redundancy gains for the dual-target compared to the single-target stimuli, and results were similar for both LOUD and SOFT. We propose that these results can be predicted by a mental architecture that falls into the class of integrated subadditive parallel systems, using a well-supported assumption that reaction time is driven by loudness. We demonstrate that modeled loudness of the experimental sounds (which ranged between about 0.2 and 14 sones) is highly correlated with mean reaction time ( r = −0.87), and we provide a proof-of-concept model based on Steven’s Power law that predicts both a failure of distributional ordering for dual-target stimuli and very modest redundancy gains.

The cochlea decomposes sounds into separate frequency channels, from which the auditory brain must reconstruct the auditory scene. To do this the auditory system must make decisions about which frequency information should be grouped together, and which should remain distinct. Two key cues for grouping are temporal coherence, resulting from coherent changes in power across frequency, and temporal predictability, resulting from regular or predictable changes over time. To test how these cues contribute to the construction of a sound scene we present listeners with a range of precursor sounds, which act to prime the auditory system by providing information about each sounds structure, followed by a fixed masker in which participants were required to detect the presence of an embedded tone. By manipulating temporal coherence and/or temporal predictability in the precursor we assess how prior sound exposure influences subsequent auditory grouping. In Experiment 1, we measure the contribution of temporal predictability by presenting temporally regular or jittered precursors, and temporal coherence by using either narrow or broadband sounds, demonstrating that both independently contribute to masking/unmasking. In Experiment 2, we measure the relative impact of temporal coherence and temporal predictability and ask whether the influence of each in the precursor signifies an enhancement or interference of unmasking. We observed that interfering precursors produced the largest changes to thresholds.

Low-frequency interaural time differences and high-frequency interaural level differences (ILDs) are used to localize sounds in the horizontal plane. Older listeners appear to be worse at horizontal-plane sound localization to compared younger listeners, but little is understood about age-related changes to across-frequency binaural processing. This study investigated if the frequency dependence of across-frequency ILD processing is altered for older compared to younger listeners, which was done by using an across-frequency binaural interference task (when the interaural difference sensitivity for a target sound is decreased by a spectrally remote interfering sound with zero interaural differences). It was hypothesized that as listeners experience advancing age and age-related high-frequency hearing loss (i.e., presbycusis), they will demonstrate worse binaural performance and experience more across-channel binaural interference (because of age-related temporal processing deficits), and will increasingly be affected by interferers at lower frequencies (because of age-related hearing loss) when compared to younger listeners. There were 11 older (>65 yrs) and 20 younger (<30 yrs) listeners with normal to near-normal audiometric thresholds up to 2 kHz. They were tested using a left-right ILD lateralization discrimination task. Single-tone ILD discrimination thresholds and across-frequency binaural interference were measured at 0.5, 1, 2, 4, and 8 kHz. ILD thresholds and interference were about twice as large for older compared to younger listeners. Interferers ≤1 kHz produced 2–3 times as much across-frequency binaural interference for older compared to younger listeners. Hearing thresholds were significant predictors of single-tone ILD thresholds; in addition, both target and interferer hearing thresholds were significant predictors of binaural interference. The results suggest a reweighting of binaural information that occurs with advancing age and age-related high-frequency hearing loss. This evidence of plasticity may help explain some of the age-related changes in spatial-hearing abilities.

Categorizing sounds into meaningful groups helps listeners more efficiently process the auditory scene and is a foundational skill for speech perception and language development. Yet, how auditory categories develop in the brain through learning, particularly for non-speech sounds (e.g., music), is not well understood. Here, we asked musically naïve listeners to complete a brief (∼20 min) training session where they learned to identify sounds from a musical interval continuum (minor-major 3rds). We used multichannel EEG to track behaviorally relevant neuroplastic changes in the auditory event-related potentials (ERPs) pre- to post-training. To rule out mere exposure-induced changes, neural effects were evaluated against a control group of 14 non-musicians who did not undergo training. We also compared individual categorization performance with structural volumetrics of bilateral Heschl’s gyrus (HG) from MRI to evaluate neuroanatomical substrates of learning. Behavioral performance revealed steeper (i.e., more categorical) identification functions in the posttest that correlated with better training accuracy. At the neural level, improvement in learners’ behavioral identification was characterized by smaller P2 amplitudes at posttest, particularly over right hemisphere. Critically, learning-related changes in the ERPs were not observed in control listeners, ruling out mere exposure effects. Learners also showed smaller and thinner HG bilaterally, indicating superior categorization was associated with structural differences in primary auditory brain regions. Collectively, our data suggest successful auditory categorical learning of music sounds is characterized by short-term functional changes (i.e., greater post-training efficiency) in sensory coding processes superimposed on preexisting structural differences in bilateral auditory cortex.

Aging leads to degeneration of the peripheral and central auditory systems, hearing loss, and difficulty understanding sounds in noise. Aging is also associated with changes in susceptibility to or recovery from damaging noise exposures, although the effects of the interaction between acute noise exposure and age on the perception of sounds are not well studied. We tested these effects in the CBA/CaJ mouse model of age-related hearing loss using operant conditioning procedures before and after noise exposure and longitudinally measured changes in their sensitivity for detecting tones in quiet or noise backgrounds. Cochleae from a subset of the behaviorally tested mice were immunolabeled to examine organ of Corti damage relative to what is expected based on aging alone. Mice tested in both quiet and noise background conditions experienced worse behavioral sensitivity immediately after noise exposure, but mice exposed at older ages generally showed greater threshold shifts and reduced recovery over time. Surprisingly, day-to-day stability in thresholds was markedly higher for mice detecting signals in the presence of a noise masker compared with detection in quiet conditions. Cochlear analysis revealed decreases in the total number of outer hair cells (OHCs) and the number of ribbons per inner cell in high-frequency regions in aged, noise-exposed mice relative to aging alone. Our findings build on previous work showing interactions between age and noise exposure and add that background noise can increase the stability of behavioral hearing sensitivity after noise damage.

Surrounding context influences speech listening, resulting in dynamic shifts to category percepts. To examine its neural basis, event-related potentials (ERPs) were recorded during vowel identification with continua presented in random, forward, and backward orders to induce perceptual warping. Behaviorally, sequential order shifted individual listeners’ categorical boundary, versus random delivery, revealing perceptual warping (biasing) of the heard phonetic category dependent on recent stimulus history. ERPs revealed later (∼300 ms) activity localized to superior temporal and middle/inferior frontal gyri that predicted listeners’ hysteresis/enhanced contrast magnitudes. Findings demonstrate that interactions between frontotemporal brain regions govern top-down, stimulus history effects on speech categorization.

It is a well-demonstrated phenomenon that listeners can discriminate native phonetic contrasts better than nonnative ones. Recent neuroimaging studies have started to reveal the underlying neural mechanisms. By focusing on the mismatch negativity/response (MMN/R), a widely studied index of neural sensitivity to sound change, researchers have observed larger MMNs for native contrasts than for nonnative ones in EEG, but also a more focused and efficient neural activation pattern for native contrasts in MEG. However, direct relations between behavioral discrimination and MMN/R are rarely reported. In the current study, 15 native English speakers and 15 native Spanish speakers completed both a behavioral discrimination task and a separate MEG recording to measure MMR to a VOT-based speech contrast (i.e., pre-voiced vs. voiced stop consonant), which represents a phonetic contrast native to Spanish speakers but is nonnative to English speakers. At the group level, English speakers exhibited significantly lower behavioral sensitivity (d’) to the contrast but a more expansive MMR, replicating previous studies. Across individuals, a significant relation between behavioral sensitivity and the MMR was only observed in the Spanish group. Potential differences in the mechanisms underlying behavioral discrimination for the two groups are discussed.

The ability to determine a sound’s location is critical in everyday life. However, sound source localization is severely compromised for patients with hearing loss who receive bilateral cochlear implants (BiCIs). Several patient factors relate to poorer performance in listeners with BiCIs, associated with auditory deprivation, experience, and age. Critically, characteristic errors are made by patients with BiCIs (e.g., medial responses at lateral target locations), and the relationship between patient factors and the type of errors made by patients has seldom been investigated across individuals. In the present study, several different types of analysis were used to understand localization errors and their relationship with patient-dependent factors (selected based on their robustness of prediction). Binaural hearing experience is required for developing accurate localization skills, auditory deprivation is associated with degradation of the auditory periphery, and aging leads to poorer temporal resolution. Therefore, it was hypothesized that earlier onsets of deafness would be associated with poorer localization acuity and longer periods without BiCI stimulation or older age would lead to greater amounts of variability in localization responses. A novel machine learning approach was introduced to characterize the types of errors made by listeners with BiCIs, making them simple to interpret and generalizable to everyday experience. Sound localization performance was measured in 48 listeners with BiCIs using pink noise trains presented in free-field. Our results suggest that older age at testing and earlier onset of deafness are associated with greater average error, particularly for sound sources near the center of the head, consistent with previous research. The machine learning analysis revealed that variability of localization responses tended to be greater for individuals with earlier compared to later onsets of deafness. These results suggest that early bilateral hearing is essential for best sound source localization outcomes in listeners with BiCIs.

A previous investigation demonstrated differences between younger adult normal-hearing listeners and older adult hearing-impaired listeners in the perceived emotion of clear and conversational speech. Specifically, clear speech sounded angry more often than conversational speech for both groups, but the effect was smaller for the older listeners. These listener groups differed by two confounding factors, age (younger vs. older adults) and hearing status (normal vs. impaired). The objective of the present study was to evaluate the contributions of aging and hearing loss to the reduced perception of anger in older adults with hearing loss. We investigated perceived anger in clear and conversational speech in younger adults with and without a simulated age-related hearing loss, and in older adults with normal hearing. Younger adults with simulated hearing loss performed similarly to normal-hearing peers, while normal-hearing older adults performed similarly to hearing-impaired peers, suggesting that aging was the primary contributor to the decreased anger perception seen in previous work. These findings confirm reduced anger perception for older adults compared to younger adults, though the significant speaking style effect—regardless of age and hearing status—highlights the need to identify methods of producing clear speech that is emotionally neutral or positive.

We tested whether sensitivity to acoustic spectrotemporal modulations can be observed from reaction times for normal-hearing and impaired-hearing conditions. In a manual reaction-time task, normal-hearing listeners had to detect the onset of a ripple (with density between 0–8 cycles/octave and a fixed modulation depth of 50%), that moved up or down the log-frequency axis at constant velocity (between 0–64 Hz), in an otherwise-unmodulated broadband white-noise. Spectral and temporal modulations elicited band-pass filtered sensitivity characteristics, with fastest detection rates around 1 cycle/oct and 32 Hz for normal-hearing conditions. These results closely resemble data from other studies that typically used the modulation-depth threshold as a sensitivity criterion. To simulate hearing-impairment, stimuli were processed with a 6-channel cochlear-implant vocoder, and a hearing-aid simulation that introduced separate spectral smearing and low-pass filtering. Reaction times were always much slower compared to normal hearing, especially for the highest spectral densities. Binaural performance was predicted well by the benchmark race model of binaural independence, which models statistical facilitation of independent monaural channels. For the impaired-hearing simulations this implied a “best-of-both-worlds” principle in which the listeners relied on the hearing-aid ear to detect spectral modulations, and on the cochlear-implant ear for temporal-modulation detection. Although singular-value decomposition indicated that the joint spectrotemporal sensitivity matrix could be largely reconstructed from independent temporal and spectral sensitivity functions, in line with time-spectrum separability, a substantial inseparable spectral-temporal interaction was present in all hearing conditions. These results suggest that the reaction-time task yields a valid and effective objective measure of acoustic spectrotemporal-modulation sensitivity.

A bstract Sound localization and identification are challenging in acoustically rich environments. The relation between these two processes is still poorly understood. As natural sound-sources rarely occur exactly simultaneously, we wondered whether the auditory system could identify (“what”) and localize (“where”) two spatially separated sounds with synchronous onsets. While listeners typically report hearing a single source at an average location, one study found that both sounds may be accurately localized if listeners are explicitly being told two sources exist. We here tested whether simultaneous source identification (one vs. two) and localization is possible, by letting listeners choose to make either one or two head-orienting saccades to the perceived location(s). Results show that listeners could identify two sounds only when presented on different sides of the head, and that identification accuracy increased with their spatial separation. Notably, listeners were unable to accurately localize either sound, irrespective of whether one or two sounds were identified. Instead, the first (or only) response always landed near the average location, while second responses were unrelated to the targets. We conclude that localization of synchronous sounds in the absence of prior information is impossible. We discuss that the putative cortical ‘what’ pathway may not transmit relevant information to the ‘where’ pathway. We examine how a broadband interaural correlation cue could help to correctly identify the presence of two sounds without being able to localize them. We propose that the persistent averaging behavior reveals that the ‘where’ system intrinsically assumes that synchronous sounds originate from a single source. S ignificance S tatement It is poorly understood whether identification (‘what’) of sounds and their localization (‘where’) are inter-related, or independent neural processes. We measured sound-localization responses towards synchronous sounds to examine potential coupling of these processes. We varied the spatial configurations of two sounds and found that although identification improved considerably with larger spatial separation, their localization was unaffected: responses were always directed towards the average location. This shows absence of mutual coupling of information between the ‘what’ and ‘where’ streams in the auditory system. We also show how broadband interaural correlation could explain the improved identification results, without affecting localization performance, and explain how the persistent spatial averaging could be understood from strong internal priors regarding sound synchronicity.

Many hearing difficulties can be explained as a loss of audibility, a problem easily detected and treated using standard audiological procedures. Yet, hearing can be much poorer (or more impaired) than audibility predicts because of deficits in the suprathreshold mechanisms that encode the rapidly changing, spectral, temporal, and binaural aspects of the sound. The ability to evaluate these mechanisms requires well-defined stimuli and strict adherence to rigorous psychometric principles. This project reports on the comparison between a laboratory-based and a mobile system’s results for psychoacoustic assessment in adult listeners with normal hearing. A description of both systems employed is provided. Psychoacoustic tests include frequency discrimination, amplitude modulation detection, binaural encoding, and temporal gap detection. Results reported by the mobile system were not significantly different from those collected with the laboratory-based system for most of the tests and were consistent with those reported in the literature. The mobile system has the potential to be a feasible option for the assessment of suprathreshold auditory encoding abilities.

Humans are sensitive to interaural time differences (ITDs) conveyed by slow modulations on high-frequency carrier signals. Sensitivity appears to be affected by temporal envelope sharpness, but it is unclear if there is a limit to which sharpness affects sensitivity. Pulse trains were varied in relative bandwidth (re: critical bandwidths) and center frequency. ITD sensitivity increased with increasing bandwidth. There was no effect of center frequency when relative bandwidths were analyzed, suggesting that the temporal envelope sharpness (concomitantly absolute bandwidth in Hz) did not affect performance. Rather, sensitivity was most easily explained by recruitment of additional auditory channels.

Spatial hearing is crucial in real life but deteriorates in participants with severe sensorineural hearing loss or single-sided deafness. This ability can potentially be improved with a unilateral cochlear implant (CI). The present study investigated measures of sound localization in participants with single-sided deafness provided with a CI. Sound localization was measured separately at eight loudspeaker positions (4°, 30°, 60°, and 90°) on the CI side and on the normal-hearing side. Low- and high-frequency noise bursts were used in the tests to investigate possible differences in the processing of interaural time and level differences. Data were compared to normal-hearing adults aged between 20 and 83. In addition, the benefit of the CI in speech understanding in noise was compared to the localization ability. Fifteen out of 18 participants were able to localize signals on the CI side and on the normal-hearing side, although performance was highly variable across participants. Three participants always pointed to the normal-hearing side, irrespective of the location of the signal. The comparison with control data showed that participants had particular difficulties localizing sounds at frontal locations and on the CI side. In contrast to most previous results, participants were able to localize low-frequency signals, although they localized high-frequency signals more accurately. Speech understanding in noise was better with the CI compared to testing without CI, but only at a position where the CI also improved sound localization. Our data suggest that a CI can, to a large extent, restore localization in participants with single-sided deafness. Difficulties may remain at frontal locations and on the CI side. However, speech understanding in noise improves when wearing the CI. The treatment with a CI in these participants might provide real-world benefits, such as improved orientation in traffic and speech understanding in difficult listening situations.

It is generally assumed that listeners with normal audiograms have relatively symmetric hearing, and more specifically that diotic stimuli (having zero interaural differences) are heard as centered in the head. While measuring intracranial lateralization with a visual pointing task for tones and 50-Hz-wide narrowband noises from 300 to 700 Hz, examples of systematic and large (>50% from midline to the ear) lateralization biases were found. In a group of ten listeners, five showed consistent lateralization bias to the right or left side at all or a subset of frequencies. Asymmetries in hearing, not apparent in audiometric thresholds, may explain these lateralization biases.

Although moving sound-sources abound in natural auditory scenes, it is not clear how the human brain processes auditory motion. Previous studies have indicated that, although ocular localization responses to stationary sounds are quite accurate, ocular smooth pursuit of moving sounds is very poor. We here demonstrate that human subjects faithfully track a sound’s unpredictable movements in the horizontal plane with smooth-pursuit responses of the head. Our analysis revealed that the stimulus–response relation was well described by an under-damped passive, second-order low-pass filter in series with an idiosyncratic, fixed, pure delay. The model contained only two free parameters: the system’s damping coefficient, and its central (resonance) frequency. We found that the latter remained constant at ∼0.6 Hz throughout the experiment for all subjects. Interestingly, the damping coefficient systematically increased with trial number, suggesting the presence of an adaptive mechanism in the auditory pursuit system (APS). This mechanism functions even for unpredictable sound-motion trajectories endowed with fixed, but covert, frequency characteristics in open-loop tracking conditions. We conjecture that the APS optimizes a trade-off between response speed and effort. Taken together, our data support the existence of a pursuit system for auditory head-tracking, which would suggest the presence of a neural representation of a spatial auditory fovea (AF).

Throughout life, sensory systems adapt to the sensory environment to provide optimal responses to relevant tasks. In the case of a developing system, sensory inputs induce changes that are permanent and detectable up to adulthood. Previously, we have shown that rearing rat pups in a complex acoustic environment (spectrally and temporally modulated sound) from postnatal day 14 (P14) to P28 permanently improves the response characteristics of neurons in the inferior colliculus and auditory cortex, influencing tonotopical arrangement, response thresholds and strength, and frequency selectivity, along with stochasticity and the reproducibility of neuronal spiking patterns. In this study, we used a set of behavioral tests based on a recording of the acoustic startle response (ASR) and its prepulse inhibition (PPI), with the aim to extend the evidence of the persistent beneficial effects of the developmental acoustical enrichment. The enriched animals were generally not more sensitive to startling sounds, and also, their PPI of ASR, induced by noise or pure tone pulses, was comparable to the controls. They did, however, exhibit a more pronounced PPI when the prepulse stimulus was represented either by a change in the frequency of a background tone or by a silent gap in background noise. The differences in the PPI of ASR between the enriched and control animals were significant at lower (55 dB SPL), but not at higher (65-75 dB SPL), intensities of background sound. Thus, rearing pups in the acoustically enriched environment led to an improvement of the frequency resolution and gap detection ability under more difficult testing conditions, i.e., with a worsened stimulus clarity. We confirmed, using behavioral tests, that an acoustically enriched environment during the critical period of development influences the frequency and temporal processing in the auditory system, and these changes persist until adulthood.

The ability to use temporal relationships between cross-modal cues facilitates perception and behavior. Previously we observed that temporally correlated changes in the size of a visual stimulus and the intensity in an auditory stimulus influenced the ability of listeners to perform an auditory selective attention task (Maddox, Atilgan, Bizley, & Lee, 2015). Participants detected timbral changes in a target sound while ignoring those in a simultaneously presented masker. When the visual stimulus was temporally coherent with the target sound, performance was significantly better than when the visual stimulus was temporally coherent with the masker, despite the visual stimulus conveying no task-relevant information. Here, we trained observers to detect audiovisual temporal coherence and asked whether this changed the way in which they were able to exploit visual information in the auditory selective attention task. We observed that after training, participants were able to benefit from temporal coherence between the visual stimulus and both the target and masker streams, relative to the condition in which the visual stimulus was coherent with neither sound. However, we did not observe such changes in a second group that were trained to discriminate modulation rate differences between temporally coherent audiovisual streams, although they did show an improvement in their overall performance. A control group did not change their performance between pretest and post-test and did not change how they exploited visual information. These results provide insights into how crossmodal experience may optimize multisensory integration.

Budgerigars ( Melopsittacus undulatus ) are small Australian parrots with a well-documented, learned vocal repertoire and a high degree of vocal production learning. These birds live in large, social flocks and they vocally interact with each other in a dynamic, reciprocal manner. We assume that budgerigars must process and integrate a wide variety of sensory stimuli when selecting appropriate vocal responses to conspecifics during vocal interactions, but the relative contributions of these different stimuli to that process are next to impossible to tease apart in a natural context. Here we show that budgerigars, under operant control, can learn to respond to specific stimuli with a specific vocal response. Budgerigars were trained to produce contact calls to a combination of auditory and visual cues. Birds learned to produce specific contact calls to stimuli that differed either in location (visual or auditory) or quality (visual). Interestingly, the birds could not learn to associate different vocal responses with different auditory stimuli coming from the same location. Surprisingly, this was so even when the auditory stimuli and the responses were the same (i.e., the bird’s own contact call). These results show that even in a highly controlled operant context, acoustic cues alone were not sufficient to support vocal production learning in budgerigars. From a different perspective, these results highlight the significant role that social interaction likely plays in vocal production learning so elegantly shown by Irene Pepperberg’s work in parrots.

A sequential dual-task design was used to assess the impacts of spoken sentence context and cognitive load on listening effort. Young adults with normal hearing listened to sentences masked by multitalker babble in which sentence-final words were either predictable or unpredictable. Each trial began with visual presentation of a short (low-load) or long (high-load) sequence of to-be-remembered digits. Words were identified more quickly and accurately in predictable than unpredictable sentence contexts. In addition, digits were recalled more quickly and accurately on trials on which the sentence was predictable, indicating reduced listening effort for predictable compared to unpredictable sentences. For word and digit recall response time but not for digit recall accuracy, the effect of predictability remained significant after exclusion of trials with incorrect word responses and was thus independent of speech intelligibility. In addition, under high cognitive load, words were identified more slowly and digits were recalled more slowly and less accurately than under low load. Participants’ working memory and vocabulary were not correlated with the sentence context benefit in either word recognition or digit recall. Results indicate that listening effort is reduced when sentences are predictable and that cognitive load affects the processing of spoken words in sentence contexts.