Psychoacoustics publications

Amplitude modulation encoding is critical for human speech perception and complex sound processing in general. The modulation transfer function (MTF) is a staple of auditory psychophysics, and has been shown to predict speech intelligibility performance in a range of adverse listening conditions and hearing impairments, including cochlear implant-supported hearing. Although both tonal and broadband carriers have been used in psychophysical studies of modulation detection and discrimination, relatively little is known about differences in the cortical representation of such signals. We obtained MTFs in response to sinusoidal amplitude modulation (SAM) for both narrowband tonal carriers and two-octave bandwidth noise carriers in the auditory core of awake squirrel monkeys. MTFs spanning modulation frequencies from 4 to 512 Hz were obtained using 16 channel linear recording arrays sampling across all cortical laminae. Carrier frequency for tonal SAM and center frequency for noise SAM was set at the estimated BF for each penetration. Changes in carrier type affected both rate and temporal MTFs in many neurons. Using spike discrimination techniques, we found that discrimination of modulation frequency was significantly better for tonal SAM than for noise SAM, though the differences were modest at the population level. Moreover, spike trains elicited by tonal and noise SAM could be readily discriminated in most cases. Collectively, our results reveal remarkable sensitivity to the spectral content of modulated signals, and indicate substantial interdependence between temporal and spectral processing in neurons of the core auditory cortex.

Pitch is one of the most fundamental percepts in the auditory system and can be extracted using either spectral or temporal information in an acoustic signal. Although pitch perception has been extensively studied in human subjects, it is far less clear how nonhuman primates perceive pitch. We have addressed this question in a series of behavioral studies in which marmosets, a vocal nonhuman primate species, were trained to discriminate complex harmonic tones differing in either spectral (fundamental frequency [f 0 ]) or temporal envelope (repetition rate) cues. We found that marmosets used temporal envelope information to discriminate pitch for acoustic stimuli with higher-order harmonics and lower f 0 values and spectral information for acoustic stimuli with lower-order harmonics and higher f 0 values. We further measured frequency resolution in marmosets using a psychophysical task in which pure tone thresholds were measured as a function of notched noise masker bandwidth. Results show that only the first four harmonics are resolved at low f 0 values and up to 16 harmonics are resolved at higher f 0 values. Resolvability in marmosets is different from that in humans, where the first five to nine harmonics are consistently resolved across most f 0 values, and is likely the result of a smaller marmoset cochlea. In sum, these results show that marmosets use two mechanisms to extract pitch (harmonic templates [spectral] for resolved harmonics, and envelope extraction [temporal] for unresolved harmonics) and that species differences in stimulus resolvability need to be taken into account when investigating and comparing mechanisms of pitch perception across animals.

Listening to and understanding people in a "cocktail-party situation" is a remarkable feature of the human auditory system. Here we investigated the neural correlates of the ability to localize a particular sound among others in an acoustically cluttered environment with healthy subjects. In a sound localization task, five different natural sounds were presented from five virtual spatial locations during functional magnetic resonance imaging (fMRI). Activity related to auditory stream segregation was revealed in posterior superior temporal gyrus bilaterally, anterior insula, supplementary motor area, and frontoparietal network. Moreover, the results indicated critical roles of left planum temporale in extracting the sound of interest among acoustical distracters and the precuneus in orienting spatial attention to the target sound. We hypothesized that the left-sided lateralization of the planum temporale activation is related to the higher specialization of the left hemisphere for analysis of spectrotemporal sound features. Furthermore, the precuneus - a brain area known to be involved in the computation of spatial coordinates across diverse frames of reference for reaching to objects - seems to be also a crucial area for accurately determining locations of auditory targets in an acoustically complex scene of multiple sound sources. The precuneus thus may not only be involved in visuo-motor processes, but may also subserve related functions in the auditory modality.

This study tested the hypothesis that energetic masking limits the benefits obtained from spatial separation in multiple-talker listening situations, particularly for listeners with sensorineural hearing loss. A speech target was presented simultaneously with two or four speech maskers. The target was always presented diotically, and the maskers were either presented diotically or dichotically. In dichotic configurations, the maskers were symmetrically placed by introducing interaural time differences (ITDs) or infinitely large interaural level differences (ILDs; monaural presentation). Target-to-masker ratios for 50 % correct were estimated. Thresholds in all separated conditions were poorer in listeners with hearing loss than listeners with normal hearing. Moreover, for a given listener, thresholds were similar for conditions with the same number of talkers per ear (e.g., ILD with four talkers equivalent to ITD with two talkers) and hence the same energetic masking. The results are consistent with the idea that increased energetic masking, rather than a specific spatial deficit, may limit performance for hearing-impaired listeners in spatialized speech mixtures.

The present investigation assessed fusion and localization dominance aspects of the precedence effect under headphones across a variety of stimulus conditions in 10 normal-hearing listeners. Listeners were presented with “lead-lag” pairs of brief (123 μs) impulses or trains of such pairs lateralized by interaural time or level differences (ITD or ILD). Listeners used a touch-sensitive display to indicate for the final lead-lag pair presented on each trial (1) whether one or two locations were perceived and (2) the location perceived. In the event two locations were perceived, subjects were further instructed to indicate the left-most location perceived. Results demonstrated that lead-lag fusion was more robust for stimuli lateralized by ITD than ILD, particularly when cues of the test stimulus differed from cues of the preceding “buildup” stimulus, consistent with Krumbholz and Nobbe [(2002). J. Acoust. Soc. Am. 112, 654–663]. Unexpectedly, results also demonstrated reduced localization dominance with increasing lead-lag delay, suggesting that the fusion aspect of the precedence effect may be dissociated from the localization dominance aspect under buildup. It is thus argued that buildup of fusion might be understood more generally as an example of auditory object formation rather than a special facility for enhanced sound localization.

Differences in fundamental frequency (F0) provide an important cue for segregating simultaneous sounds. Cochlear implants (CIs) transmit F0 information primarily through the periodicity of the temporal envelope of the electrical pulse trains. Successful segregation of sounds with different F0s requires the ability to process multiple F0s simultaneously, but it is unknown whether CI users have this ability. This study measured modulation frequency discrimination thresholds for half-wave rectified sinusoidal envelopes modulated at 115 Hz in CI users and normal-hearing (NH) listeners. The target modulation was presented in isolation or in the presence of an interferer. Discrimination thresholds were strongly affected by the presence of an interferer, even when it was unmodulated and spectrally remote. Interferer modulation increased interference and often led to very high discrimination thresholds, especially when the interfering modulation frequency was lower than that of the target. Introducing a temporal offset between the interferer and the target led to at best modest improvements in performance in CI users and NH listeners. The results suggest no fundamental difference between acoustic and electric hearing in processing single or multiple envelope-based F0s, but confirm that differences in F0 are unlikely to provide a robust cue for perceptual segregation in CI users.

Although the ferret has become an important model species for studying both fundamental and clinical aspects of spatial hearing, previous behavioral work has focused on studies of sound localization and spatial release from masking in the free field. This makes it difficult to tease apart the role played by different spatial cues. In humans and other species, interaural time differences (ITDs) and interaural level differences (ILDs) play a critical role in sound localization in the azimuthal plane and also facilitate sound source separation in noisy environments. In this study, we used a range of broadband noise stimuli presented via customized earphones to measure ITD and ILD sensitivity in the ferret. Our behavioral data show that ferrets are extremely sensitive to changes in either binaural cue, with levels of performance approximating that found in humans. The measured thresholds were relatively stable despite extensive and prolonged (>16 weeks) testing on ITD and ILD tasks with broadband stimuli. For both cues, sensitivity was reduced at shorter durations. In addition, subtle effects of changing the stimulus envelope were observed on ITD, but not ILD, thresholds. Sensitivity to these cues also differed in other ways. Whereas ILD sensitivity was unaffected by changes in average binaural level or interaural correlation, the same manipulations produced much larger effects on ITD sensitivity, with thresholds declining when either of these parameters was reduced. The binaural sensitivity measured in this study can largely account for the ability of ferrets to localize broadband stimuli in the azimuthal plane. Our results are also broadly consistent with data from humans and confirm the ferret as an excellent experimental model for studying spatial hearing.

The nucleus basalis (NB) in the basal forebrain provides most of the cholinergic input to the neocortex and has been implicated in a variety of cognitive functions related to the processing of sensory stimuli. However, the role that cortical acetylcholine release plays in perception remains unclear. Here we show that selective loss of cholinergic NB neurons that project to the cortex reduces the accuracy with which ferrets localize brief sounds and prevents them from adaptively reweighting auditory localization cues in response to chronic occlusion of one ear. Cholinergic input to the cortex was disrupted by making bilateral injections of the immunotoxin ME20.4-SAP into the NB. This produced a substantial loss of both p75 neurotrophin receptor (p75 NTR )-positive and choline acetyltransferase-positive cells in this region and of acetylcholinesterase-positive fibers throughout the auditory cortex. These animals were significantly impaired in their ability to localize short broadband sounds (40–500 ms in duration) in the horizontal plane, with larger cholinergic cell lesions producing greater performance impairments. Although they localized longer sounds with normal accuracy, their response times were significantly longer than controls. Ferrets with cholinergic forebrain lesions were also less able to relearn to localize sound after plugging one ear. In contrast to controls, they exhibited little recovery of localization performance after behavioral training. Together, these results show that cortical cholinergic inputs contribute to the perception of sound source location under normal hearing conditions and play a critical role in allowing the auditory system to adapt to changes in the spatial cues available.

Background: A model that can accurately predict speech intelligibility for a given hearing-impaired (HI) listener would be an important tool for hearing-aid fitting or hearing-aid algorithm development. Existing speech-intelligibility models do not incorporate variability in suprathreshold deficits that are not well predicted by classical audiometric measures. One possible approach to the incorporation of such deficits is to base intelligibility predictions on sensitivity to simultaneously spectrally and temporally modulated signals. Purpose: The likelihood of success of this approach was evaluated by comparing estimates of spectrotemporal modulation (STM) sensitivity to speech intelligibility and to psychoacoustic estimates of frequency selectivity and temporal fine-structure (TFS) sensitivity across a group of HI listeners. Research Design: The minimum modulation depth required to detect STM applied to an 86 dB SPL four-octave noise carrier was measured for combinations of temporal modulation rate (4, 12, or 32 Hz) and spectral modulation density (0.5, 1, 2, or 4 cycles/octave). STM sensitivity estimates for individual HI listeners were compared to estimates of frequency selectivity (measured using the notched-noise method at 500, 1000, 2000, and 4000 Hz), TFS processing ability (2 Hz frequency-modulation detection thresholds for 500, 1000, 2000, and 4000 Hz carriers) and sentence intelligibility in noise (at a 0 dB signal-to-noise ratio) that were measured for the same listeners in a separate study. Study Sample: Eight normal-hearing (NH) listeners and 12 listeners with a diagnosis of bilateral sensorineural hearing loss participated. Data Collection and Analysis: STM sensitivity was compared between NH and HI listener groups using a repeated-measures analysis of variance. A stepwise regression analysis compared STM sensitivity for individual HI listeners to audiometric thresholds, age, and measures of frequency selectivity and TFS processing ability. A second stepwise regression analysis compared speech intelligibility to STM sensitivity and the audiogram-based Speech Intelligibility Index. Results: STM detection thresholds were elevated for the HI listeners, but only for low rates and high densities. STM sensitivity for individual HI listeners was well predicted by a combination of estimates of frequency selectivity at 4000 Hz and TFS sensitivity at 500 Hz but was unrelated to audiometric thresholds. STM sensitivity accounted for an additional 40% of the variance in speech intelligibility beyond the 40% accounted for by the audibility-based Speech Intelligibility Index. Conclusions: Impaired STM sensitivity likely results from a combination of a reduced ability to resolve spectral peaks and a reduced ability to use TFS information to follow spectral-peak movements. Combining STM sensitivity estimates with audiometric threshold measures for individual HI listeners provided a more accurate prediction of speech intelligibility than audiometric measures alone. These results suggest a significant likelihood of success for an STM-based model of speech intelligibility for HI listeners.

The auditory system creates a neuronal representation of the acoustic world based on spectral and temporal cues present at the listener's ears, including cues that potentially signal the locations of sounds. Discrimination of concurrent sounds from multiple sources is especially challenging. The current study is part of an effort to better understand the neuronal mechanisms governing this process, which has been termed "auditory scene analysis". In particular, we are interested in spatial release from masking by which spatial cues can segregate signals from other competing sounds, thereby overcoming the tendency of overlapping spectra and/or common temporal envelopes to fuse signals with maskers. We studied detection of pulsed tones in free-field conditions in the presence of concurrent multi-tone non-speech maskers. In "energetic" masking conditions, in which the frequencies of maskers fell within the ± 1/3-octave band containing the signal, spatial release from masking at low frequencies (~600 Hz) was found to be about 10 dB. In contrast, negligible spatial release from energetic masking was seen at high frequencies (~4000 Hz). We observed robust spatial release from masking in broadband "informational" masking conditions, in which listeners could confuse signal with masker even though there was no spectral overlap. Substantial spatial release was observed in conditions in which the onsets of the signal and all masker components were synchronized, and spatial release was even greater under asynchronous conditions. Spatial cues limited to high frequencies (>1500 Hz), which could have included interaural level differences and the better-ear effect, produced only limited improvement in signal detection. Substantially greater improvement was seen for low-frequency sounds, for which interaural time differences are the dominant spatial cue.

Auditory-cued behavioral training can alter neural circuits in primary auditory cortex (A1), but the mechanisms and consequences of experience-dependent cortical plasticity are not fully understood. To address this issue, we trained adult rats to detect a 5 kHz target in order to receive a food reward. After 14 days training we identified three locations within A1: (i) the region representing the characteristic frequency (CF) 5 kHz, (ii) a nearby region with CF ∼10 kHz, and (iii) a more distant region with CF ∼20 kHz. In order to compare functional connectivity in A1 near to, vs. far from, the representation of the target frequency, we placed a 16-channel multiprobe in middle- (∼10 kHz) and high- (∼20 kHz) CF regions and obtained current-source density (CSD) profiles evoked by a range of tone stimuli (CF±1-3 octaves in quarter-octave steps). Our aim was to construct "CSD receptive fields" (CSD RFs) in order to determine the laminar and spectral profile of tone-evoked current sinks, and infer changes to thalamocortical and intracortical inputs. Behavioral training altered CSD RFs at the 10 kHz, but not 20 kHz, site relative to CSD RFs in untrained control animals. At the 10 kHz site, current sinks evoked by the target frequency were enhanced in layer 2/3, but the initial current sink in layer 4 was not altered. The results imply training-induced plasticity along intracortical pathways connecting the target representation with nearby cortical regions. Finally, we related behavioral performance (sensitivity index, d') to CSD responses in individual animals, and found a significant correlation between the development of d' over training and the amplitude of the target-evoked current sink in layer 2/3. The results suggest that plasticity along intracortical pathways is important for auditory learning.

A subject's sensitivity to a stimulus variation can be studied by estimating the psychometric function. Generally speaking, three parameters of the psychometric function are of interest: the performance threshold, the slope of the function, and the rate at which attention lapses occur. In the present study, three psychophysical procedures were used to estimate the three-parameter psychometric function for an auditory gap detection task. These were an up-down staircase (up-down) procedure, an entropy-based Bayesian (entropy) procedure, and an updated maximum-likelihood (UML) procedure. Data collected from four young, normal-hearing listeners showed that while all three procedures provided similar estimates of the threshold parameter, the up-down procedure performed slightly better in estimating the slope and lapse rate for 200 trials of data collection. When the lapse rate was increased by mixing in random responses for the three adaptive procedures, the larger lapse rate was especially detrimental to the efficiency of the up-down procedure, and the UML procedure provided better estimates of the threshold and slope than did the other two procedures.

Two common measures of auditory temporal resolution are the temporal modulation transfer function (TMTF) and the gap detection threshold (GDT). The current study addresses the lack of efficient psychophysical procedures for collecting TMTFs and the lack of literature on the comparisons of TMTF and GDT. Two procedures for efficient measurements of the TMTF are proposed: (1) A Bayesian procedure that adaptively chooses the stimulus modulation rate and depth to maximize the information gain from each trial and (2) a procedure that reduces the data collection to two adaptive staircase tracks. Results from experiments I and II showed that, for broadband carriers, these approaches provided similar results compared to TMTFs measured using traditional methods despite taking less than 10 min for data collection. Using these efficient procedures, TMTFs were measured from a large number of naive listeners and were compared to the gap detection thresholds collected from the same ears in experiment III. Results showed that the sensitivity parameter estimated from the TMTF measurements correlated well with the GDTs, whereas the cutoff rate is either uncorrelated or positively correlated with the gap detection threshold. These results suggest caution in interpreting a lower GDT as evidence for less sluggish temporal processing.

Several studies have attributed deterioration of sound localization in the horizontal (azimuth) and vertical (elevation) planes to an age-related decline in binaural processing and high-frequency hearing loss (HFHL). The latter might underlie decreased elevation performance of older adults. However, as the pinnae keep growing throughout life, we hypothesized that larger ears might enable older adults to localize sounds in elevation on the basis of lower frequencies, thus (partially) compensating their HFHL. In addition, it is not clear whether sound localization has already matured at a very young age, when the body is still growing, and the binaural and monaural sound-localization cues change accordingly. The present study investigated sound-localization performance of children (7-11 years), young adults (20-34 years), and older adults (63-80 years) under open-loop conditions in the two-dimensional frontal hemifield. We studied the effect of age-related hearing loss and ear size on localization responses to brief broadband sound bursts with different bandwidths. We found similar localization abilities in azimuth for all listeners, including the older adults with HFHL. Sound localization in elevation for the children and young adult listeners with smaller ears improved when stimuli contained frequencies above 7 kHz. Subjects with larger ears could also judge the elevation of sound sources restricted to lower frequency content. Despite increasing ear size, sound localization in elevation deteriorated in older adults with HFHL. We conclude that the binaural localization cues are successfully used well into later stages of life, but that pinna growth cannot compensate the more profound HFHL with age.

In 2006, Turner and colleagues (Behav. Neurosci., 120:188-195) introduced the gap-startle paradigm as a high-throughput method for tinnitus screening in rats. Under this paradigm, gap detection ability was assessed by determining the level of inhibition of the acoustic startle reflex produced by a short silent gap inserted in an otherwise continuous background sound prior to a loud startling stimulus. Animals with tinnitus were expected to show impaired gap detection ability (i.e., lack of inhibition of the acoustic startle reflex) if the background sound containing the gap was qualitatively similar to the tinnitus pitch. Thus, for the gap-startle paradigm to be a valid tool to screen for tinnitus, a robust startle response from which to inhibit must be present. Because recent studies have demonstrated that the acoustic startle reflex could be dramatically reduced following noise exposure, we endeavored to 1) modify the gap-startle paradigm to be more resilient in the presence of hearing loss, and 2) evaluate whether a reduction in startle reactivity could confound the interpretation of gap prepulse inhibition and lead to errors in screening for tinnitus. In the first experiment, the traditional broadband noise (BBN) startle stimulus was replaced by a bandpass noise in which the sound energy was concentrated in the lower frequencies (5-10 kHz) in order to maintain audibility of the startle stimulus after unilateral high-frequency noise exposure (16 kHz). However, rats still showed a 57% reduction in startle amplitude to the bandpass noise post-noise exposure. A follow-up experiment on a separate group of rats with transiently-induced conductive hearing loss revealed that startle reactivity was better preserved when the BBN startle stimulus was replaced by a rapid airpuff to the back of the rat's neck. Furthermore, it was found that transient unilateral conductive hearing loss, which was not likely to induce tinnitus, caused an impairment in gap prepulse inhibition as assessed with the traditional BBN gap-startle paradigm, resulting in a false-positive screening for tinnitus. Thus, the present study identifies significant caveats of the traditional gap-startle paradigm, and describes experimental parameters using an airpuff startle stimulus which may help to limit the negative consequences of reduced startle reactivity following noise exposure, thereby allowing researchers to better screen for tinnitus in animals with hearing loss.

Auditory neurons that exhibit stimulus-specific adaptation (SSA) decrease their response to common tones while retaining responsiveness to rare ones. We recorded single-unit responses from the inferior colliculus (IC) where SSA is known to occur and we explored for the first time SSA in the cochlear nucleus (CN) of rats. We assessed an important functional outcome of SSA, the extent to which frequency discriminability depends on sensory context. For this purpose, pure tones were presented in an oddball sequence as standard (high probability of occurrence) or deviant (low probability of occurrence) stimuli. To study frequency discriminability under different probability contexts, we varied the probability of occurrence and the frequency separation between tones. The neuronal sensitivity was estimated in terms of spike-count probability using signal detection theory. We reproduced the finding that many neurons in the IC exhibited SSA, but we did not observe significant SSA in our CN sample. We concluded that strong SSA is not a ubiquitous phenomenon in the CN. As predicted, frequency discriminability was enhanced in IC when stimuli were presented in an oddball context, and this enhancement was correlated with the degree of SSA shown by the neurons. In contrast, frequency discrimination by CN neurons was independent of stimulus context. Our results demonstrated that SSA is not widespread along the entire auditory pathway, and suggest that SSA increases frequency discriminability of single neurons beyond that expected from their tuning curves.

In order to extract information in a rich environment, we focus on different features that allow us to direct attention to whatever source is of interest. The cortical network deployed during spatial attention, especially in vision, is well characterized. For example, visuospatial attention engages a frontoparietal network including the frontal eye fields (FEFs), which modulate activity in visual sensory areas to enhance the representation of an attended visual object. However, relatively little is known about the neural circuitry controlling attention directed to non-spatial features, or to auditory objects or features (either spatial or non-spatial). Here, using combined magnetoencephalography (MEG) and anatomical information obtained from MRI, we contrasted cortical activity when observers attended to different auditory features given the same acoustic mixture of two simultaneous spoken digits. Leveraging the fine temporal resolution of MEG, we establish that activity in left FEF is enhanced both prior to and throughout the auditory stimulus when listeners direct auditory attention to target location compared to when they focus on target pitch. In contrast, activity in the left posterior superior temporal sulcus (STS), a region previously associated with auditory pitch categorization, is greater when listeners direct attention to target pitch rather than target location. This differential enhancement is only significant after observers are instructed which cue to attend, but before the acoustic stimuli begin. We therefore argue that left FEF participates more strongly in directing auditory spatial attention, while the left STS aids auditory object selection based on the non-spatial acoustic feature of pitch.

Selective auditory attention is essential for human listeners to be able to communicate in multi-source environments. Selective attention is known to modulate the neural representation of the auditory scene, boosting the representation of a target sound relative to the background, but the strength of this modulation, and the mechanisms contributing to it, are not well understood. Here, listeners performed a behavioral experiment demanding sustained, focused spatial auditory attention while we measured cortical responses using electroencephalography (EEG). We presented three concurrent melodic streams; listeners were asked to attend and analyze the melodic contour of one of the streams, randomly selected from trial to trial. In a control task, listeners heard the same sound mixtures, but performed the contour judgment task on a series of visual arrows, ignoring all auditory streams. We found that the cortical responses could be fit as weighted sum of event-related potentials evoked by the stimulus onsets in the competing streams. The weighting to a given stream was roughly 10 dB higher when it was attended compared to when another auditory stream was attended; during the visual task, the auditory gains were intermediate. We then used a template-matching classification scheme to classify single-trial EEG results. We found that in all subjects, we could determine which stream the subject was attending significantly better than by chance. By directly quantifying the effect of selective attention on auditory cortical responses, these results reveal that focused auditory attention both suppresses the response to an unattended stream and enhances the response to an attended stream. The single-trial classification results add to the growing body of literature suggesting that auditory attentional modulation is sufficiently robust that it could be used as a control mechanism in brain-computer interfaces (BCIs).