Psychoacoustics publications

A classic paradigm used to quantify the perceptual weighting of binaural spatial cues requires a listener to adjust the value of one cue, while the complementary cue is held constant. Adjustments are made until the auditory percept appears centered in the head, and the values of both cues are recorded as a trading relation (TR), most commonly in μs interaural time difference per dB interaural level difference. Interestingly, existing literature has shown that TRs differ according to the cue being adjusted. The current study investigated whether cue-specific adaptation, which might arise due to the continuous, alternating presentation of signals during adjustment tasks, could account for this poorly understood phenomenon. Three experiments measured TRs via adjustment and via lateralization of single targets in virtual reality (VR). Targets were 500 Hz pure tones preceded by silence or by adapting trains that held one of the cues constant. VR removed visual anchors and provided an intuitive response technique during lateralization. The pattern of results suggests that adaptation can account for cue-dependent TRs. In addition, VR seems to be a viable tool for psychophysical tasks.

Objectives. Cochlear implant (CI) users typically report impaired ability to understand speech in noise. Speech understanding in CI users decreases with noise due to reduced temporal processing ability, and speech perceptual errors involve stop consonants distinguished by voice onset time (VOT). The current study examined the effects of noise on various speech perception tests while at the same time used cortical auditory evoked potentials (CAEPs) to quantify the change of neural processing of speech sounds caused by noise. We hypothesized that the noise effects on VOT processing can be reflected in N1/P2 measures, the neural changes relate to behavioral speech perception performances.Methods. Ten adult CI users and 15 normal-hearing (NH) people participated in this study. CAEPs were recorded from 64 scalp electrodes in both quiet and noise (signal-to-noise ratio +5 dB) and in passive and active (requiring consonant discrimination) listening. Speech stimulus was synthesized consonant-vowels with VOTs of 0 and 50 ms. N1-P2 amplitudes and latencies were analyzed as a function of listening condition. For the active condition, the P3b also was analyzed. Behavioral measures included a variety of speech perception tasks.Results. For good performing CI users, performance in most speech test was lower in the presence of noise masking. N1 and P2 latencies became prolonged with noise masking. The P3b amplitudes were smaller in CI groups compared to NH. The degree of P2 latency change (0 vs. 50 ms VOT) was correlated with consonant perception in noise.Conclusion. The effects of noise masking on temporal processing can be reflected in cortical responses in CI users. N1/P2 latencies were more sensitive to noise masking than amplitude measures. Additionally, P2 responses appear to have a better relationship to speech perception in CI users compared to N1.

Tinnitus is a common auditory disease worldwide; it is estimated that more than 10% of all individuals experience this hearing disorder during their lifetime. Tinnitus is sometimes accompanied by hearing loss. However, hearing loss is not acquired in some other tinnitus generations. In this study, we injected adult rats with salicylate sodium (SS) (200 mg/kg/day for 10 days) and found no significant hearing threshold changes at 2, 4, 8, 12, 14, 16, 20, or 24 kHz (all p > 0.05 ). Tinnitus was confirmed in the treated rats via Behaviour Testing of Acoustic Startle Response (ASR) and Gap Prepulse Inhibition Test of Acoustic Startle Reflex (GPIAS). A immunostaining study showed that there is significant loss of anti-CtBP2 puncta (a marker of cochlear inner hair cell (HC) ribbon synapses) in treated animals in apical, middle, and basal turns (all p < 0.05 ). The ABR wave I amplitudes were significantly reduced at 4, 8, 12, 14, 16, and 20 kHz (all p < 0.05 ). No significant losses of outer HCs, inner HCs, or HC cilia were observed (all p > 0.05 ). Thus, our study suggests that loss of cochlear inner HC ribbon synapse after SS exposure is a contributor to the development of tinnitus without changing hearing threshold.

Declining auditory spatial processing is hypothesized to contribute to the difficulty older adults have detecting, locating, and selecting a talker from among others in noisy listening environments. Though auditory spatial processing has been associated with several cortical structures, little is known regarding the underlying white matter architecture or how age-related changes in white matter microstructure may affect it. The arcuate fasciculus is a target for understanding age-related differences in auditory spatial attention based on normative spatial attention findings in humans. Similarly, animal and human clinical studies suggest that the corpus callosum plays a role in the cross-hemispheric integration of auditory spatial information important for spatial localization and attention. The current investigation used diffusion imaging to examine the extent to which age-group differences in the identification of spatially cued speech were accounted for by individual differences in the white matter microstructure of the right arcuate fasciculus and the corpus callosum. Higher right arcuate and callosal fractional anisotropy (FA) predicted better segregation and identification of spatially cued speech across younger and older listeners. Further, individual differences in callosal microstructure mediated age-group differences in auditory spatial processing. Follow-up analyses suggested that callosal tracts connecting left and right pre-frontal and posterior parietal cortex are particularly important for auditory spatial processing. The results are consistent with previous work in animals and clinical human samples and provide a cortical mechanism to account for age-related deficits in auditory spatial processing. Further, the results suggest that both intrahemispheric and interhemispheric mechanisms are involved in auditory spatial processing.

The brain combines information from multiple sensory modalities to interpret the environment. Multisensory integration is often modeled by ideal Bayesian causal inference, a model proposing that perceptual decisions arise from a statistical weighting of information from each sensory modality based on its reliability and relevance to the observer’s task. However, ideal Bayesian causal inference fails to describe human behavior in a simultaneous auditory spatial discrimination task in which spatially aligned visual stimuli improve performance despite providing no information about the correct response. This work tests the hypothesis that humans weight auditory and visual information in this task based on their relative reliabilities, even though the visual stimuli are task-uninformative, carrying no information about the correct response, and should be given zero weight. Listeners perform an auditory spatial discrimination task with relative reliabilities modulated by the stimulus durations. By comparing conditions in which task-uninformative visual stimuli are spatially aligned with auditory stimuli or centrally located (control condition), listeners are shown to have a larger multisensory effect when their auditory thresholds are worse. Even in cases in which visual stimuli are not task-informative, the brain combines sensory information that is scene-relevant, especially when the task is difficult due to unreliable auditory information.

Purpose This preliminary investigation compared effects of time compression on intelligibility for male versus female talkers. We hypothesized that time compression would have a greater effect for female talkers. Method Sentence materials from four talkers (two males) were time compressed, and original-speed and time-compressed speech materials were presented in a background of 12-talker babble to young adult listeners with normal hearing. Each talker/processing condition was heard by eight listeners (total N = 64). Generalized linear mixed-effects models were used to determine the effects of and interaction between processing condition and talker sex on keyword intelligibility. Additional post hoc analyses examined whether processing condition effects were related to talker vowel space and word frequency. Results For original-speed sentences, female and male talkers were essentially equally intelligible. Time compression reduced intelligibility for all talkers, but the effect was significantly greater for the female talkers. Supplementary analyses revealed that the effect of time compression depended on both talker vowel space and word frequency: The detrimental effect decreased significantly as word frequency and vowel space increased. Word frequency effects were also greater overall for talkers with larger vowel spaces. Conclusions While the small talker sample limits conclusions about the effects of talker sex, the secondary analyses suggest that intelligibility of talkers with larger vowel spaces is less susceptible to the negative effect of time compression, especially for high-frequency words.

The current study aimed to resolve some of the inconsistencies in the literature on which mental processes affect auditory cortical activity. To this end, we studied auditory cortical firing in four monkeys with different experience while they were involved in six conditions with different arrangements of the task components sound, motor action, and water reward. Firing rates changed most strongly when a sound-only condition was compared to a condition in which sound was paired with water. Additional smaller changes occurred in more complex conditions in which the monkeys received water for motor actions before or after sounds. Our findings suggest that auditory cortex is most strongly modulated by the subjects' level of arousal, thus by a psychological concept related to motor activity triggered by reinforcers and to readiness for operant behavior. Our findings also suggest that auditory cortex is involved in associative and emotional functions, but not in agency and cognitive effort.

Language development builds upon a complex network of interacting subservient systems. It therefore follows that variations in, and subclinical disruptions of, these systems may have secondary effects on emergent language. In this paper, we consider the relationship between genetic variants, hearing, auditory processing and language development. We employ whole genome sequencing in a discovery family to target association and gene x environment interaction analyses in two large population cohorts; the Avon Longitudinal Study of Parents and Children (ALSPAC) and UK10K. These investigations indicate that USH2A variants are associated with altered low-frequency sound perception which, in turn, increases the risk of developmental language disorder. We further show that Ush2a heterozygote mice have low-level hearing impairments, persistent higher-order acoustic processing deficits and altered vocalizations. These findings provide new insights into the complexity of genetic mechanisms serving language development and disorders and the relationships between developmental auditory and neural systems.

Chronic single-sided deaf (CSSD) listeners lack the availability of binaural difference cues to localize sounds in the horizontal plane. Hence, for directional hearing they have to rely on different types of monaural cues: loudness perceived in their hearing ear, which is affected in a systematic way by the acoustic head shadow, on spectral cues provided by the low-pass filtering characteristic of the head, and on high-frequency spectral-shape cues from the pinna of their hearing ear. Presumably, these cues are differentially weighted against prior assumptions on the properties of sound sources in the environment. The rules guiding this weighting process are not well understood. In this preliminary study, we trained three CSSD listeners to localize a fixed intensity, high-pass filtered sound source at ten locations in the horizontal plane with visual feedback. After training, we compared their localization performance to sounds with different intensities, presented in the two-dimensional frontal hemifield to their pre-training results. We show that the training had rapidly readjusted the contributions of monaural cues and internal priors, which resulted to be imposed by the multisensory information provided during the training. We compare the results with the strategies found for the acute monaural hearing condition of normal-hearing listeners, described in an earlier study [1].

The ability to detect short gaps in noise is an important tool for assessing the temporal resolution in the auditory cortex. However, the mere existence of responses to temporal gaps bounded by two short broadband markers is surprising, because of the expected short-term suppression that is prevalent in auditory cortex. Here, we used in-vivo intracellular recordings in anesthetized rats to dissect the synaptic mechanisms that underlie gap-related responses. When a gap is bounded by two short markers, a gap termination response was evoked by the onset of the second marker with minimal contribution from the offset of the first marker. Importantly, we show that the gap termination response was driven by a different (potentially partially overlapping) synaptic population than that underlying the onset response to the first marker. This recruitment of additional synaptic resources is a novel mechanism contributing to the important perceptual task of gap detection.

Observer-based procedures are used to assess auditory behavior in infants, often incorporating adaptive tracking algorithms. These procedures are reliable, but effects of modifications made to accommodate infant testing are not fully understood. One modification is that observation intervals are undefined for the listener, introducing signal-temporal uncertainty and increasing the likelihood that listener response bias will influence estimates of performance. The effect of these factors was evaluated by comparing threshold estimates obtained from adults using two tasks: (1) single-interval, yes/no and (2) two-interval, forced-choice. Detection thresholds were estimated adaptively for a 1000-Hz FM tone in quiet and for a word presented in two-talker speech masking. Trials were initiated and judged by the observer (observer-based) or the listener (listener-based). Thus, listening intervals were temporally uncertain in observer-based procedures and temporally defined in listener-based procedures. Thresholds were higher for observer-based relative to corresponding listener-based procedures. The magnitude of this difference was similar across the yes/no and two-interval tasks, and was larger for masked word detection than tone detection in quiet. Listeners adopted a conservative criterion when tested using the observer-based, yes/no procedure, but modeling results suggest that signal-temporal uncertainty accounts for the largest portion of the threshold difference between observer-based and listener-based procedures.

During critical periods, neural circuits develop to form receptive fields that adapt to the sensory environment and enable optimal performance of relevant tasks. We hypothesized that early exposure to background noise can improve signal-in-noise processing, and the resulting receptive field plasticity in the primary auditory cortex can reveal functional principles guiding that important task. We raised rat pups in different spectro-temporal noise statistics during their auditory critical period. As adults, they showed enhanced behavioral performance in detecting vocalizations in noise. Concomitantly, encoding of vocalizations in noise in the primary auditory cortex improves with noise-rearing. Significantly, spectro-temporal modulation plasticity shifts cortical preferences away from the exposed noise statistics, thus reducing noise interference with the foreground sound representation. Auditory cortical plasticity shapes receptive field preferences to optimally extract foreground information in noisy environments during noise-rearing. Early noise exposure induces cortical circuits to implement efficient coding in the joint spectral and temporal modulation domain.

We investigated whether the categorical perception (CP) of speech might also provide a mechanism that aids its perception in noise. We varied signal-to-noise ratio (SNR) [clear, 0 dB, -5 dB] while listeners classified an acoustic-phonetic continuum (/u/ to /a/). Noise-related changes in behavioral categorization were only observed at the lowest SNR. Event-related brain potentials (ERPs) differentiated category vs. category-ambiguous speech by the P2 wave (~180-320 ms). Paralleling behavior, neural responses to speech with clear phonetic status (i.e., continuum endpoints) were robust to noise down to -5 dB SNR, whereas responses to ambiguous tokens declined with decreasing SNR. Results demonstrate that phonetic speech representations are more resistant to degradation than corresponding acoustic representations. Findings suggest the mere process of binning speech sounds into categories provides a robust mechanism to aid figure-ground speech perception by fortifying abstract categories from the acoustic signal and making the speech code more resistant to external interferences.

Humans perceptual judgments are imprecise, as repeated exposures to the same physical stimulation (e.g. audio-visual inputs separated by a constant temporal offset) can result in different decisions. Moreover, there can be marked individual differences – precise judges will repeatedly make the same decision about a given input, whereas imprecise judges will make different decisions. The causes are unclear. We examined this using audio-visual (AV) timing and confidence judgments, in conjunction with electroencephalography (EEG) and multivariate pattern classification analyses. One plausible cause of differences in timing precision is that it scales with variance in the dynamics of evoked brain activity. Another possibility is that equally reliable patterns of brain activity are evoked, but there are systematic differences that scale with precision. Trial-by-trial decoding of input timings from brain activity suggested precision differences may not result from variable dynamics. Instead, precision was associated with evoked responses that were exaggerated (more different from baseline) ~300 ms after initial physical stimulations. We suggest excitatory and inhibitory interactions within a winner-take-all neural code for AV timing might exaggerate responses, such that evoked response magnitudes post-stimulation scale with encoding success.

Frequency discrimination learning is often accompanied by an expansion of the functional region corresponding to the target frequency within the auditory cortex. Although the perceptual significance of this plastic functional reorganization remains debated, greater cortical representation is generally thought to improve perception for a stimulus. Recently, the ability to expand functional representations through passive sound experience has been demonstrated in adult rats, suggesting that it may be possible to design passive sound exposures to enhance specific perceptual abilities in adulthood. To test this hypothesis, we exposed adult female Long–Evans rats to 2 weeks of moderate-intensity broadband white noise followed by 1 week of 7 kHz tone pips, a paradigm that results in the functional over-representation of 7 kHz within the adult tonotopic map. We then tested the ability of exposed rats to identify 7 kHz among distractor tones on an adaptive tone discrimination task. Contrary to our expectations, we found that map expansion impaired frequency discrimination and delayed perceptual learning. Rats exposed to noise followed by 15 kHz tone pips were not impaired at the same task. Exposed rats also exhibited changes in auditory cortical responses consistent with reduced discriminability of the exposure tone. Encouragingly, these deficits were completely recovered with training. Our results provide strong evidence that map expansion alone does not imply improved perception. Rather, plastic changes in frequency representation induced by bottom-up processes can worsen perceptual faculties, but because of the very nature of plasticity these changes are inherently reversible. SIGNIFICANCE STATEMENT The potent ability of our acoustic environment to shape cortical sensory representations throughout life has led to a growing interest in harnessing both passive sound experience and operant perceptual learning to enhance mature cortical function. We use sound exposure to induce targeted expansions in the adult rat tonotopic map and find that these bottom-up changes unexpectedly impair performance on an adaptive tone discrimination task. Encouragingly, however, we also show that training promotes the recovery of electrophysiological measures of reduced neural discriminability following sound exposure. These results provide support for future neuroplasticity-based treatments that take into account both the sensory statistics of our external environment and perceptual training strategies to improve learning and memory in the adult auditory system.

Objective . Categorical perception (CP) is an inherent property of speech perception. The response time (RT) of listeners’ perceptual speech identification is highly sensitive to individual differences. While the neural correlates of CP have been well studied in terms of the regional contributions of the brain to behavior, functional connectivity patterns that signify individual differences in listeners’ speed (RT) for speech categorization is less clear. In this study, we introduce a novel approach to address these questions. Approach . We applied several computational approaches to the EEG, including graph mining, machine learning (i.e., support vector machine), and stability selection to investigate the unique brain states (functional neural connectivity) that predict the speed of listeners’ behavioral decisions. Main results . We infer that (i) the listeners’ perceptual speed is directly related to dynamic variations in their brain connectomics, (ii) global network assortativity and efficiency distinguished fast, medium, and slow RTs, (iii) the functional network underlying speeded decisions increases in negative assortativity (i.e., became disassortative) for slower RTs, (iv) slower categorical speech decisions cause excessive use of neural resources and more aberrant information flow within the CP circuitry, (v) slower responders tended to utilize functional brain networks excessively (or inappropriately) whereas fast responders (with lower global efficiency) utilized the same neural pathways but with more restricted organization. Significance . Findings show that neural classifiers (SVM) coupled with stability selection correctly classify behavioral RTs from functional connectivity alone with over 92% accuracy (AUC = 0.9). Our results corroborate previous studies by supporting the engagement of similar temporal (STG), parietal, motor, and prefrontal regions in CP using an entirely data-driven approach.

Plastic change in neuronal connectivity is the foundation of memory encoding. It is not clear whether the changes during anesthesia can alter subsequent behavior. Here, we demonstrated that in male rodents under anesthesia, a visual stimulus (VS) was associated with electrical stimulation of the auditory cortex or natural auditory stimulus in the presence of cholecystokinin (CCK), which guided the animals' behavior in a two-choice auditory task. Auditory neurons became responsive to the VS after the pairings. Moreover, high-frequency stimulation of axon terminals of entorhinal CCK neurons in the auditory cortex enabled LTP of the visual response in the auditory cortex. Such pairing during anesthesia also generated VS-induced freezing in an auditory fear conditioning task. Finally, we verified that direct inputs from the entorhinal CCK neurons and the visual cortex enabled the above neural plasticity in the auditory cortex. Our findings suggest that CCK-enabled visuoauditory association during anesthesia can be translated to the subsequent behavior action. SIGNIFICANCE STATEMENT Our study provides strong evidence for the hypothesis that cholecystokinin plays an essential role in the formation of cross-modal associative memory. Moreover, we demonstrated that an entorhinal–neocortical circuit underlies such neural plasticity, which will be helpful to understand the mechanisms of memory formation and retrieval in the brain.

Neural adaptation enables sensory information to be represented optimally in the brain despite large fluctuations over time in the statistics of the environment. Auditory contrast gain control represents an important example, which is thought to arise primarily from cortical processing. Here we show that neurons in the auditory thalamus and midbrain of mice show robust contrast gain control, and that this is implemented independently of cortical activity. Although neurons at each level exhibit contrast gain control to similar degrees, adaptation time constants become longer at later stages of the processing hierarchy, resulting in progressively more stable representations. We also show that auditory discrimination thresholds in human listeners compensate for changes in contrast, and that the strength of this perceptual adaptation can be predicted from physiological measurements. Contrast adaptation is therefore a robust property of both the subcortical and cortical auditory system and accounts for the short-term adaptability of perceptual judgments.

Parvalbumin-positive (PV+) interneurons are major regulators of adult experience-dependent plasticity. Acute manipulation of PV+ cell activity before learning alters the rate of acquisition of new skills, whereas transient inactivation of PV+ cells interferes with retrieval of previously learned information. However, the effects of sustained PV+ cell manipulation throughout training remain largely unknown. Using chemogenetics in rat auditory cortex during an adaptive sound disrimination task, here we show that PV+ cells exert bidirectional control over the rate of perceptual learning. Down-regulation of PV+ cell activity accelerated learning, but increasing their activity resulted in slower learning. However, both interventions led to reduced gains in perceptual acuity by the end of training relative to controls. Furthermore, longitudinal training performance was functionally correlated with measures of neural synchrony and stimulus-specific adaptation. These findings suggest that, whereas restricting PV+ cell activity may initially facilitate training-induced plasticity, a subsequent increase in PV+ cell activity is necessary to prevent further plastic changes and consolidate learning.

Human perception requires the many-to-one mapping between continuous sensory elements and discrete categorical representations. This grouping operation underlies the phenomenon of categorical perception (CP)-the experience of perceiving discrete categories rather than gradual variations in signal input. Speech perception requires CP because acoustic cues do not share constant relations with perceptual-phonetic representations. Beyond facilitating perception of unmasked speech, we reasoned CP might also aid the extraction of target speech percepts from interfering sound sources (i.e., noise) by generating additional perceptual constancy and reducing listening effort. Specifically, we investigated how noise interference impacts cognitive load and perceptual identification of unambiguous (i.e., categorical) vs. ambiguous stimuli. Listeners classified a speech vowel continuum (/u/-/a/) at various signal-to-noise ratios (SNRs [unmasked, 0 and -5 dB]). Continuous recordings of pupil dilation measured processing effort, with larger, later dilations reflecting increased listening demand. Critical comparisons were between time-locked changes in eye data in response to unambiguous (i.e., continuum endpoints) tokens vs. ambiguous tokens (i.e., continuum midpoint). Unmasked speech elicited faster responses and sharper psychometric functions, which steadily declined in noise. Noise increased pupil dilation across stimulus conditions, but not straightforwardly. Noise-masked speech modulated peak pupil size (i.e., [0 and -5 dB] > unmasked). In contrast, peak dilation latency varied with both token and SNR. Interestingly, categorical tokens elicited earlier pupil dilation relative to ambiguous tokens. Our pupillary data suggest CP reconstructs auditory percepts under challenging listening conditions through interactions between stimulus salience and listeners' internalized effort and/or arousal.