Menu

Behavioral Neuroscience publications

Behavioral experiments controlled or timed with TDT systems: operant tasks, conditioning and closed-loop paradigms.

Science Advances · Aug 2026

Neural competition between prefrontal and auditory cortex constrains novel sound strategy learning (opens in a new tab)

Kai Lu, Kelvin T. Wong, Chengcheng J. Yang, … Robert C. Liu

Abstract

In nature, animals learn to replace predisposed behaviors with new strategies, yet the neural constraints on these transitions are unclear. Using an ethological search task in mice, we reveal medial prefrontal cortical (mPFC) neural correlates of a predisposed win-stay strategy that decays as animals learn to follow a more reliable auditory cue. Auditory cortex (ACx) activity predicts correct trial-by-trial sound-guided search, even on day one of training. This prognostic coding strengthens with learning and emerges from suppressed spiking, most pronounced in neurons tuned laterally to the cue’s spectrum. Chemogenetic disruption reveals ACx contributions to improving performance. Unexpectedly, the global silencing of mPFC accelerates successful usage of sound-tracking, contrary to its canonical role in flexible or stimulus-dependent behavior. Instead, a decentralized multiexpert competition model best predicts behavior and causal perturbations. These findings suggest that mPFC implements a default strategy based on prior knowledge, which actively hinders the expression of more efficient strategies.

Science Advances · Apr 2026

An evolutionary conserved neural mechanism for interpersonal coordination in primates (opens in a new tab)

Lucia Maria Sacheli, Stefano Grasso, Laura Zapparoli, … Eraldo Paulesu

Abstract

Interpersonal coordination is fundamental to social evolution. We investigate its phenomenology and neural underpinnings in humans and macaques, examining the behavioral adaptations required for mutual coordination during motor interactions and the extent to which the underlying brain mechanisms are shared across species. Using a common interpersonal coordination paradigm, we conducted functional magnetic resonance imaging (fMRI) in humans and intracranial local field potential (LFP) recordings in macaques. Despite between-species behavioral discrepancies, both monkeys and humans coordinate through adjustments that proved to be based on proactive adaptation of motor planning and execution. Evidence from fMRI and time-resolved decoding analysis of LFPs converged to show modulation of premotor brain activity associated with interpersonal coordination and its effectiveness. Moreover, a dynamic sequential coding emerged, whereby the action context is represented early during planning, and coordination features near movement onset. Our findings reveal an evolutionarily conserved cortical architecture across primates that supports cooperative motor behavior.

Annals of the New York Academy of Sciences · Apr 2025

Representation of vocalizations in the frontal auditory field and the dorsal auditory cortex of bats (opens in a new tab)

Stephen Gareth Hoerpel, Sonja C. Vernes, Uwe Firzlaff

Abstract

In bats, which express a complex vocal repertoire and are considered vocal learners, the frontal auditory field (FAF) is supposedly placed in a frontal cortico‐striatal network for vocal–motor control. The FAF receives input from the auditory cortex (AC) and other auditory nuclei via multiple pathways. However, not much is known about the transition of information on vocalizations from the AC to the FAF. The bat AC consists of different subfields, among which the dorsal fields (dAC) are characterized by precise coding of the temporal envelope of vocalizations. The dAC should, therefore, be a major source of auditory feedback information about self‐produced or perceived vocalizations to the FAF. Our study aimed to investigate the specificity of encoding for different types of vocalizations in FAF and dAC neurons. Using extracellular recordings in anesthetized Phyllostomus discolor , we describe basic response properties in both cortical areas and compare responses to different types of prerecorded vocalizations. The specificity of encoding for different behaviorally relevant call categories and single calls was higher in dAC than in FAF neurons, both in terms of temporal firing patterns and response strength. These findings highlight the importance of the dAC in the neural network for control of vocal communication in bats.

eLife · Oct 2023

Thalamic regulation of ocular dominance plasticity in adult visual cortex (opens in a new tab)

Yi Qin, Mehran Ahmadlou, Samuel Suhai, … Christiaan N Levelt

Abstract

Experience-dependent plasticity in the adult visual system is generally thought of as a cortical process. However, several recent studies have shown that perceptual learning or monocular deprivation can also induce plasticity in the adult dorsolateral geniculate nucleus (dLGN) of the thalamus. How plasticity in the thalamus and cortex interact in the adult visual system is ill-understood. To assess the influence of thalamic plasticity on plasticity in primary visual cortex (V1), we made use of our previous finding that during the critical period ocular dominance (OD) plasticity occurs in dLGN and requires thalamic synaptic inhibition. Using multielectrode recordings we find that this is also true in adult mice, and that in the absence of thalamic inhibition and plasticity, OD plasticity in adult V1 is absent. To study the influence of V1 on thalamic plasticity, we silenced V1 and show that during the critical period, but not in adulthood, the OD shift in dLGN is partially caused by feedback from V1. We conclude that during adulthood the thalamus plays an unexpectedly dominant role in experience-dependent plasticity in V1. Our findings highlight the importance of considering the thalamus as a potential source of plasticity in learning events that are typically thought of as cortical processes.

Scientific Reports · Jul 2021

Communication breakdown: Limits of spectro-temporal resolution for the perception of bat communication calls (opens in a new tab)

Stephen Gareth Hörpel, A. Leonie Baier, Herbert Peremans, … Uwe Firzlaff

Abstract

During vocal communication, the spectro-temporal structure of vocalizations conveys important contextual information. Bats excel in the use of sounds for echolocation by meticulous encoding of signals in the temporal domain. We therefore hypothesized that for social communication as well, bats would excel at detecting minute distortions in the spectro-temporal structure of calls. To test this hypothesis, we systematically introduced spectro-temporal distortion to communication calls of Phyllostomus discolor bats. We broke down each call into windows of the same length and randomized the phase spectrum inside each window. The overall degree of spectro-temporal distortion in communication calls increased with window length. Modelling the bat auditory periphery revealed that cochlear mechanisms allow discrimination of fast spectro-temporal envelopes. We evaluated model predictions with experimental psychophysical and neurophysiological data. We first assessed bats’ performance in discriminating original versions of calls from increasingly distorted versions of the same calls. We further examined cortical responses to determine additional specializations for call discrimination at the cortical level. Psychophysical and cortical responses concurred with model predictions, revealing discrimination thresholds in the range of 8–15 ms randomization-window length. Our data suggest that specialized cortical areas are not necessary to impart psychophysical resilience to temporal distortion in communication calls.

Brain Structure and Function · Apr 2021

Neuroplastin expression is essential for hearing and hair cell PMCA expression (opens in a new tab)

Xiao Lin, Michael G. K. Brunk, Pingan Yuanxiang, … Dirk Montag

Abstract

Hearing deficits impact on the communication with the external world and severely compromise perception of the surrounding. Deafness can be caused by particular mutations in the neuroplastin ( Nptn ) gene, which encodes a transmembrane recognition molecule of the immunoglobulin (Ig) superfamily and plasma membrane Calcium ATPase (PMCA) accessory subunit. This study investigates whether the complete absence of neuroplastin or the loss of neuroplastin in the adult after normal development lead to hearing impairment in mice analyzed by behavioral, electrophysiological, and in vivo imaging measurements. Auditory brainstem recordings from adult neuroplastin-deficient mice ( Nptn −/− ) show that these mice are deaf. With age, hair cells and spiral ganglion cells degenerate in Nptn −/− mice. Adult Nptn −/− mice fail to behaviorally respond to white noise and show reduced baseline blood flow in the auditory cortex (AC) as revealed by single-photon emission computed tomography (SPECT). In adult Nptn −/− mice, tone-evoked cortical activity was not detectable within the primary auditory field (A1) of the AC, although we observed non-persistent tone-like evoked activities in electrophysiological recordings of some young Nptn −/− mice. Conditional ablation of neuroplastin in Nptn lox/loxEmx1Cre mice reveals that behavioral responses to simple tones or white noise do not require neuroplastin expression by central glutamatergic neurons. Loss of neuroplastin from hair cells in adult Nptn Δlox/loxPrCreERT mice after normal development is correlated with increased hearing thresholds and only high prepulse intensities result in effective prepulse inhibition (PPI) of the startle response. Furthermore, we show that neuroplastin is required for the expression of PMCA 2 in outer hair cells. This suggests that altered Ca 2+ homeostasis underlies the observed hearing impairments and leads to hair cell degeneration. Our results underline the importance of neuroplastin for the development and the maintenance of the auditory system.

Scientific Reports · Nov 2020

Resistance to noise-induced gap detection impairment in FVB mice is correlated with reduced neuroinflammatory response and parvalbumin-positive neuron loss (opens in a new tab)

Alexander K. Zinsmaier, Weihua Wang, Li Zhang, … Shaowen Bao

Abstract

Exposure to loud noises results in neuroinflammatory responses in the central auditory pathway. Noise-induced neuroinflammation is implicated in auditory processing deficits such as impairment in gap detection. In this study, we examined whether strain differences between the FVB and C57BL/6 mice in noise-induced impairment in gap detection are correlated with strain differences in neuroinflammatory responses. We found that noise induced more robust TNF-α expression in C57BL/6 than in FVB mice. Noise-induced microglial deramification was observed in C57BL/6 mice, but not in FVB mice. Furthermore, noise exposure resulted in a reduction in parvalbumin-positive (PV+) neuron density in the C57BL/6 mice, but not in FVB mice. These results suggest that neuroinflammatory responses and loss of PV+ neurons may contribute to strain differences in noise-induced impairment in gap detection.

Frontiers in Neuroscience · Oct 2020

Diffusible Tumor Necrosis Factor-Alpha (TNF-) Promotes Noise-Induced Parvalbumin-Positive (PV+) Neuron Loss and Auditory Processing Impairments (opens in a new tab)

Di Deng, Weihua Wang, Shaowen Bao

Abstract

Neuroinflammation has been implicated in noise-induced auditory processing disorder and tinnitus. Certain non-auditory neurological disorders can also increase the levels of proinflammatory cytokines in the brain. To investigate the impact of increased brain proinflammatory cytokine levels on the central auditory pathway, we infused recombinant TNF-α into the right lateral cerebral ventricle, and examined auditory processing and cytoarchitecture of the auditory cortex. Microglial deramification was observed in the auditory cortex of mice that had received both TNF-α infusion and exposure to an 86-dB noise, but not in mice that had received either TNF-α infusion or noise exposure alone. In addition, we observed reduced cortical PV+ neuron density and impaired performances in gap detection and prepulse inhibition (PPI) only in mice that received both TNF-α infusion and the noise exposure. These results suggest that disease-related increase in brain proinflammatory cytokine release could be a risk factor for noise-induced auditory processing disorder and tinnitus.

PLOS Biology · Jun 2019

Neuroinflammation mediates noise-induced synaptic imbalance and tinnitus in rodent models (opens in a new tab)

Weihua Wang, Li. S. Zhang, Alexander K. Zinsmaier, … Shaowen Bao

Abstract

Hearing loss is a major risk factor for tinnitus, hyperacusis, and central auditory processing disorder. Although recent studies indicate that hearing loss causes neuroinflammation in the auditory pathway, the mechanisms underlying hearing loss-related pathologies are still poorly understood. We examined neuroinflammation in the auditory cortex following noise-induced hearing loss (NIHL) and its role in tinnitus in rodent models. Our results indicate that NIHL is associated with elevated expression of proinflammatory cytokines and microglial activation-two defining features of neuroinflammatory responses-in the primary auditory cortex (AI). Genetic knockout of tumor necrosis factor alpha (TNF-α) or pharmacologically blocking TNF-α expression prevented neuroinflammation and ameliorated the behavioral phenotype associated with tinnitus in mice with NIHL. Conversely, infusion of TNF-α into AI resulted in behavioral signs of tinnitus in both wild-type and TNF-α knockout mice with normal hearing. Pharmacological depletion of microglia also prevented tinnitus in mice with NIHL. At the synaptic level, the frequency of miniature excitatory synaptic currents (mEPSCs) increased and that of miniature inhibitory synaptic currents (mIPSCs) decreased in AI pyramidal neurons in animals with NIHL. This excitatory-to-inhibitory synaptic imbalance was completely prevented by pharmacological blockade of TNF-α expression. These results implicate neuroinflammation as a therapeutic target for treating tinnitus and other hearing loss-related disorders.

Frontiers in Cellular Neuroscience · Sep 2018

Loss of the Cochlear Amplifier Prestin Reduces Temporal Processing Efficacy in the Central Auditory System (opens in a new tab)

Joseph P. Walton, Adam C. Dziorny, Olga N. Vasilyeva, Anne E. Luebke

Abstract

Active mechanical amplification of sound occurs in cochlear outer hair cells (OHCs) that change their length with oscillations of their membrane potential. Such length changes are the proposed cellular source of the cochlear amplifier, and prestin is the motor protein responsible for OHC electromotility. Previous findings have shown that mice lacking prestin displayed a loss of OHC electromotility, subsequent loss of distortion-product otoacoustic emissions, and a 40-60 dB increase in hearing thresholds. In this study we were interested in studying the functional consequences of the complete loss of cochlear amplification on neural coding of frequency selectivity, tuning, and temporal processing in the auditory midbrain. We recorded near-field auditory evoked potentials and multi-unit activity from the inferior colliculus (IC) of prestin (-/-) null and prestin (+/+) wild-type control mice and determined frequency response areas (FRAs), tuning sharpness, and gap detection to tone bursts and silent gaps embedded in broadband noise. We were interested in determining if the moderate to severe sensorineural hearing loss associated with the loss of motor protein prestin would also impair auditory midbrain temporal-processing measures, or if compensatory mechanisms within the brainstem could compensate for the loss of prestin. In prestin knockout mice we observed that there are severe impairments in midbrain tuning, thresholds, excitatory drive, and gap detection suggesting that brainstem and midbrain processing could not overcome the auditory processing deficits afforded by the loss of OHC electromotility mediated by the prestin protein.

Physiological Reports · Jul 2017

Complex object motion represented by context-dependent correlated activity of visual interneurones (opens in a new tab)

Paul C. Dick, Nicole L. Michel, John R. Gray

Abstract

Accurate and adaptive encoding of complex, dynamic visual information is critical for the survival of many animals. Studies across a range of taxa have investigated behavioral and neuronal responses to objects that represent a threat, such as a looming object approaching along a direct collision course. By investigating neural mechanisms of avoidance behaviors through recording multineuronal activity, it is possible to better understand how complex visual information is represented in circuits that ultimately drive behaviors. We used multichannel electrodes to record from the well-studied locust nervous system to explore how object motion is reflected in activity of correlated neural activity. We presented locusts (Locusta migratoria) with objects that moved along one of 11 unique trajectories and recorded from descending interneurons within the ventral nerve cord. Spike sorting resulted in 405 discriminated units across 20 locusts and we found that 75% of the units responded to some form of object motion. Dimensionality reduction through principal component (PCA) and dynamic factor (DFA) analyses revealed population vector responses within individuals and common firing trends across the pool of discriminated units, respectively. Population vector composition (PCA) varied with the stimulus and common trends (DFA) showed unique tuning related to changes in the visual size and trajectory of the object through time. These findings demonstrate that this well-described collision detection system is more complex than previously envisioned and will drive future experiments to explore fundamental principles of how visual information is processed through context-dependent dynamic ensembles of neurons to initiate and control complex behavior.

The Journal of Neuroscience · May 2017

A Role for Auditory Corticothalamic Feedback in the Perception of Complex Sounds (opens in a new tab)

Natsumi Y. Homma, Max F.K. Happel, Fernando R. Nodal, … Victoria M. Bajo

Abstract

Feedback signals from the primary auditory cortex (A1) can shape the receptive field properties of neurons in the ventral division of the medial geniculate body (MGBv). However, the behavioral significance of corticothalamic modulation is unknown. The aim of this study was to elucidate the role of this descending pathway in the perception of complex sounds. We tested the ability of adult female ferrets to detect the presence of a mistuned harmonic in a complex tone using a positive conditioned go/no-go behavioral paradigm before and after the input from layer VI in A1 to MGBv was bilaterally and selectively eliminated using chromophore-targeted laser photolysis. MGBv neurons were identified by their short latencies and sharp tuning curves. They responded robustly to harmonic complex tones and exhibited an increase in firing rate and temporal pattern changes when one frequency component in the complex tone was mistuned. Injections of fluorescent microbeads conjugated with a light-sensitive chromophore were made in MGBv, and, following retrograde transport to the cortical cell bodies, apoptosis was induced by infrared laser illumination of A1. This resulted in a selective loss of ∼60% of layer VI A1-MGBv neurons. After the lesion, mistuning detection was impaired, as indicated by decreased d' values, a shift of the psychometric curves toward higher mistuning values, and increased thresholds, whereas discrimination performance was unaffected when level cues were also available. Our results suggest that A1-MGBv corticothalamic feedback contributes to the detection of harmonicity, one of the most important grouping cues in the perception of complex sounds.SIGNIFICANCE STATEMENT Perception of a complex auditory scene is based on the ability of the brain to group those sound components that belong to the same source and to segregate them from those belonging to different sources. Because two people talking simultaneously may differ in their voice pitch, perceiving the harmonic structure of sounds is very important for auditory scene analysis. Here we demonstrate mistuning sensitivity in the thalamus and that feedback from the primary auditory cortex is required for the normal ability of ferrets to detect a mistuned harmonic within a complex sound. These results provide novel insight into the function of descending sensory pathways in the brain and suggest that this corticothalamic circuit plays an important role in scene analysis.

Nature Communications · Apr 2015

Preference for concentric orientations in the mouse superior colliculus (opens in a new tab)

Mehran Ahmadlou, J Alexander Heimel

Abstract

The superior colliculus is a layered structure important for body- and gaze-orienting responses. Its superficial layer is, next to the lateral geniculate nucleus, the second major target of retinal ganglion axons and is retinotopically organized. Here we show that in the mouse there is also a precise organization of orientation preference. In columns perpendicular to the tectal surface, neurons respond to the same visual location and prefer gratings of the same orientation. Calcium imaging and extracellular recording revealed that the preferred grating varies with retinotopic location, and is oriented parallel to the concentric circle around the centre of vision through the receptive field. This implies that not all orientations are equally represented across the visual field. This makes the superior colliculus different from visual cortex and unsuitable for translation-invariant object recognition and suggests that visual stimuli might have different behavioural consequences depending on their retinotopic location.

Frontiers in Behavioral Neuroscience · Nov 2014

Abnormal emotional learning in a rat model of autism exposed to valproic acid in utero (opens in a new tab)

Anwesha Banerjee, Crystal T. Engineer, Bethany L. Sauls, … Jonathan E. Ploski

Abstract

Autism Spectrum Disorders (ASD) are complex neurodevelopmental disorders characterized by repetitive behavior and impaired social communication and interactions. Apart from these core symptoms, a significant number of ASD individuals display higher levels of anxiety and some ASD individuals exhibit impaired emotional learning. We therefore sought to further examine anxiety and emotional learning in an environmentally induced animal model of ASD that utilizes the administration of the known teratogen, valproic acid (VPA) during gestation. Specifically we exposed dams to one of two different doses of VPA (500 and 600 mg/kg) or vehicle on day 12.5 of gestation and examined the resultant progeny. Our data indicate that animals exposed to VPA in utero exhibit enhanced anxiety in the open field test and normal object recognition memory compared to control animals. Animals exposed to 500 mg/kg of VPA displayed normal acquisition of auditory fear conditioning, and exhibited reduced extinction of fear memory and normal litter survival rates as compared to control animals. We observed that animals exposed to 600 mg/kg of VPA exhibited a significant reduction in the acquisition of fear conditioning, a significant reduction in social interaction and a significant reduction in litter survival rates as compared to control animals. VPA (600 mg/kg) exposed animals exhibited similar shock sensitivity and hearing as compared to control animals indicating the fear conditioning deficit observed in these animals was not likely due to sensory deficits, but rather due to deficits in learning or memory retrieval. In conclusion, considering that progeny from dams exposed to rather similar doses of VPA exhibit striking differences in emotional learning, the VPA model may serve as a useful tool to explore the molecular and cellular mechanisms that contribute to not only ASD, but also emotional learning.

Frontiers in Systems Neuroscience · Aug 2014

Speech sound discrimination training improves auditory cortex responses in a rat model of autism (opens in a new tab)

Crystal T. Engineer, Tracy M. Centanni, Kwok W. Im, Michael P. Kilgard

Abstract

Children with autism often have language impairments and degraded cortical responses to speech. Extensive behavioral interventions can improve language outcomes and cortical responses. Prenatal exposure to the antiepileptic drug valproic acid (VPA) increases the risk for autism and language impairment. Prenatal exposure to VPA also causes weaker and delayed auditory cortex responses in rats. In this study, we document speech sound discrimination ability in VPA exposed rats and document the effect of extensive speech training on auditory cortex responses. VPA exposed rats were significantly impaired at consonant, but not vowel, discrimination. Extensive speech training resulted in both stronger and faster anterior auditory field (AAF) responses compared to untrained VPA exposed rats, and restored responses to control levels. This neural response improvement generalized to non-trained sounds. The rodent VPA model of autism may be used to improve the understanding of speech processing in autism and contribute to improving language outcomes.

Neural Plasticity · 2014

Salicylate-induced auditory perceptual disorders and plastic changes in nonclassical auditory centers in rats (opens in a new tab)

Guang-Di Chen, Kelly E. Radziwon, Nina Kashanian, … Richard Salvi

Abstract

Previous studies have shown that sodium salicylate (SS) activates not only central auditory structures, but also nonauditory regions associated with emotion and memory. To identify electrophysiological changes in the nonauditory regions, we recorded sound-evoked local field potentials and multiunit discharges from the striatum, amygdala, hippocampus, and cingulate cortex after SS-treatment. The SS-treatment produced behavioral evidence of tinnitus and hyperacusis. Physiologically, the treatment significantly enhanced sound-evoked neural activity in the striatum, amygdala, and hippocampus, but not in the cingulate. The enhanced sound evoked response could be linked to the hyperacusis-like behavior. Further analysis showed that the enhancement of sound-evoked activity occurred predominantly at the midfrequencies, likely reflecting shifts of neurons towards the midfrequency range after SS-treatment as observed in our previous studies in the auditory cortex and amygdala. The increased number of midfrequency neurons would lead to a relative higher number of total spontaneous discharges in the midfrequency region, even though the mean discharge rate of each neuron may not increase. The tonotopical overactivity in the midfrequency region in quiet may potentially lead to tonal sensation of midfrequency (the tinnitus). The neural changes in the amygdala and hippocampus may also contribute to the negative effect that patients associate with their tinnitus.

PLoS ONE · Oct 2013

Similarity of cortical activity patterns predicts generalization behavior (opens in a new tab)

Crystal T. Engineer, Claudia A. Perez, Ryan S. Carraway, … Michael P. Kilgard

Abstract

Humans and animals readily generalize previously learned knowledge to new situations. Determining similarity is critical for assigning category membership to a novel stimulus. We tested the hypothesis that category membership is initially encoded by the similarity of the activity pattern evoked by a novel stimulus to the patterns from known categories. We provide behavioral and neurophysiological evidence that activity patterns in primary auditory cortex contain sufficient information to explain behavioral categorization of novel speech sounds by rats. Our results suggest that category membership might be encoded by the similarity of the activity pattern evoked by a novel speech sound to the patterns evoked by known sounds. Categorization based on featureless pattern matching may represent a general neural mechanism for ensuring accurate generalization across sensory and cognitive systems.

Frontiers in Neuroengineering · 2013

Identification of a self-paced hitting task in freely moving rats based on adaptive spike detection from multi-unit M1 cortical signals (opens in a new tab)

Sofyan H. H. Hammad, Dario Farina, Ernest N. Kamavuako, Winnie Jensen

Abstract

Invasive brain-computer interfaces (BCIs) may prove to be a useful rehabilitation tool for severely disabled patients. Although some systems have shown to work well in restricted laboratory settings, their usefulness must be tested in less controlled environments. Our objective was to investigate if a specific motor task could reliably be detected from multi-unit intra-cortical signals from freely moving animals. Four rats were trained to hit a retractable paddle (defined as a "hit"). Intra-cortical signals were obtained from electrodes placed in the primary motor cortex. First, the signal-to-noise ratio was increased by wavelet denoising. Action potentials were then detected using an adaptive threshold, counted in three consecutive time intervals and were used as features to classify either a "hit" or a "no-hit" (defined as an interval between two "hits"). We found that a "hit" could be detected with an accuracy of 75 ± 6% when wavelet denoising was applied whereas the accuracy dropped to 62 ± 5% without prior denoising. We compared our approach with the common daily practice in BCI that consists of using a fixed, manually selected threshold for spike detection without denoising. The results showed the feasibility of detecting a motor task in a less restricted environment than commonly applied within invasive BCI research.

PLoS ONE · Mar 2011

A symbiotic brain-machine interface through value-based decision making (opens in a new tab)

Babak Mahmoudi, Justin C. Sanchez

Abstract

Background: In the development of Brain Machine Interfaces (BMIs), there is a great need to enable users to interact with changing environments during the activities of daily life. It is expected that the number and scope of the learning tasks encountered during interaction with the environment as well as the pattern of brain activity will vary over time. These conditions, in addition to neural reorganization, pose a challenge to decoding neural commands for BMIs. We have developed a new BMI framework in which a computational agent symbiotically decoded users' intended actions by utilizing both motor commands and goal information directly from the brain through a continuous Perception-Action-Reward Cycle (PARC). Methodology: The control architecture designed was based on Actor-Critic learning, which is a PARC-based reinforcement learning method. Our neurophysiology studies in rat models suggested that Nucleus Accumbens (NAcc) contained a rich representation of goal information in terms of predicting the probability of earning reward and it could be translated into an evaluative feedback for adaptation of the decoder with high precision. Simulated neural control experiments showed that the system was able to maintain high performance in decoding neural motor commands during novel tasks or in the presence of reorganization in the neural input. We then implanted a dual micro-wire array in the primary motor cortex (M1) and the NAcc of rat brain and implemented a full closed-loop system in which robot actions were decoded from the single unit activity in M1 based on an evaluative feedback that was estimated from NAcc. Conclusions: Our results suggest that adapting the BMI decoder with an evaluative feedback that is directly extracted from the brain is a possible solution to the problem of operating BMIs in changing environments with dynamic neural signals. During closed-loop control, the agent was able to solve a reaching task by capturing the action and reward interdependency in the brain.