Braincodec:通过皮层刺激实现听觉重建的仿生深度编码器
A biomimetic deep encoder for auditory restoration by cortical stimulation
研究团队提出Braincodec深度网络,通过优化刺激模式与听觉皮层神经码的空间、时间和高层特性对齐来传输声音信息。该系统在线运行,仅需几百个通道即可高保真重建自然声音,小鼠实验中配备Braincodec驱动的听觉皮层假体的小鼠在辨别真实声音时达到与未植入小鼠相当的准确率。
预印本给出Braincodec编码方法与小鼠实验结果,读者可了解皮层听觉假体在通道数和声音重建上的思路。
Cochlear and auditory brainstem implants are the primary treatments for profound deafness. However, the inherently low resolution of electrical stimulation used by these devices limits information transfer to a small number of independent stimulation channels and results in perceptual difficulties. An alternative approach is to target the auditory cortex, a brain region large enough to accommodate hundreds of stimulation channels and whose stimulation evokes sound percepts. Although modern brain interfaces offer large channel counts and spatial resolution, developing encoding algorithms capable of accurately transmitting interpretable sound information remains challenging. Here we introduce Braincodec, a deep network that optimizes both sound information transmission and the alignment of stimulation patterns with the spatial, temporal, and high-level properties of the auditory cortex neural code. Braincodec operates online and requires only a few hundred channels to transmit sufficient information for the reconstruction of natural sounds with high fidelity, a performance inaccessible to cochlear implant encoders. Moreover, mice equipped with a Braincodec-driven auditory cortical prosthesis matched the accuracy of non-implanted mice in discriminating real sounds. Braincodec therefore enables the development of high-throughput cortical neuroprosthetics with the potential to overcome the limitations of current auditory implants and provides a generic framework applicable to other sensory modalities.
来源:bioRxiv · 脑电与神经科学预印本 · biorxiv.org