Noninvasive Tracking of Every Individual in Unmarked Mouse Groups Using Multi-Camera Fusion and Deep Learning

查看全文 作　　者：Feng [1,2,3,4]Su;Yangzhen [5]Wang;Mengping [1]Wei;Chong [6]Wang;Shaoli [7]Wang;Lei [1]Yang;Jianmin [8]Li;Peijiang [9]Yuan;Dong-Gen [4]Luo;Chen [1,2,3]Zhang 机构地区：[1]Department of Neurobiology,School of Basic Medical Sciences,Beijing Key Laboratory of Neural Regeneration and Repair,Capital Medical University,Beijing,100069,China;[2]Chinese Institute for Brain Research,Beijing,102206,China;[3]State Key Laboratory of Translational Medicine and Innovative Drug Development,Nanjing,210000,China;[4]Peking-Tsinghua Center for Life Sciences,Academy for Advanced Interdisciplinary Studies,Peking University,Beijing,100871,China;[5]School of Life Sciences,Tsinghua University,Beijing,100084,China;[6]School of Biological Science and Medical Engineering,Beihang University,Beijing,100191,China;[7]The Key Laboratory of Developmental Genes and Human Disease,Institute of Life Sciences,Southeast University,Nanjing,210096,Jiangsu,China;[8]Institute for Artificial Intelligence,the State Key Laboratory of Intelligence Technology and Systems,Beijing National Research Center for Information Science and Technology,Department of Computer Science and Technology,Tsinghua University,Beijing,100084,China;[9]School of Mechanical Engineering and Automation,Beihang University,Beijing,100191,China 出　　处：《Neuroscience Bulletin》索引2023年第39卷第6期,共18页 基　　金：supported by grants from the National Key R&D Program of China(2017YFA0105201);the National Natural Science Foundation of China(81925011,92149304,31900698,32170954,and 32100763;the Key-Area Research and Development Program of Guangdong Province(2019B030335001);The Youth Beijing Scholars Program(015),Support Project of High-level Teachers in Beijing Municipal Universities(CIT&TCD20190334);Beijing Advanced Innovation Center for Big Data-based Precision Medicine,Capital Medical University,Beijing,China(PXM2021_014226_000026). 摘　　要：Accurate and efficient methods for identifying and tracking each animal in a group are needed to study complex behaviors and social interactions.Traditional tracking methods(e.g.,marking each animal with dye or surgically implanting microchips)can be invasive and may have an impact on the social behavior being measured.To overcome these shortcomings,video-based methods for tracking unmarked animals,such as fruit flies and zebrafish,have been developed.However,tracking individual mice in a group remains a challenging problem because of their flexible body and complicated interaction patterns.In this study,we report the development of a multi-object tracker for mice that uses the Faster region-based convolutional neural network(R-CNN)deep learning algorithm with geometric transformations in combination with multi-camera/multi-image fusion technology.The system successfully tracked every individual in groups of unmarked mice and was applied to investigate chasing behavior.The proposed system constitutes a step forward in the noninvasive tracking of individual mice engaged in social behavior. 关 键 词：Noninvasive tracking Deep learning MULTI-CAMERA Mouse group Social interaction