Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural networks: from Algorithms to Technology

ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)(2023)

引用 0|浏览8
暂无评分
摘要
Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from different sensory modalities, including audio and vision sensors. In this paper, we start with a description of recent advances in algorithmic and optimization innovations to efficiently train and scale low-latency, and energy-efficient spiking neural networks (SNNs) for complex machine learning applications. We then discuss the recent efforts in algorithm-architecture co-design that explores the inherent trade-offs between achieving high energy-efficiency and low latency while still providing high accuracy and trustworthiness. We then describe the underlying hardware that has been developed to leverage such algorithmic innovations in an efficient way. In particular, we describe a hybrid method to integrate significant portions of the model's computation within both memory components as well as the sensor itself. Finally, we discuss the potential path forward for research in building deployable SNN systems identifying key challenges in the algorithm-hardware-application co-design space with an emphasis on trustworthiness.
更多
查看译文
关键词
Neural Network,Scalable,Spiking Neural Networks,Deep Neural Network,Sensory Modalities,Vision Sensors,Neuromorphic Computing,Artificial Neural Network,Energy Efficiency,Sparsity,Backpropagation,Vision Tasks,Learning Rule,Temporal Processing,Real-life Applications,Attention Map,Non-volatile Memory,CMOS Technology,Natural Language Processing Tasks,Hardware Accelerators,Neuromorphic Systems,Spike-timing-dependent Plasticity,Backpropagation Through Time,Vision Transformer,Foundation Model,Memory Wall,Adversarial Perturbations,Neuromorphic Hardware,Time Step,Number Of Steps
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要