Tolerating Noise Effects in Processing-in-Memory Systems for Neural Networks: A Hardware-Software Codesign Perspective

ADVANCED INTELLIGENT SYSTEMS(2022)

引用 30|浏览3
暂无评分
摘要
Neural networks have been widely used for advanced tasks from image recognition to natural language processing. Many recent works focus on improving the efficiency of executing neural networks in diverse applications. Researchers have advocated processing-in-memory (PIM) architecture as a promising candidate for training and testing neural networks because PIM design can reduce the communication cost between storage and computing units. However, there exist noises in the PIM system generated from the intrinsic physical properties of both memory devices and the peripheral circuits. The noises introduce challenges in stably training the systems and achieving high test performance, e.g., accuracy in classification tasks. This review discusses the current approaches to tolerating noise effects for both training and inference in PIM systems and provides an analysis from a hardware-software codesign perspective. Noise-tolerant strategies for PIM systems based on resistive random-access memory (ReRAM), including circuit-level, algorithm-level, and system-level solutions are explained. In addition, we also present some selected noise-tolerate cases in PIM systems for generative adversarial networks and physical neural networks.
更多
查看译文
关键词
hardware-software codesign, noise, processing-in-memory, resistive random-access memory
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要