BFP for DNN Architectures

This chapter explores the use of the block floating point number system as an alternative to traditional fixed point and floating point number systems in deep neural network implementations. We begin by providing an overview of BFP and explaining how it differs from FLP and FXP. Next, we discuss the factors that can impact the performance of BFP in DNN acceleration, drawing from existing literature to identify the best practices for optimizing BFP performance. Finally, we present quantitative comparisons of various works that have utilized BFP for DNNs, demonstrating its potential as an effective tool for accelerating DNN computations.