The Variational Bandwidth Bottleneck: Stochastic Evaluation on an Information Budget
international conference on learning representations, 2020.
Keywords:Variational Information Bottleneck Reinforcement learning
In many applications, it is desirable to extract only the relevant information from complex input data, which involves making a decision about which input features are relevant. The information bottleneck method formalizes this as an information-theoretic optimization problem by maintaining an optimal tradeoff between compression (t...More