Information-theoretic analysis of a dynamic release site using a two-channel model of depression

Synapses are dynamic communication channels between neurons as their rates of information transfer depend on past history. While information theory has been used to study the information efficacy of synapses [1-3], the effect of synaptic dynamics, including short-term depression and facilitation, on the information rate is not yet fully understood.To reduce the complexity of the problem, we confine ourselves here to a single release site of the synapse. This allows us to analytically calculate the information transfer at the release site for a simple model of synaptic depression which is based on binary channels. The input of the model is a spike train, modeled by an independent identically distributed process X={Xi}i=1∞, where each Xi has a Bernoulli distribution with P(Xi = 0) = α. The modelu0027s output is a process Y={Yi}i=1∞, such that if there is a release at time, then Yi = 1 and otherwise Yi = 0. We model the short term depression by two binary asymmetric channels that represent the possible states of the release site: the u0027recoveredu0027 state, when no release occurred in the previous time step (Figure ​(Figure1a),1a), and the u0027usedu0027 state, following vesicle release (Figure ​(Figure1b).1b). In particular, we assume that the release probability is reduced following a release, that is p2 ≤ p1 and 1 - q2 ≤ 1 - q1.Figure 1Each individual channel in Figure ​Figure11 will have a mutual information rate, either r1 or r2. As Xi is Bernoulli-distributed, ri=h(αpi+α¯qi¯)-αh(pi)-α¯h(qi¯) for i = 1,2, where h(·) is the entropy of a Bernoulli random variable and x¯=1-x. We prove that the mutual information rate of the release site with depression is a linear summation of the information rates of these two channels. The mutual information rate I(X;Y) between the input process X nd the output process Y, is I(X;Y) = θr1 + (1 - θ)r2 where θ=αp2¯+α¯q2α(p1+p2¯)+α(q1¯+q2)The closed form expression of the mutual information rate allows us to study the effect of depression analytically. Through simulations we show that for a range of parameters, depression improves the rate of information transfer at the release site. We also show that when the level of depression is increased (i.e., with smaller p2 and larger q2), the release siteu0027s information capacity is reached at lower input spike rates. Therefore, the optimal spike rate of the presynaptic neuron has a reverse relationship with the depression level of its release site. This means that synaptic depression can save energy while maintaining information rate. The two-channel model of release site is a building block for the construction of more precise models of synaptic transmission. These advanced models will enable us to evaluate and study the synaptic information rates analytically.