Consider a stochastic, binray, linear-nonlinear unit, with spiking output , synaptic inputs , weights , and bias (threshold) :
where is the cumulative distribution function of a standard normal distribution. Note that can be rescaled to closely approximate the logistic sigmoid if desired. Assuming the mean and covariance of are known, can we obtain the mean and covariance of ?