Showing posts with label latent variables. Show all posts
Showing posts with label latent variables. Show all posts

Tuesday, July 10, 2018

Approximations of the measurement update and model likelihood for nonlinear spatiotemporal Cox processes

Epilogue: These notes were part of a project to infer unobserved ("latent") states in a neural field model, as well as the parameters of that model, from spiking observations. It has since been published. Ultimately, for speed we ended up selecting the Laplace approximation for the measurement update, solved via Newton-Raphson.

[get PDF]

We are interested in approximations to the measurement update for a spatially-extended latent-variable point-process, where the latent variables are also spatial fields that undergo dynamics similar to chemical reaction-diffusion systems. 

The latent variables or fields are concentrations, activations, or some similar physical quantity. They are therefore constrained to be non-negative, and also typically must obey conservation laws. Additionally, the observed point-process intensity field must also be constrained to be non-negative. 

Such systems arise in chemical reaction diffusion systems, epidemiological models, and neural field models, where the measurement is a point-process that is coupled indirectly to the latent spatiotemporal system.

Wednesday, January 16, 2013

Impact of redundancy on stable decoding

[get notes as PDF]

Neural activity is redundant: many states in motor cortex can generate similar movements. When we record from motor cortex, we capture only a small fraction of the total neurons. Redundancy makes it possible to observe the overall state of motor cortex from limited observations, but might also impair the generalization performance of a linear decoder.

Consider two neurons, $A$ and $B$, that combine linearly to produce movement $C{=}\alpha_1 A{+} \alpha_2 B$. (Perhaps both neurons drive the same targets in spinal cord.) An animal could use any linear combination of activations of units $A$ and $B$ to perform behavior $C$, so long as the sum $\alpha_1{+}\alpha_2$ is constant. What if there is an unobserved variable $\gamma$ that sets whether neuron $A$ or $B$ is used more (Fig. 1)?


Figure 1: (simulated hypothetical scenario) Neural signals $A$ and $B$ combine linearly according to weight $\gamma$ to form behavioral output $C=\gamma A + (1-\gamma) B$. Parameter $\gamma$ modulates sinusoidally between $0.25$ and $0.75$.