Note: Noise-induced gain modulation (stochastic gating)

In nonlinear stochastic networks, noise can interact with nonlinearities to alter the effective transfer function of neurons. This figure outlines a hypothetical application of this phenomenon. 

Constrained plasticity can compensate for ongoing drift in neural populations

I've started a new postdoc, working on a collaboration between the O'Leary, Ziv, and Harvey labs, on the Human Frontiers Science Program grant, "Building a theory of shifting representations in the mammalian brain". 

To start, I've been working with Adrianna Loback to try to make sense of a puzzling result from Driscoll et al. (2017): the neural code for sensorimotor variables in parietal cortex is unstable, changing dramatically even for habitual tasks in which no learning takes place.

We think the brain might be using a distributed population code. Because there are so many possible ways to read-out a distributed and redundant population code, it could be that there is a stable representation at the population level, despite the apparent instability of single neurons. 

I'll be presenting our work to date as a poster at the UK Neural Computation conference in Nottingham, July 1st-3rd. 

[download poster PDF] 

Abstract:

Recent experiments reveal that neural populations underlying behavior reorganize their tunings over days to weeks, even for routine tasks. How can we reconcile stable behavioral performance with ongoing reconfiguration in the underlying neural populations? We examine drift in the population encoding of learned behaviour in posterior parietal cortex of mice navigating a virtual-reality maze environment. Over five to seven days, we find a subspace of population activity that can partially decode behaviour despite shifts in single-neuron tunings. Additionally, directions of trial-to-trial variability on a single day predict the direction of drift observed on the following day. We conclude that day-to-day drift is concentrated in a subspace that could facilitate stable decoding if trial-to-trial variability lies in an encoding-null space. However, a residual component of drift remains aligned with the task-coding subspace, eventually disrupting a fixed decoder on longer timescales. We illustrate that this slower drift could be compensated in a biologically plausible way, with minimal synaptic weight changes and using a weak error signal. We conjecture that behavioral stability is achieved by active processes that constrain plasticity and drift to directions that preserve decoding, as well as adaptation of brain regions to ongoing changes in the neural code.

This poster can be cited as: 

Rule, M. E., Loback, A. R., Raman, D. V., Harvey, C. D., O'Leary, T. S. (2019) Constrained plasticity can compensate for ongoing drift in neural populations. [Poster] UK Neural Computation 2019, July 1st Nottingham, UK

Exploring a regular-spiking limit of autoregressive point-process models with an absolute refractory period

These notes explore a deterministic limit of Autoregressive Point-Process Generalized Linear Model (AR-PPGLM) of a spiking neuron. We consider a Poisson point process that is either strongly driven or strongly suppressed, and take a limit where spiking output becomes deterministic (and instantaneous rates diverge). This deterministic limit is of interest in clarifying how AR-PPGLM models relate to deterministic models of spiking.

[get as PDF]

Moment-closure approaches to statistical mechanics and inference in models of neural dynamics

At the upcoming SAND meeting in Pittsburgh, I'll be presenting our recent work on using moment closures to combine theoretical models with statistical inference. This work has already been published, but this poster provides a quick summary. 

In my postdoc at Edinburgh, I worked on methods to combine neural field modelling and statistical inference. Neural field models capture how microscopic actions of single neurons combine to create emergent collective dynamics. Statistical modelling of spiking data commonly uses Poisson point-process models. These projects combined the two in an interesting way. 

In "autoregressive point-processes as latent state-space models" [PDF], we convert a popular statistical model for spike-train data into a neural field model. This neural field model is a bit unusual: it extends over time rather than space, and describes correlations as well as mean firing rates. This may lead to new tricks for inference and coarse-graining on these types of models. 

In "neural field models for latent state inference", we use a microscopic model of retinal waves to specify a second-order neural field model that doubles as a latent state-space model for spiking observations. This advances methods for developing data-driven neural field models.

[download poster PDF]

Neural field models for latent state inference

The final paper from my Edinburgh postdoc in the Sanguinetti and Hennig labs (perhaps, we shall see). 

[get PDF]

We combined neural field modelling with point-process latent state inference. Neural field models capture collective population activity like oscillations and spatiotemporal waves. They make the simplifying assumption that neural activity can be summarized by the average firing rate in a region.

High-density electrode array recordings can now record developmental retinal waves in detail. We derived a neural field model for these waves from the microscopic model proposed by Hennig et al.. This model posits that retinal waves are supported by an quiescent, active, and refractory states. 

Fig 3. Spatial 3-state neural-field model exhibits self-organized multi-scale wave phenomena. Simulated example states at selected time-points on a [0,1]² unit interval using a 20×20 grid with effective population density of $\rho{=}50$ cells per unit area, and rate parameters $\sigma{=}0.075$, $\rho_a {=} 0.4$, $\rho_r {=} 3.2 \times 10^{−3}$, $\rho_e {=} 0.028$, and $\rho_q {=} 0.25$ (Methods: Sampling from the model). As, for instance, in neonatal retinal waves, spontaneous excitation of quiescent cells (blue) lead to propagating waves of activity (red), which establish localized patches in which cells are refractory (green) to subsequent wave propagation. Over time, this leads to diverse patterns of waves at a range of spatial scales. 

Moment equations for an autoregressive point process with an absolute refractory period

These notes extend the autoregressive point-process moment closures derived in Rule and Sanguinetti (2018) to models that include an absolute refractory period via a gating term that sets the rate to zero after a spike.

[get notes as PDF]

Gaussian moment-closures for autoregressive GLM population models

[get notes as PDF]

In Rule and Sanguinetti (2008) "Autoregressive Point Processes as Latent State-Space Models" (more at the blog post) we developed moment-closure approximations for the time-evolution of the moments of Autoregressive Point-Process Generalized Linear Models (AR-PPGLMs) of neural activity. These notes generalize these approximations for AR-PPGLM models of neural ensembles . For networks of linear-nonlinear "neurons", the derivations are very similar to the single-neuron case presented in the paper.