Optimal decision making with biologically realistic neural signals

Action selection in animals requires rapid decision making that can discriminate the most salient requests for behavioral expression. The basal ganglia (BG) are believed to play a critical role in resolving competition between these requests [1] and, recently it has been proposed that the BG and cortex, taken together, implement a decision algorithm known as the multi-hypothesis sequential probability ratio test (MSPRT) [2]. Here, the cortex first integrates noisy ‘evidence’ indicating salience of action requests. The BG then examine this integrated evidence, and report the channel with maximal mean salience. The MSPRT is optimal in the sense that it guarantees the smallest decision time for a given error. The signals used in [2] assume cortical evidence - as neural firing rates - is supplied by Gaussian distributed signals. However, it is known that such rates are not distributed normally.

To remedy this we have deduced three new forms for MSPRT that are based on more biologically realistic input signals. They include the Inverse Gaussian, Gamma and Lognormal distributions. All implementations preserve a form which could be mapped, in principle, onto the anatomy of the BG. Figure 1 shows an example of the performance of the MSPRT models across all distributions, together with the so called race model. All variants used the same input statistics (mean and variance). Counterintuitively, the relative performance of the models did not change with base level of salience or evidence.

Figure 1

Performance of original Gaussian MSPRT[2], new implementations of MSPRT, and Race model. Performance is measured as decision time against number of alternatives for selection. The selection criterion was 1% error rate. The results are averaged across 500 simulations and error bars show 1 standard deviation.

A critical parameter in the algorithm is the time step Δt used to sample the cortical input. The Gaussian, Inverse Gaussian, and Gamma cases are generated as stable Lévy processes and may be scaled indefinitely with decreasing Δt. However, unlike the MSPRT with Gaussian signals, we show that decision time for the inverse Gaussian, and Gamma decreases with Δt. Figure 1 use a Δt = 1 ms for all models and clearly shows a performance advantage for the cases with more realistic distributions (the lognormal case is shown with similar scaling even though it has not an associated Lévy process). Indefinitely small decision times may appear unrealistic, but we present an interpretation of cortical sampling that relates Δt to the inter-spike intervals of an ensemble of neural afferents impinging on the cortical ‘integrators’. This and, other mechanisms, provide a natural lower bound for Δt. We conclude that neurons may take advantage of the properties of natural spike trains to enhance decision making in the cortex-BG complex.