Title:A Radically New Theory of how the Brain Represents and Computes with Probabilities

Abstract:It is widely acknowledged that the brain i) implements probabilistic reasoning, and ii) represents information via population/distributed coding. Most previous population-based probabilistic (PPC) theories share several basic properties: 1) continuous (graded) neurons; 2) full/dense distributed coding: all/most coding field neurons formally participate in every code; 3) graded synapses; 4) rate coding; individual neurons are assumed to 5) have unimodal, e.g., bell-shaped, tuning functions (TFs) and 6) be fundamentally noisy; and 7) noise/correlation are generally viewed as problems requiring mitigation. In contrast, our theory assumes: 1) binary neurons; 2) only a small subset of neurons, i.e., a sparse distributed code (SDC), comprises any individual code; 3) binary synapses; 4) formally requires only single, i.e., first, spikes; individual neurons 5) initially have completely flat TFs (all weights zero) and 6) are not noisy; and 7) noise is a resource generated and used to cause similar inputs to map to similar codes, which controls a tradeoff between storage capacity and embedding the input space statistics in the pattern of intersections over the codes, indirectly yielding particular correlation patterns. The theory, Sparsey, was introduced 20 years ago as a canonical cortical circuit/algorithm model, but not discussed as a probabilistic model. Assuming input similarity correlates with likelihood, the active SDC code simultaneously represents both the most probable hypothesis and the full probability distribution. We show this for spatial and spatiotemporal (sequential) cases. Finally, consistent with moving beyond the Neuron Doctrine to the view that the SDC (cell assembly, ensemble) is the atomic unit of neural representation, Sparsey suggests that classical unimodal TFs emerge as an artifact of a single/few-trial learning process in which SDC codes are laid down in superposition.