Learning through ferroelectric domain dynamics in solid-state synapses (opens in new tab)

Who are "we"?

For example, "Almost everybody accepts that the brain does a tremendous amount of analog processing. The controversy lies in whether there is anything digital about it." [1]

[1]: http://www.rle.mit.edu/acbs/pdfpublications/journal_papers/a... (page 30 of the PDF, labelled 1630)

While neural action potentials are binary (either absent or identical to every other AP) they encode temporally an analog signal (internal charge, ion concentration) with amplitude in proportion to frequency.

Most computational biology researchers would be more likely to compare synapses to memristors nowadays.

There's good reason to believe that different parts of the brain are quasi-specialized to particular applications. In a sense, this applies to particular software artificial neural networks (ANN) as well, particularly if the various hyper-parameters are fixed (number of neural units per layer, etc). One of the primary advantages of software ANNs over hardware ANNs (which don't really exist yet) would be the ability to easily change the hyper parameters.

Hardware implementations of ANNs, such as might be designed based on these FTJ-based artificial synapses, would have some fixed hyper parameters, and thus would be pseudo-specialized. This disadvantage could potentially be more than compensated for by a dramatic learning speedup and power-usage reduction. Transistors are highly scaled and low power, but it takes a lot of them and a lot of time to simulate each neural unit.

On a separate note, the best-performing software ANNs don't emulate spike time dependant plasticity, which is believed to be the primary learning mechanism of the human brain. Instead, they use variations of backpropagation and gradient descent, which is almost certainly not how the human brain learns. It remains to be fully understood how the two compare at various tasks. Most likely, they will have different strengths and weaknesses, making each useful in their own right.

At the top of the article, memristors[1] are mentioned -- as artificial synapses they play a key part in the process of adding/removing weight (influence) to various pathways between neurons. This isn't strictly speaking a digital scheme -- a given weight is an analog level that's compared to analog levels from other competing artificial synapses.

The properties of the memristors can be controlled electronically, and by having programmable and persistent resistance to current flow, they play the part of biological synapses.

This entire scheme relies on our gradually improving insight into how biological brains work. As these systems evolve to higher levels of complexity, they become a practical research basis for understanding the human brain.

1. https://en.wikipedia.org/wiki/Memristor

Neither in software or the brain are all the neurons interconnected. There are connections between neurons which are local to each other.

Check methods-- the simulations exhibit sparse coding because the model was built that way, in particular, it assumes LIF (leaky integrate and fire) output neurons that can inhibit each other. In fact, this assumed inhibition is the only reason it works as is. Else, many neurons would probably fire simultaneously in an unstructured crossbar without a set learning rule.

Nevertheless, a STDP type learning rule can inspire interesting applications. One of my co-advisors authored an article [1] which shows a completely unsupervised classification on the MNIST challenge in a crossbar environment, achieving 93 \% . Nothing like state of the art CNNs etc, but considering this was done without labels, that's pretty impressive.

[1]http://www.ief.u-psud.fr/~querlioz/PDF/Querlioz_PIEEE2015.pd...