Algorithms of the Mind (opens in new tab)

I think this is an incredibly bad way to try and study the mind. The neural net bears some passing resemblance to a neuron (both have graph connectivity), but the neuron is a biological structure with complex biochemical inputs and outputs. In addition it took us twenty or so years to proceed from simple feed forward neural networks to so-called "deep learning" neural networks. How shallow such networks are when measured against the complexity of an actual neural system is unknown. We may be standing at the shore of a great ocean with one foot in the water congratulating ourselves on our understanding.

Nguyen claims that the renaissance in neural networks will provide us with concepts to understand the human brain in an analogous way to how the steam engine allowed us to conceive of entropy.

I'm not convinced it goes in that direction yet, though. Neural networks are loosely biologically inspired to begin with, and the idea of the primate visual system as a deep feedforward network predates the recent machine learning advances by many years.

If that's true, it undermines his entire thesis. What's missing: how a concept in machine learning allowed us to conceptualize something new in neuroscience, rather than just describe a process we have a vague intuition for (still obviously useful).

FWIW, and I'm a little biased here, I would argue that it's (high-level,vague) concepts in neuroscience that have been driving machine learning. There are ways we behave and learn that we've been trying to emulate in machines. Someday it will swing back the other way, but not yet.

While intriguing, it's important to remember that humankind has always compared the mind to whichever recent technology was available - the catapult, the mill, the steam engine, and eventually, computers. While Deep Neural Networks -- unlike mills -- are of course inspired by what seems to be the actual biology of our brains, and the results are fascinating, it's humbling to keep the above in mind.

The subtitle of the article is "What Machine Learning Teaches Us About Ourselves"; This is backwards. Brain sciences inform ML (In fact, ML techniques are often coined after the biological counterpart). A result or finding in ML does not necessarily, or at all, imply anything for neuroscience.

Artificial neural networks do not teach us about biological neural networks, or 'Neuronal Networks', a term reluctantly used by a close neuroscientist for contradistinction. We don't need Google's cat research, but Hubel and Wiesel's cat research.

Let's see: Cheap reference to Kant, check. Vague parallel to the Sapir-Whorf hypothesis, check.

The 'intriguing' mapping that involves 3 ML terms is desperate.

This article appearing on the front page of HN shows how delusional some of today's ML lovers are with respect to neuroscience, the discipline that actually studies human brains.

Interesting overview of the recognition/imagination duality, but I dislike the tendency to play the game of "oh that's totally what [famous person] must have meant with his dense prose hundreds of years ago."

The author of this article fails to incorporate two relevant prior explorations of this topic: (1) from the Buddhist perspective and (2) from Wilfrid Sellars' work, in particular "Empiricism And The Philosophy Of Mind". The remarks below pertain to the first; the second is beyond my philosophy-fu to say anything meaningful.

Take the idea, "We see with our brains, not with our eyes" as a criticism of the "naive view" that sense data / fabrications are neutral, that they are just "out there", and it is only when they come into contact with the mind that the mind infuses the raw sense data with desire and aversion. The idea that we are just passive observers of phenomena.

Thanissaro Bhikkhu critiques this idea from the Buddhist perspective:

"040920 Disenchantment & Dispassion \ \ Thanissaro Bhikkhu \ \ Dhamma Talks" https://www.youtube.com/watch?v=k8M-_Msav1Q

He says that on the contrary, desire and aversion are involved a priori in the formation of the fabrications (sense data).

So this is not a new idea. It is a very old idea. The idea that the technology of ML can confirm this particular critique of the naive view is novel (although I'm not convinced it is wise to draw conclusions about the mind in this way, just as I'm not convinced it is wise to draw conclusions about the way evolution operates based on artificial life simulations).

There are two contradictory claims:

1. The brain is like a neural network (which is purely logical) in the sense of ML.

2. Human brains cannot be explained by purely logical things.

The author also uses "concept," which is a technical term in computational learning theory with a specific meaning, as if it meant "intuition." How can you present "intuition" to a neural network? This distinction is swept under the rug. Not to mention all the recent work showing how easily neural networks can be fooled by slightly adversarially noisy inputs.

There are many grains of salt required for a useful discussion on neural networks. Instead of taking something we have no understanding of and making grand philosophical claims, we should be using the tools we have to understand that thing.

The field of computational cognitive neuroscience studies the mind as a machine learning algorithm.

http://grey.colorado.edu/CompCogNeuro

I was immediately put off when the author trotted out Sapir-Whorf; and, not even apologetically: in its strong form! Everything in the article became suspect. S-W is not correct, end of story.

Oh god, please stop it with the medium.com, quantamagazine, and other dumbed down TED talk crowd 'news' sites. Can't you please link to the original articles?