Re: GNU/Linux is the Empowerment of the PC. So What Do You Do?

On Tue, 9 Apr 2024 17:26:12 -0400, Chris Ahlstrom wrote:

I've seen some interesting books about neural logic circuits, but circa
1980.

Rumelhart and McClelland's 'Parallel Distributed Processing' was the text
used in a seminar I took that summed up the state of the art. The
perceptron went back to McColloch and Pitts in 1944. It was a start but
had problems some of which were pointed out by Minsky. Hopfield came up
with the network named after him. Rumelhart and Hinton threw in back
propagation based on gradient descent in an '86 paper.

Anyway, read the current literature and you'll see a lot of what was
discussed in the '80s. The problem was hardware. Nvidia is making big
bucks producing $40,000+ GPUs that can handle all the matrix operations
involved. That sort of power wasn't available in the '80s outside of a few
supercomputers and even they might have been breathing heavy.

The other problem was the inevitable hype that oversold NNs.

https://www.skynettoday.com/overviews/neural-net-history

It may be tl;dr but if you're interested that covers the history very
well. It's telling that 'neural network' became a little toxic amid the
stumbles over the years and became 'machine learning'. Having watched the
technology waxing and waning for close to 40 years I don't know if the
current boom will become a bust.

https://mitsloan.mit.edu/ideas-made-to-matter/why-neural-net-pioneer-
geoffrey-hinton-sounding-alarm-ai

Hinton is entering "what have we wrought?" territory. McClelland seems to
be optimistic still.

https://deepai.org/profile/james-mcclelland

Rumelhart died relatively young before AI became a headline item.