Re: Is Intel exceptionally unsuccessful as an architecture designer?

On Wed, 18 Sep 2024 19:00:27 +0300, Michael S wrote:

mitchalsup@aol.com (MitchAlsup1) writes:
>

On Wed, 18 Sep 2024 1:27:03 +0000, Lawrence D'Oliveiro wrote:
 

On Wed, 18 Sep 2024 00:57:59 +0000, MitchAlsup1 wrote:
 

On Wed, 18 Sep 2024 0:44:44 +0000, Lawrence D'Oliveiro wrote:
 

On Tue, 17 Sep 2024 23:45:50 +0000, MitchAlsup1 wrote:
 

"the CPUs are simply I/O managers to the Inference Engines and
GPUs."

>
That particular Wheel of Reincarnation will never turn that way.
>
Why? It comes down to RAM. Those addon processors will never have
access to the sheer quantity of RAM that is available to the CPU.
And motherboard-based CPU RAM is upgradeable, as well, whereas
addon cards tend not to offer this option.

>
He showed a die figure with 256GB of DRAM stacked 8-deep and
2×4-wide.

>
Was it upgradeable? Or was it soldered in?

>

Soldered in.

 

It's not easy to get 256GB via HBM.
To give one example, Fujitsu A64Fx got only 32GB.
It was 5 years ago and some progress was made since then, but density
improvements nowadays are sloooooooow.

The basic issue is:

* CPU+motherboard RAM -- usually upgradeable
* Addon coprocessor RAM -- usually not upgradeable

If all these special-purpose processors could share RAM coming from the
same pool, the addon coprocessors would become a lot more useful.