Re: Is Intel exceptionally unsuccessful as an architecture designer?

On Wed, 18 Sep 2024 15:50:09 GMT
scott@slp53.sl.home (Scott Lurndal) wrote:

mitchalsup@aol.com (MitchAlsup1) writes:

On Wed, 18 Sep 2024 1:27:03 +0000, Lawrence D'Oliveiro wrote:
 

On Wed, 18 Sep 2024 00:57:59 +0000, MitchAlsup1 wrote:
 

On Wed, 18 Sep 2024 0:44:44 +0000, Lawrence D'Oliveiro wrote:
 

On Tue, 17 Sep 2024 23:45:50 +0000, MitchAlsup1 wrote:
 

"the CPUs are simply I/O managers to the Inference Engines and
GPUs." 

>
That particular Wheel of Reincarnation will never turn that way.
>
Why? It comes down to RAM. Those addon processors will never have
access to the sheer quantity of RAM that is available to the
CPU. And motherboard-based CPU RAM is upgradeable, as well,
whereas addon cards tend not to offer this option. 

>
He showed a die figure with 256GB of DRAM stacked 8-deep and
2×4-wide. 

>
Was it upgradeable? Or was it soldered in? 

>
Soldered in. 

 
Or in the case of HBM, directly stacked on the processor at the
fab.
 

It's not easy to get 256GB via HBM.
To give one example, Fujitsu A64Fx got only 32GB.
It was 5 years ago and some progress was made since then, but density
improvements nowadays are sloooooooow.