Liste des Groupes | Revenir à c arch |
On Wed, 18 Sep 2024 15:50:09 GMT<https://www.servethehome.com/micron-hbm3e-12-high-36gb-higher-capacity-ai-accelerators-shipping/>
scott@slp53.sl.home (Scott Lurndal) wrote:
mitchalsup@aol.com (MitchAlsup1) writes:It's not easy to get 256GB via HBM.On Wed, 18 Sep 2024 1:27:03 +0000, Lawrence D'Oliveiro wrote:>
On Wed, 18 Sep 2024 00:57:59 +0000, MitchAlsup1 wrote:>
On Wed, 18 Sep 2024 0:44:44 +0000, Lawrence D'Oliveiro wrote:>
On Tue, 17 Sep 2024 23:45:50 +0000, MitchAlsup1 wrote:>
"the CPUs are simply I/O managers to the Inference Engines and>
GPUs."
That particular Wheel of Reincarnation will never turn that way.
>
Why? It comes down to RAM. Those addon processors will never have
access to the sheer quantity of RAM that is available to the
CPU. And motherboard-based CPU RAM is upgradeable, as well,
whereas addon cards tend not to offer this option.
He showed a die figure with 256GB of DRAM stacked 8-deep and
2×4-wide.
Was it upgradeable? Or was it soldered in?
Soldered in.
Or in the case of HBM, directly stacked on the processor at the
fab.
>
To give one example, Fujitsu A64Fx got only 32GB.
It was 5 years ago and some progress was made since then, but density
improvements nowadays are sloooooooow.
Les messages affichés proviennent d'usenet.