Liste des Groupes | Revenir à ras written |
On 11/18/2024 10:45 AM, Scott Lurndal wrote:I believe there is a bubble, Regular people are taking AI and buying nvidia shares. I think no surer indication of bubbles can be found than that.Paul S Person <psperson@old.netcom.invalid> writes:>On Mon, 18 Nov 2024 14:12:34 GMT, scott@slp53.sl.home (Scott Lurndal)It is unlikely that there will be anywhere near one million
wrote:
Lynn McGuire <lynnmcguire5@gmail.com> writes:US.On 11/14/2024 9:00 AM, Scott Lurndal wrote:Lynn McGuire <lynnmcguire5@gmail.com> writes:I am on the periphery of the ongoing blanketing of the USA with AI
servers. I have a few facts that might just blow you away.
The expected number of AI servers in the USA alone is presently a
million (SWAG). The current cost for a single AI server is $500,000==20BTW, I should have mentioned that the AI Servers are not uniform in any=1,000,000 x $500,000 =3D $500 billion US of capital.=20
First, What is your source for this data? Be specific.
=20
Second, define precisely what an "AI server" is.parallelof their aspects. I just gave the specs for one of the high end=20Some of us actually produce ML hardware. The term AI is an marketing
machines that the manufacturer has a three month waiting list for.
gimic, not reality.
ML hardware ranges from custom logic in a desktop CPU to massively =specialized hardware (e.g. plug-in GPUs). An ML-enabled server canNvidia.
range from a simple ML accelerator block in the CPU itself (Apple,
Google, Amazon, Marvell) to a large, expensive, power-hungry GPU from =Yes, there are large racks of ML-enabled servers, particularly for1 million of them will rather increase the power requirements,
training. No, they're not really anything special other than using
high-end, high performance CPUs, GPUs and high-speed interconnects
(Infiniband, 100 and 400Gb ethernet). Basically no different
than any supercomputer in scale and power requirements.
possibly causing shortages.
ML training setups, which are the power-hungry setups.
ML Inference requires significantly less horsepower and will
be distributed over millions of laptop/desktop/table systems.
It's just as likely that the hype bubble will burst in the
next 18 months.
""Prediction is very difficult, especially about the future." — Niels Bohr"
https://www.reddit.com/r/quotes/comments/10at8mq/prediction_is_very_difficult_especially_about_the/
>
BTW, my buddy who programs AI Servers at the big dumb company, agrees with you. But they are selling hundreds of the huge AI servers each month and are struggling to meet demand.
>
Lynn
Les messages affichés proviennent d'usenet.