Sujet : Re: ongoing infrastructure changes with AI in the USA
De : lynnmcguire5 (at) *nospam* gmail.com (Lynn McGuire)
Groupes : rec.arts.sf.writtenDate : 14. Nov 2024, 23:39:56
Autres entêtes
Organisation : A noiseless patient Spider
Message-ID : <vh5u7s$3139m$4@dont-email.me>
References : 1 2 3
User-Agent : Mozilla Thunderbird
On 11/14/2024 2:18 PM, D wrote:
On Thu, 14 Nov 2024, Scott Lurndal wrote:
Lynn McGuire <lynnmcguire5@gmail.com> writes:
I am on the periphery of the ongoing blanketing of the USA with AI
servers. I have a few facts that might just blow you away.
>
The expected number of AI servers in the USA alone is presently a
million (SWAG). The current cost for a single AI server is $500,000 US.
1,000,000 x $500,000 = $500 billion US of capital.
>
First, What is your source for this data? Be specific.
>
Second, define precisely what an "AI server" is.
My guess would be a server stuffed with GPU:s.
1. A huge rackmount frame the size of a refrigerator
2. Two Intel Zeons with 64 or 128 cpus each
3. Many terabytes of ram in 20 to 40 memory slots
4. 10 to 40 SSD hard drives of 1 TB to 8 TB
5. four to twelve Nvidea H100 or H200 boards
6. multiple power supplies
7. etc, etc, etc, etc, etc, etc
In other words, it looks like a 1980s / 1990s mini computer in a rack configuration with many swapable / upgradable modules.
Here is just one variant:
https://www.dell.com/en-us/dt/servers/specialty-servers/poweredge-xe-servers.htm#scroll=off&tab0=0&accordion0Lynn