Re: ongoing infrastructure changes with AI in the USA

Liste des GroupesRevenir à ras written 
Sujet : Re: ongoing infrastructure changes with AI in the USA
De : psperson (at) *nospam* old.netcom.invalid (Paul S Person)
Groupes : rec.arts.sf.written
Date : 16. Nov 2024, 18:02:02
Autres entêtes
Organisation : A noiseless patient Spider
Message-ID : <krjhjjhhk1c74fbqad60omphc01urapapc@4ax.com>
References : 1 2 3 4 5 6 7
User-Agent : ForteAgent/8.00.32.1272
On Fri, 15 Nov 2024 22:09:57 +0100, D <nospam@example.net> wrote:

>
>
On Fri, 15 Nov 2024, Lynn McGuire wrote:
>
On 11/15/2024 3:23 AM, D wrote:
 
 
On Thu, 14 Nov 2024, Lynn McGuire wrote:
 
On 11/14/2024 2:18 PM, D wrote:
 
 
On Thu, 14 Nov 2024, Scott Lurndal wrote:
 
Lynn McGuire <lynnmcguire5@gmail.com> writes:
I am on the periphery of the ongoing blanketing of the USA with AI
servers.  I have a few facts that might just blow you away.
 
The expected number of AI servers in the USA alone is presently a
million (SWAG).  The current cost for a single AI server is $500,000
US.
   1,000,000 x $500,000 = $500 billion US of capital.
 
First, What is your source for this data?  Be specific.
 
Second, define precisely what an "AI server" is.
 
My guess would be a server stuffed with GPU:s.
 
1. A huge rackmount frame the size of a refrigerator
2. Two Intel Zeons with 64 or 128 cpus each
3. Many terabytes of ram in 20 to 40 memory slots
4. 10 to 40 SSD hard drives of 1 TB to 8 TB
5. four to twelve Nvidea H100 or H200 boards
6. multiple power supplies
7. etc, etc, etc, etc, etc, etc
 
In other words, it looks like a 1980s / 1990s mini computer in a rack
configuration with many swapable / upgradable modules.
 
Here is just one variant:
https://www.dell.com/en-us/dt/servers/specialty-servers/poweredge-xe-
servers.htm#scroll=off&tab0=0&accordion0
 
Lynn
 
Just what I would have expected! It will be fun if there's another AI-
winter. Then we'll be eating GPU:s for breakfast given all the oversupply
that will exist! When do you think disillusionment will set in (if at all)?
>
The AI disillusionment will start when the companies try to layoff their
customer support departments and find out that they cannot do so.
>
Lynn
>
Let us study the example of Klarna with great interest! I think they did
exactly that. Instead of having people answering questions about loans and
credit, they will let the LLM:s do it and I then assume have a vastly
smaller teams of humans catching the hallucinations and edge cases.

Most of the companies I have had to try to deal with over the past few
years are heavily protected by automated telephone/online chat trees
which /never/ get you to an actual person. The closest one came was to
offer me the option of using my phone to chat with one. Sadly, my
phone doesn't do that; it's very primitive.

IOW, they only want to hear about the problems they can imagine you
might have and so have solutions for. Anything else is of no interest
to them.
--
"Here lies the Tuscan poet Aretino,
Who evil spoke of everyone but God,
Giving as his excuse, 'I never knew him.'"

Date Sujet#  Auteur
14 Nov 24 * ongoing infrastructure changes with AI in the USA38Lynn McGuire
14 Nov 24 +* Re: ongoing infrastructure changes with AI in the USA2Paul S Person
15 Nov 24 i`- Re: ongoing infrastructure changes with AI in the USA1Paul S Person
14 Nov 24 +* Re: ongoing infrastructure changes with AI in the USA23D
15 Nov 24 i+* Re: ongoing infrastructure changes with AI in the USA21Lynn McGuire
15 Nov 24 ii`* Re: ongoing infrastructure changes with AI in the USA20D
15 Nov 24 ii `* Re: ongoing infrastructure changes with AI in the USA19Lynn McGuire
15 Nov 24 ii  `* Re: ongoing infrastructure changes with AI in the USA18D
16 Nov 24 ii   `* Re: ongoing infrastructure changes with AI in the USA17Paul S Person
17 Nov 24 ii    `* Re: ongoing infrastructure changes with AI in the USA16Gary R. Schmidt
17 Nov 24 ii     `* Re: ongoing infrastructure changes with AI in the USA15Paul S Person
17 Nov 24 ii      +- Re: ongoing infrastructure changes with AI in the USA1Cryptoengineer
18 Nov 24 ii      `* Re: ongoing infrastructure changes with AI in the USA13Jay E. Morris
18 Nov 24 ii       `* Re: ongoing infrastructure changes with AI in the USA12Paul S Person
18 Nov 24 ii        `* Re: ongoing infrastructure changes with AI in the USA11Jay E. Morris
18 Nov 24 ii         `* Re: ongoing infrastructure changes with AI in the USA10Jay E. Morris
19 Nov 24 ii          `* Re: ongoing infrastructure changes with AI in the USA9Paul S Person
19 Nov 24 ii           +- Re: ongoing infrastructure changes with AI in the USA1Jay E. Morris
19 Nov 24 ii           `* Re: ongoing infrastructure changes with AI in the USA7Cryptoengineer
19 Nov 24 ii            `* Re: ongoing infrastructure changes with AI in the USA6Garrett Wollman
20 Nov 24 ii             `* Re: ongoing infrastructure changes with AI in the USA5Jay E. Morris
20 Nov 24 ii              +* Re: ongoing infrastructure changes with AI in the USA3Cryptoengineer
20 Nov 24 ii              i`* Re: ongoing infrastructure changes with AI in the USA2ted@loft.tnolan.com (Ted Nolan
21 Nov 24 ii              i `- Re: ongoing infrastructure changes with AI in the USA1Jay E. Morris
20 Nov 24 ii              `- Re: ongoing infrastructure changes with AI in the USA1Paul S Person
15 Nov 24 i`- Re: ongoing infrastructure changes with AI in the USA1Garrett Wollman
15 Nov 24 +* Re: ongoing infrastructure changes with AI in the USA3Titus G
15 Nov 24 i`* Re: ongoing infrastructure changes with AI in the USA2Lynn McGuire
15 Nov 24 i `- Re: ongoing infrastructure changes with AI in the USA1Titus G
15 Nov 24 +* Re: ongoing infrastructure changes with AI in the USA5William Hyde
15 Nov 24 i`* Re: ongoing infrastructure changes with AI in the USA4Lynn McGuire
16 Nov 24 i +* Re: ongoing infrastructure changes with AI in the USA2William Hyde
16 Nov 24 i i`- Re: ongoing infrastructure changes with AI in the USA1Bobbie Sellers
16 Nov 24 i `- Re: ongoing infrastructure changes with AI in the USA1Paul S Person
17 Nov 24 `* Re: ongoing infrastructure changes with AI in the USA4Lynn McGuire
18 Nov 24  `* Re: ongoing infrastructure changes with AI in the USA3Paul S Person
18 Nov 24   `* Re: ongoing infrastructure changes with AI in the USA2Lynn McGuire
19 Nov 24    `- Re: ongoing infrastructure changes with AI in the USA1D

Haut de la page

Les messages affichés proviennent d'usenet.

NewsPortal