Re: Short Vectors Versus Long Vectors

On Wed, 24 Apr 2024 00:57:07 -0600, John Savard wrote:

But they've managed to get GPUs to multiply matrices - and they're quite
good at it, which is why we're having all this amazing progress in AI
recently.

Worth noting that this AI stuff requires very low-precision floats: 16-
bit, even 8-bit. And they sacrifice mantissa bits in favour of exponents--
down to something like maybe only a couple of mantissa bits in the 8-bit
format.