Sujet : no more matrix multiplication needed in LLMs?
De : alien (at) *nospam* comet.invalid (Jan Panteltje)
Groupes : sci.electronics.designDate : 26. Jun 2024, 07:16:32
Autres entêtes
Message-ID : <v5g87h$25m9e$1@solani.org>
User-Agent : NewsFleX-1.5.7.5 (Linux-5.15.32-v7l+)
Researchers upend AI status quo by eliminating matrix multiplication in LLMs
Running AI models without matrix math means far less power consumption—and fewer GPUs?
https://arstechnica.com/information-technology/2024/06/researchers-upend-ai-status-quo-by-eliminating-matrix-multiplication-in-llms/So, low power and cheaper AI?
Bye bye Nvidia?