Will a decoder-only transformer also work? (Was: Spring 2025 Challenge: TicTacToe Transformer)

Liste des GroupesRevenir à cl prolog 
Sujet : Will a decoder-only transformer also work? (Was: Spring 2025 Challenge: TicTacToe Transformer)
De : janburse (at) *nospam* fastmail.fm (Mild Shock)
Groupes : comp.lang.prolog
Date : 02. Mar 2025, 03:49:32
Autres entêtes
Message-ID : <vq0gvr$tuur$1@solani.org>
References : 1
User-Agent : Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:128.0) Gecko/20100101 Firefox/128.0 SeaMonkey/2.53.20
Ok, my bad. You can of course also try a decoder-only.
Just like here in this Python code example:
 > **Simple PyTorch Implementation of “Grokking”**
 > We trained a standard decoder-only transformer (Vaswani et al., 2017)
 > https://github.com/teddykoker/grokking
The transformer need not necessarely have a encoder and
a latent space. It can be also a decoder-only.
Mild Shock schrieb:
 Very simple challenge conceptually, develop the idea
of Centipawn towards TicTacToe and implement the
game based on learning / training a transformer, and
 then executing it. All written in Prolog itself! Optional
bonus exercise, make the execution ИИUƎ style, i.e.
incremental evaluation of the transformer.
 Centipawn - Chess Wiki
https://chess.fandom.com/wiki/Centipawn
 NNUE - Chess Programming Wiki
https://www.chessprogramming.org/NNUE

Date Sujet#  Auteur
24 Feb 25 * Spring 2025 Challenge: TicTacToe Transformer5Mild Shock
25 Feb 25 +* Dead horse or wake up call? (Was: Spring 2025 Challenge: TicTacToe Transformer)2Mild Shock
25 Feb 25 i`- Some Progress with SWI-Prolog eForests (Re: Dead horse or wake up call?)1Mild Shock
2 Mar 25 `* Will a decoder-only transformer also work? (Was: Spring 2025 Challenge: TicTacToe Transformer)2Mild Shock
2 Mar 25  `- I didn't invent these things (Was: Will a decoder-only transformer also work?)1Mild Shock

Haut de la page

Les messages affichés proviennent d'usenet.

NewsPortal