Different Tokens, Different Compute in LLMs
In Mixture-of-Recursions, a learned router decides which tokens continue through additional passes of the same transformer layers. Some tokens take one pass, others two or three. An excerpt from my longer video on looped transformers: https://www.youtube.com/watch?v=KT4n-z_4QJU
Discussion
Rejoignez la communauté pour réagir et poser vos questions.
Aucun message pour l'instant. Lancez la discussion !