@s8n my brain is too zonked right now to contemplate how this knowledge could be used with mamba networks somehow.

i remember seeing those months ago and state space models were crushing LLMs in some ways.

i'm not sure if these could be merged in some meaningful way to make a language machine capable of real-time learning :cirno_what: