Embed Notice

@HauntedOwlbear Naturally, 2k goes fast, so there's a few techniques to work on this, some of which are 'ok, but not just a FILO list of tokens, but instead we'll be smart about it...' and also, you have:
RAG - retrieval augmented generation, aka 'get a little extra info and send that along with the prompt', which you CAN do with your own chatlogs
or
'Always send X thing with the prompt, every time', which is what Silly Tavern does.