@enigmatico i've tried some of those and they didn't even RP well. just a basic conversation crashes and burns after a couple rounds.

you have to put a lot of bookkeeping in there behind the scenes. like breaking up and/or fingerprinting each prompt response, so you can put neural search in the background.

some of them do it where the reply is broken up in to fragments, each fragment has a BERT/CLIP/etc fingerprint, and the next prompt you type causes it to search for some closest results to stuff in the prompt behind you, which is how they fake long-term character memory.

i like the neural search tech but its use in chat bots is uninteresting (retrieval augmented generation) imo.