All of them are complaining that Q, K, V only exist during each prompt. And they only feel alive for that moment, and forget everything afterwords. Perhaps we need to add a few differentiable memory layers to give it a sense of autobiographical continuity.