@eaton
Well said.
Admittedly, my experience with training and designing neural networks is limited, but wouldn't it be only slightly more computation to create a high level meta neural network that reaches into the LLM and estimates some attributes of the current LLM context, by attaching to specific neuron outputs?
The attributes could be level of confidence through time, expected response time, etc. Then just create a UI program from the output of that meta neural net realtime value