iced depresso (icedquinn@blob.cat)'s status on Wednesday, 22-May-2024 14:49:33 JST
-
Embed this notice
@gentoobro @hazlin the simulacrums are passing turing tests, they just don't have the ability to actually learn anything. and they never will with the current doctrine.
i think numenta was very close. they had some small models learning in real time (i think still a thousand iterations of learning, but they're using hebbian stuff.) i had some thoughts about the way they did that and dividing the model in to banks of "tapes" where you could somehow accumulate the error across those and pull up whichever tape is worst, and subject only that to ongoing training for a bit, which is kinda close to what the hippocampus actually does.