@kaia @Wrest have you tried just using openclip for the embedding and tagging those in a vector db? then you can ask if its within some similarity bound from a tagged image.

i tried clustering bert output with annoy but found it didn't do the best job getting similar text together, but manually tagging examples does sort of ok