Notices by Mikkel Denker (mikkeldenker@mastodon.social)

@andersbiork @peacememories @Cheeseness @aral With that said, I think this is very fair criticism and we should remove it.
Hallucinations is an integrated part of how LLMs work and I haven't seen anyone be able to solve it. At this point, I'm not even sure it can be and I don't think LLMs have any place in search until it's solved.

I'll put it on my todo list to remove it right away.

@andersbiork @peacememories @Cheeseness @aral Thanks for the tag! The model in production is also Mistral which we host on our own server using vllm. The only reason the code references openai is because everyone seems to have settled on that as the standard api.

The summary only shows a couple of lines, so I think it can be seen as an expensive snippet that is only computed on-demand when the user requests it. If one wants more information they need to visit the original site.

[continued]