Yeah that was REALLY finicky to get right. I have a few ways to prevent hallucinations and I haven't gotten any in the latest iteration even with really crazy questions being asked. (I encourage you to try to break it).
This is partly why I show the source Snippets (Q/A Pairs written directly by the owner) below the summary as a way to verify the information. Kind of like the AI 'showing it's work. It also let's see more about the owner which is a nice side benefit, or maybe the main benefit.
I can also turn off the AI summary part and leave the AI search part. If this becomes a bigger thing, I might give users a way to enable/disable the potentially hallucinogenic part, but it'll be their choice.
This is partly why I show the source Snippets (Q/A Pairs written directly by the owner) below the summary as a way to verify the information. Kind of like the AI 'showing it's work. It also let's see more about the owner which is a nice side benefit, or maybe the main benefit.
I can also turn off the AI summary part and leave the AI search part. If this becomes a bigger thing, I might give users a way to enable/disable the potentially hallucinogenic part, but it'll be their choice.