🤷
Let it say "I don't know"
Left unguided, an AI will guess rather than admit a gap, because guessing looks more helpful in the moment.
Why it happens
Models are trained to be helpful above all, and an unanswered question can read as a failure to be helpful, so they fill it anyway.
What to do
Tell it explicitly that "I don't know" is an acceptable answer, and you'll get fewer confident wrong answers and more honest ones.
"If you're not sure, say so instead of guessing."