Why LLMs Hallucinate, and How to Reduce It

"Why does ChatGPT make things up?" Because it predicts a plausible next word, not a true one — and it never says "I don't know" unless you make it. Here's the cause, in plain words, with an interactive demo. 🌫️ Try it: https://dev48v.infy.uk/ai/days/day7-hallucinate.html It predicts likely, not true An LLM generates the most LIKELY continuation given everything so far. "Likely" is learned from patterns in its training text — not a lookup of verified facts. When the likely-sounding...