Glossary

What is Hallucination (AI)?

A hallucination is a statement by an AI language model that is fluent and convincing but factually wrong or not supported by any source. It happens because language models generate likely sequences of words and do not check facts by themselves. Source-based methods such as RAG reduce the risk but do not eliminate it.

In simple terms

Think of a very well-read colleague who hates saying "I don't know". Ask about a detail they don't know, and they fill the gap with something plausible, such as a section number or a date. They are not lying on purpose; they are just filling in. So the rule for AI is the same as for that colleague: check important statements against the source before passing them on.

In the enterprise

Beispiel Versicherung uses an AI assistant to answer questions about internal guidelines. Without a connection to the sources, the assistant once states an approval limit that appears in no guideline. After switching to a source-based system, every answer shows the document and page. Staff are instructed to always check amounts and deadlines against the cited passage. If the statement is not there, it is not used.

Related terms

Sources

  1. Huang et al. (2023): A Survey on Hallucination in Large Language Models (arXiv:2311.05232)
  2. Ji et al. (2022): Survey of Hallucination in Natural Language Generation (arXiv:2202.03629)

How we use this: UNID AI Second Brain · The second brain for your company's knowledge

← All terms

FAQ

Frequently asked questions

Do source references prevent hallucinations completely?

No. Even with sources, a model can summarise a passage incorrectly or cite a source that does not support the statement. Source references do make errors checkable: comparing the quote with the cited page usually reveals a hallucination quickly.

See it working on your own material.

In a 30-minute call we show the products live and work out which use case makes sense for you first. No obligation, in German or English, in Vienna or online.

UNID AI · Leonard-Bernstein-Straße 10 · 1220 Vienna · +43 660 476 30 89