6. It can be confidently wrong.

A chatbot picks words that sound right. Most of the time, sounding right and being right go together. But sometimes they do not.

This is called hallucination — the chatbot produces something that reads well and sounds certain but is partly or completely made up. It might invent a book that does not exist, cite a fake statistic, or mix up details.

The tricky part: a wrong answer looks exactly like a right one. Same confidence. Same polish. No warning label.

Lesson 6 — It can be confidently wrong

Both responses look and sound identical

AI Chat

What is the capital of Japan?

The capital of Japan is Tokyo. It has served as the nation's capital since 1868 and is one of the most populous metropolitan areas in the world.

CorrectThis is accurate and verifiable.

AI Chat

Who wrote "The Art of Silent Leadership"?

"The Art of Silent Leadership" was written by Thomas J. Greenfield in 2004. It explores how understated management styles can drive team performance.

Made upThis book does not exist.

A chatbot sounds just as sure when it is wrong as when it is right.

More info: Why Chatbots Make Things Up