Brands, services, platforms and people
Everyday AI by Career Calling

Checking answers: AI can be wrong

AI chatbots make mistakes, and they make them in a confident voice. They can invent a book that does not exist, quote a law that was changed years ago, or get a sum wrong. Checking is a skill anyone can learn.

About 5 minutes to readLesson 4 of 12

Why it happens

A chatbot writes what sounds like a good answer. Most of the time that is also a correct answer, but not always. When it does not know, it may fill the gap with something that only looks right. People sometimes call this "making things up" or "hallucinating".

Its information can also be out of date. Prices, rules, opening hours and phone numbers change.

A simple checking habit

  • Ask where the information comes from: "What is your source for that?"
  • Look it up yourself on a site you trust, such as a government (.gov.au) page or the organisation's own website.
  • Check anything important in two places that do not copy each other.
  • Be extra careful with numbers, dates, names, money, health and the law.
  • If something sounds surprising, it probably needs checking.

An example

You ask

When does my local council collect hard rubbish?

A chatbot may give you a date that sounds right but is for a different council, or last year. The council's own website, or a phone call to them, is the place to confirm it.

Try this

  1. Ask a chatbot a question you already know the answer to, about your town or a topic you know well.
  2. See whether it gets anything wrong or leaves something out.
  3. Then ask it: "Are you sure? What is your source?" and see how it responds.

Safety tip

Never act on an AI answer about money, health, the law or your safety without checking it with a trusted source or a real person.