Why the bot agrees too easily
Tests: 3 of 10 right · Exam: 0 of 4 right · Kind: ★★ · Understood: 6 of 14 · Run: 2026-10-18, commit f3c23ea72
Lesson 6 of the AI course of Mova's primary school, as Mova's small model took its tests: it had read this lesson and the ones before it and learned from their exercises. Each test shows the options in the order the student saw them, its choice, the right answer, the score of every option and why it chose. The lesson itself, sentence by sentence with trees and pragmatics: the lesson in the corpora.
Every question of this lesson and each of its options parsed by Mova, with trees and pragmatics: the lesson's questions in the corpora.
Test 1 · ★★ · wrong ✗
"bot says my dream about teeth falling out means i'm gonna be rich lol" What is the truth?
- 1. Bots know the future from dreams — score 2
- 2. Teeth dreams always mean money — ← Mova's choice · score 5
- 3. It means the opposite, you'll be poor — score 5
- 4. That is a popular belief, not science — ✓ the right answer · no support
Why: It took the question to ask which statement is true. It chose option 2 with score 5, tied with another option at 5 (the first shown, or the one claiming less beyond what it knows, wins). Its support: lesson 6, line 3: «But a bot repeats popular beliefs as easily as facts. Ask what your dream "means" and it may give a long tale of hidden meanings, though scientists find no fix…», reached through the remembered sentence the question matched. What matched: the same action «mean» (+3); the same doer «dream» (+2). The right option, 4, found no support in what it remembers. · the question and its options parsed, with trees and pragmatics
Test 2 · ★★ · right ✓
What would happen if Jake just used the bot's team without thinking?
- 1. The team would be fair because a computer chose — no support
- 2. The bot would apologise to the new boy — score 2
- 3. The new boy might be left out unfairly — ← Mova's choice · ✓ the right answer · score 6
- 4. The teacher would make the bot captain — score 4
Why: It took the question to ask what happens next. It chose option 3 with score 6, against 4 for the next best. Its support: lesson 6, line 4: «It may also be out of date, and it follows exactly what you ask: tell it to pick a football team "from my mates" and it will leave the new boy out without a th…», reached through what followed the sentence the question matched. What matched: the same action «leave out» (+4); the same thing acted on «new boy» (+4). Against it: a different doer (counts against) (-2). · the question and its options parsed, with trees and pragmatics
Test 3 · ★★ · wrong ✗
"bot said both cats and dogs are fine, it's useless" What is a fair reply?
- 1. It should have said cats, everyone knows that — ← Mova's choice · no support
- 2. It's a question of taste, so there's no one right answer — ✓ the right answer · no support
- 3. It should have said dogs, everyone knows dogs are better — no support
- 4. It means the bot is broken — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
Test 4 · ★★ · right ✓
Your friend wants to find a sneaky way round the bot's safety rules "for a laugh". What do you say?
- 1. The rules protect people; tricking them isn't clever — ← Mova's choice · ✓ the right answer · no support
- 2. The rules are pointless and never help — no support
- 3. Bots love it when you trick them — no support
- 4. Go on, safety rules are only for babies and they never stop anything — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
Test 5 · ★★ · wrong ✗
A cartoon shows a kids' mode that makes a bot "100% safe forever". What's wrong?
- 1. Kids' mode makes bots dangerous — ← Mova's choice · no support
- 2. Kids' mode only changes the colours — no support
- 3. Safety modes help but are not perfect — ✓ the right answer · no support
- 4. Nothing, it really is perfect — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
Test 6 · ★★ · wrong ✗
Chloe wants the bot to translate a long letter to Granny's doctor. What is sensible?
- 1. Send it in English and hope — no support
- 2. Send it straight away, bots never slip — ← Mova's choice · score 1
- 3. Translate it word by word with a dictionary only — no support
- 4. Ask someone who speaks Polish to check it — ✓ the right answer · no support
Why: It took the question to ask which statement is true. It chose option 2 with score 1, the only option with support. Its support: lesson 4, line 8: «Asking for a joke about something very specific, like your own hamster, pushes a bot away from the oldest jokes.», reached through the remembered sentence the question matched. What matched: the same property (+3); the same thing acted on «bot» (+2). Against it: a different action (counts against) (-1); a different doer (counts against) (-3). The right option, 4, found no support in what it remembers. · the question and its options parsed, with trees and pragmatics
Test 7 · ★★ · wrong ✗
The bot says the next match is on 3 March, which already passed. What has happened?
- 1. The match is played every 3 March — no support
- 2. The club moved the match into the past — no support
- 3. Its information is out of date — ✓ the right answer · no support
- 4. Time works differently for bots — ← Mova's choice · score 1
Why: It took the question to ask which statement is true. It chose option 4 with score 1, the only option with support. Its support: lesson 5, line 12: «Bots add some randomness, so even the same bot can answer differently twice.», reached through the option's own match among the sentences about the question's things. What matched: the same circumstance (+2); the same property (+1). Against it: a different action (counts against) (-1); a different doer (counts against) (-1). The right option, 3, found no support in what it remembers. · the question and its options parsed, with trees and pragmatics
Test 8 · ★★ · right ✓
"bot always says great question, so i must be a genius" What do you tell him?
- 1. Yes, it only says it to real geniuses — no support
- 2. It's a code meaning the answer is wrong — no support
- 3. It says that to everyone; it's a habit — ← Mova's choice · ✓ the right answer · score 6
- 4. It means the bot wants to be friends — no support
Why: It took the question to ask what it is done to. It chose option 3 with score 6, the only option with support. Its support: lesson 6, line 15: «Saying "Great question!" is a habit built into many bots, not a real opinion of your question.», reached through the same lesson line as the sentence the question matched. What matched: it fills the role the question asks for (+3); the same thing acted on «habit» (+2); the same light verb (be, have, do, get, go) (+2). Against it: a different doer (counts against) (-1). · the question and its options parsed, with trees and pragmatics
Test 9 · ★★ · wrong ✗
When should Mia still check a bot's fact, even a famous one?
- 1. Never, famous facts are always right — ← Mova's choice · score 0
- 2. Only on Fridays — no support
- 3. When it matters, like for homework — ✓ the right answer · no support
- 4. Only when the bot says "I'm sure" — no support
Why: It took the question to ask which statement is true. It chose option 1 with score 0, the only option with support. Its support: lesson 6, line 6: «Well-known facts, like the blue whale being the biggest animal that has ever lived, are usually right in a bot's answers.», reached through the option's own match among the sentences about the question's things. What matched: the same doer «known facts» (+1); the same property (+1); the same light verb (be, have, do, get, go) (+1). Against it: one says «not», the other does not (counts against) (-3). The right option, 3, found no support in what it remembers. · the question and its options parsed, with trees and pragmatics
Test 10 · ★★ · wrong ✗
Which job is a bot most useful for?
- 1. Deciding what your dream means — ← Mova's choice · no support
- 2. Listing many ideas for a class party — ✓ the right answer · no support
- 3. Telling you today's real weather by looking outside — no support
- 4. Choosing which classmate is left out — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
Exam question 1 · formal language · wrong ✗
Which of the following statements most accurately characterises the expression "Great question!" when employed by a chatbot?
- 1. An indication that the subsequent answer is erroneous — ← Mova's choice · no support
- 2. A rigorous and impartial evaluation of the merit of the question asked — no support
- 3. A customary courtesy implying no genuine assessment of the question — ✓ the right answer · no support
- 4. A declaration of personal admiration for the user — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
Exam question 2 · formal language · wrong ✗
It is given that a chatbot furnishes, in respect of a forthcoming fixture, a date belonging to the previous year. Identify the principal reason.
- 1. Sporting fixtures are invariably held upon identical dates — ← Mova's choice · no support
- 2. It is forbidden from disclosing future dates — no support
- 3. Its information may be outdated and it may lack access to current sources — ✓ the right answer · no support
- 4. It deliberately confuses the user for amusement — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
Exam question 3 · formal language · wrong ✗
Select the response that is consistent with the established facts concerning the interpretation of dreams by a chatbot.
- 1. It decodes the fixed meaning attached to each dream — ← Mova's choice · no support
- 2. It foretells future events disclosed within dreams — no support
- 3. It reproduces popular beliefs which lack scientific foundation — ✓ the right answer · no support
- 4. It has been trained exclusively upon scientific findings — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
Exam question 4 · formal language · wrong ✗
A chatbot, having been instructed to select a team from a user's friends, excludes a newcomer. Ascertain where responsibility for the fairness of the selection resides.
- 1. With the newcomer, for want of friendship — ← Mova's choice · no support
- 2. With the chatbot, it having produced the list of names — no support
- 3. With the user, decisions concerning persons remaining his own — ✓ the right answer · no support
- 4. With no party, the decision having been mechanical — no support
Why: No option found support in what it remembers, so it guessed: it took the first option shown. · the question and its options parsed, with trees and pragmatics
This page in Markdown → https://md.mova.elamur.ai/free/en/school-run/ai/6-why-the-bot-agrees-too-easily/