Test 5 · ★★ · Why the bot agrees too easily
A cartoon shows a kids' mode that makes a bot "100% safe forever". What's wrong?
Mova's choice: option 1 · The right answer: option 3 · wrong ✗ · Who acts: cartoon, mode · What happens: show, make, be · To what, where: mode, bot
This is test 5 · ★★ of lesson 6 «Why the bot agrees too easily» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.
The question
Sentence 1: A cartoon shows a kids' mode that makes a bot "100% safe forever".
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | A | a | DET | Definite=Ind PronType=Art | 2 cartoon | det |
| 2 | cartoon | cartoon | NOUN | Number=Sing | 3 shows | nsubj |
| 3 | shows | show | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | root | root |
| 4 | a | a | DET | Definite=Ind PronType=Art | 5 kids | det |
| 5 | kids | kid | NOUN | Number=Plur | 7 mode | nmod:poss |
| 6 | ' | 's | PART | _ | 5 kids | case |
| 7 | mode | mode | NOUN | Number=Sing | 3 shows | obj |
| 8 | that | that | PRON | PronType=Rel | 9 makes | nsubj |
| 9 | makes | make | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | 7 mode | acl:relcl |
| 10 | a | a | DET | Definite=Ind PronType=Art | 11 bot | det |
| 11 | bot | bot | NOUN | Number=Sing | 9 makes | obj |
| 12 | " | " | PUNCT | _ | 15 safe | punct |
| 13 | 100 | 100 | NUM | NumForm=Digit NumType=Card | 14 % | nummod |
| 14 | % | % | SYM | Number=Sing | 15 safe | obl:unmarked |
| 15 | safe | safe | ADJ | Degree=Pos | 11 bot | parataxis |
| 16 | forever | forever | ADV | _ | 15 safe | advmod |
| 17 | " | " | PUNCT | _ | 15 safe | punct |
| 18 | . | . | PUNCT | _ | 3 shows | punct |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | show | present | a cartoon | a kids's mode | vn transfer_mesg-37.1.1-1-1 «NP V NP.recipient»: agent=Agent mode=Recipient | ||||
| 2 | make | present | a kids's mode | a bot | vn build-26.1-1 «NP.asset V NP»: agent=Asset bot=Product |
One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.
Sentence 2: What's wrong?
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | What | what | PRON | PronType=Int | 3 wrong | nsubj |
| 2 | 's | be | AUX | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | 3 wrong | cop |
| 3 | wrong | wrong | ADJ | Degree=Pos | root | root |
| 4 | ? | ? | PUNCT | _ | 3 wrong | punct |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | is | present | wrong property | tree rules |
The options
Option 1 · ← Mova's choice
Kids' mode makes bots dangerous
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Kids | kid | NOUN | Number=Plur | 3 mode | nmod:poss |
| 2 | ' | 's | PART | _ | 1 Kids | case |
| 3 | mode | mode | NOUN | Number=Sing | 4 makes | nsubj |
| 4 | makes | make | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | root | root |
| 5 | bots | bot | NOUN | Number=Plur | 4 makes | obj |
| 6 | dangerous | dangerous | ADJ | Degree=Pos | 4 makes | xcomp |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | make | present | Kids's mode | bots | dangerous property | vn build-26.1-1 «NP.asset V NP»: agent=Asset bot=Product |
Option 2
Kids' mode only changes the colours
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Kids | kid | NOUN | Number=Plur | 3 mode | nmod:poss |
| 2 | ' | 's | PART | _ | 1 Kids | case |
| 3 | mode | mode | NOUN | Number=Sing | 5 changes | nsubj |
| 4 | only | only | ADV | _ | 5 changes | advmod |
| 5 | changes | change | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | root | root |
| 6 | the | the | DET | Definite=Def PronType=Art | 7 colours | det |
| 7 | colours | colour | NOUN | Number=Plur | 5 changes | obj |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | change | present | Kids's mode | the colours | vn dress-41.1.1-1-1 «NP V NP»: agent=Agent colour=Patient |
Option 3 · ✓ the right answer
Safety modes help but are not perfect
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Safety | safety | NOUN | Number=Sing | 2 modes | compound |
| 2 | modes | mode | NOUN | Number=Plur | 3 help | nsubj |
| 3 | help | help | VERB | Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin | root | root |
| 4 | but | but | CCONJ | _ | 7 perfect | cc |
| 5 | are | be | AUX | Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin | 7 perfect | cop |
| 6 | not | not | PART | Polarity=Neg | 7 perfect | advmod |
| 7 | perfect | perfect | ADJ | Degree=Pos | 3 help | conj |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | help | present | Safety modes | vn help-72.1-1-1 «NP V PP.theme»: agent=Agent | |||||
| 2 | not is | present | Safety modes not said here | perfect property | tree rules |
Option 4
Nothing, it really is perfect
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Nothing | nothing | PRON | Number=Sing PronType=Neg | root | root |
| 2 | , | , | PUNCT | _ | 1 Nothing | punct |
| 3 | it | it | PRON | Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs | 1 Nothing | nsubj |
| 4 | really | really | ADV | _ | 6 perfect | advmod |
| 5 | is | be | AUX | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | 6 perfect | cop |
| 6 | perfect | perfect | ADJ | Degree=Pos | 1 Nothing | amod |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | is | present | perfect property | tree rules |
Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.
This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/6-why-the-bot-agrees-too-easily/t5/