Test 3 · ★ · Hallucinations: confident made-up answers
Your friend shows a "real quote" from a footballer that a bot made up during role-play. What is the truth?
Mova's choice: option 1 · The right answer: option 2 · wrong ✗ · Who acts: friend, truth · What happens: show, make up, be · To what, where: real quote, footballer, bot
This is test 3 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.
The question
Sentence 1: Your friend shows a "real quote" from a footballer that a bot made up during role-play.
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Your | your | PRON | Case=Gen Person=2 Poss=Yes PronType=Prs | 2 friend | nmod:poss |
| 2 | friend | friend | NOUN | Number=Sing | 3 shows | nsubj |
| 3 | shows | show | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | root | root |
| 4 | a | a | DET | Definite=Ind PronType=Art | 7 quote | det |
| 5 | " | " | PUNCT | _ | 7 quote | punct |
| 6 | real | real | ADJ | Degree=Pos | 7 quote | amod |
| 7 | quote | quote | NOUN | Number=Sing | 3 shows | obj |
| 8 | " | " | PUNCT | _ | 7 quote | punct |
| 9 | from | from | ADP | _ | 11 footballer | case |
| 10 | a | a | DET | Definite=Ind PronType=Art | 11 footballer | det |
| 11 | footballer | footballer | NOUN | Number=Sing | 3 shows | obl |
| 12 | that | that | SCONJ | _ | 14 bot | mark |
| 13 | a | a | DET | Definite=Ind PronType=Art | 14 bot | det |
| 14 | bot | bot | NOUN | Number=Sing | 11 footballer | appos |
| 15 | made | make | VERB | Tense=Past VerbForm=Part Voice=Pass | 14 bot | acl |
| 16 | up | up | ADP | _ | 15 made | compound:prt |
| 17 | during | during | ADP | _ | 20 play | case |
| 18 | role | role | NOUN | Number=Sing | 20 play | compound |
| 19 | - | - | PUNCT | _ | 18 role | punct |
| 20 | play | play | NOUN | Number=Sing | 15 made | obl |
| 21 | . | . | PUNCT | _ | 3 shows | punct |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | show | present | Your friend | a real quote | a footballer | vn transfer_mesg-37.1.1-1-1 «NP V NP.recipient»: agent=Agent quote=Recipient | |||
| 2 | make up | participle | a bot not said here | during role play | vn comprise-107.2-1 «NP V NP»: agent=Theme |
One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.
Sentence 2: What is the truth?
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | What | what | PRON | PronType=Int | root | root |
| 2 | is | be | AUX | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | 1 What | cop |
| 3 | the | the | DET | Definite=Def PronType=Art | 4 truth | det |
| 4 | truth | truth | NOUN | Number=Sing | 1 What | nsubj |
| 5 | ? | ? | PUNCT | _ | 1 What | punct |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | is a | present | the truth | tree rules |
The options
Option 1 · ← Mova's choice
Footballers write their own bot quotes
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Footballers | footballer | NOUN | Number=Plur | 2 write | nsubj |
| 2 | write | write | VERB | Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin | root | root |
| 3 | their | their | PRON | Case=Gen Number=Plur Person=3 Poss=Yes PronType=Prs | 6 quotes | nmod:poss |
| 4 | own | own | ADJ | Degree=Pos | 6 quotes | amod |
| 5 | bot | bot | NOUN | Number=Sing | 6 quotes | compound |
| 6 | quotes | quote | NOUN | Number=Plur | 2 write | obj |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | write | present | Footballers | Footballers's own bot quotes | vn scribble-25.2-1 «NP V NP»: agent=Agent quote=Theme | ||||
| 2 | quote | Footballers = footballer | nom quote «communication transitive»: poss=agent |
Option 2 · ✓ the right answer
It was invented by the bot; he never said it
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | It | it | PRON | Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs | 3 invented | nsubj:pass |
| 2 | was | be | AUX | Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin | 3 invented | aux:pass |
| 3 | invented | invent | VERB | Tense=Past VerbForm=Part Voice=Pass | root | root |
| 4 | by | by | ADP | _ | 6 bot | case |
| 5 | the | the | DET | Definite=Def PronType=Art | 6 bot | det |
| 6 | bot | bot | NOUN | Number=Sing | 3 invented | obl |
| 7 | ; | ; | PUNCT | _ | 10 said | punct |
| 8 | he | he | PRON | Case=Nom Gender=Masc Number=Sing Person=3 PronType=Prs | 10 said | nsubj |
| 9 | never | never | ADV | PronType=Neg | 10 said | advmod |
| 10 | said | say | VERB | Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin | 3 invented | conj |
| 11 | it | it | PRON | Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs | 10 said | obj |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | invent | past · passive | the bot | It | vn create-26.4-1 «NP V NP»: agent=Agent subject=Result | ||||
| 2 | not say speech: assert | past | he | bot | vn say-37.7-1-1 «NP V NP.topic»: agent=Agent it=Topic |
Option 3
It's real if it sounds a lot like him
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | It | it | PRON | Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs | 3 real | nsubj |
| 2 | 's | be | AUX | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | 3 real | cop |
| 3 | real | real | ADJ | Degree=Pos | root | root |
| 4 | if | if | SCONJ | _ | 6 sounds | mark |
| 5 | it | it | PRON | Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs | 6 sounds | nsubj |
| 6 | sounds | sound | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | 3 real | advcl |
| 7 | a | a | DET | Definite=Ind PronType=Art | 8 lot | det |
| 8 | lot | lot | NOUN | Number=Sing | 6 sounds | obl |
| 9 | like | like | ADP | _ | 10 him | case |
| 10 | him | he | PRON | Case=Acc Gender=Masc Number=Sing Person=3 PronType=Prs | 6 sounds | obl |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | is | present | It | real property | tree rules | ||||
| 2 | sound a condition, not said to happen | present | it | a lot | like him = he | vn stimulus_subject-30.4 «NP V PP.attribute»: agent=Stimulus |
Option 4
Bots only use quotes from real newspapers
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Bots | bot | NOUN | Number=Plur | 3 use | nsubj |
| 2 | only | only | ADV | _ | 3 use | advmod |
| 3 | use | use | VERB | Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin | root | root |
| 4 | quotes | quote | NOUN | Number=Plur | 3 use | obj |
| 5 | from | from | ADP | _ | 7 newspapers | case |
| 6 | real | real | ADJ | Degree=Pos | 7 newspapers | amod |
| 7 | newspapers | newspaper | NOUN | Number=Plur | 3 use | obl |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | use | present | Bots | quotes | real newspapers | vn eat-39.1 «NP V NP»: agent=Agent quote=Patient |
Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.
This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t3/