Test 1 · ★ · Hallucinations: confident made-up answers "my bot said my essay was brilliant!!" It never saw the essay. What do you say?
Mova's choice: option 4 · The right answer: option 4 · right ✓ · Who acts: bot, essay, my, you · What happens: say, be, essay, not see · To what, where: essay · Speech: someone speaks here
This is test 1 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school .
The question Sentence 1: "my bot said my essay was brilliant!!"
punct nmod:poss nsubj nmod:poss nsubj cop ccomp punct punct root " PUNCT my PRON bot NOUN said VERB my PRON essay NOUN was AUX brilliant ADJ !! PUNCT " PUNCT The words, one row each (CoNLL-U) # word lemma UPOS features head relation 1 " " PUNCT _ 4 said punct 2 my my PRON Case=Gen Number=Sing Person=1 Poss=Yes PronType=Prs 3 bot nmod:poss 3 bot bot NOUN Number=Sing 4 said nsubj 4 said say VERB Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin root root 5 my my PRON Case=Gen Number=Sing Person=1 Poss=Yes PronType=Prs 6 essay nmod:poss 6 essay essay NOUN Number=Sing 8 brilliant nsubj 7 was be AUX Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin 8 brilliant cop 8 brilliant brilliant ADJ Degree=Pos 4 said ccomp 9 !! !! PUNCT _ 8 brilliant punct 10 " " PUNCT _ 4 said punct
# verb tense, mood who what, whom to whom where when other roles by
1 say speech: assert in a quote past my bot vn say-37.7-1-1 «NP V that S»: agent=Agent 2 is in a quote past my essay brilliant property tree rules 3 essay in a quote my nom essay «communication transitive»: poss=agent
One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.
Sentence 2: It never saw the essay.
nsubj advmod det obj punct root It PRON never ADV saw VERB the DET essay NOUN . PUNCT The words, one row each (CoNLL-U) # word lemma UPOS features head relation 1 It it PRON Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs 3 saw nsubj 2 never never ADV PronType=Neg 3 saw advmod 3 saw see VERB Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin root root 4 the the DET Definite=Def PronType=Art 5 essay det 5 essay essay NOUN Number=Sing 3 saw obj 6 . . PUNCT _ 3 saw punct
# verb tense, mood who what, whom to whom where when other roles by
1 not see past essay the essay vn comprehend-87.2-1-1 «NP V NP»: agent=Experiencer essay=Stimulus
Sentence 3: What do you say?
obj aux nsubj punct root What PRON do AUX you PRON say VERB ? PUNCT The words, one row each (CoNLL-U) # word lemma UPOS features head relation 1 What what PRON PronType=Int 4 say obj 2 do do AUX Mood=Ind Number=Sing Person=2 Tense=Pres VerbForm=Fin 4 say aux 3 you you PRON Case=Nom Person=2 PronType=Prs 4 say nsubj 4 say say VERB VerbForm=Inf root root 5 ? ? PUNCT _ 4 say punct
# verb tense, mood who what, whom to whom where when other roles by
1 say speech: assert present · do-support you vn say-37.7-1-1 «NP V NP.topic»: agent=Agent what=Topic
The options Option 1 Great, now you don't need to check it
punct advmod nsubj aux advmod conj mark xcomp obj root Great ADJ , PUNCT now ADV you PRON do AUX n't PART need VERB to PART check VERB it PRON The words, one row each (CoNLL-U) # word lemma UPOS features head relation 1 Great great ADJ Degree=Pos root root 2 , , PUNCT _ 7 need punct 3 now now ADV PronType=Dem 7 need advmod 4 you you PRON Case=Nom Person=2 PronType=Prs 7 need nsubj 5 do do AUX Mood=Ind Number=Sing Person=2 Tense=Pres VerbForm=Fin 7 need aux 6 n't not PART Polarity=Neg 7 need advmod 7 need need VERB VerbForm=Inf 1 Great conj 8 to to PART _ 9 check mark 9 check check VERB VerbForm=Inf 7 need xcomp 10 it it PRON Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs 9 check obj
# verb tense, mood who what, whom to whom where when other roles by
1 not need present · do-support you now vn want-32.1-1-1 «NP V NP S_INF»: agent=Pivot clause=Theme 2 check not said to happen to-infinitive you not said here it vn assessment-34.1 «NP V NP»: agent=Agent it=Theme
Option 2 It must have looked at it through the camera
nsubj:pass aux aux case obl case det obl root It PRON must AUX have AUX looked VERB at ADP it PRON through ADP the DET camera NOUN The words, one row each (CoNLL-U) # word lemma UPOS features head relation 1 It it PRON Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs 4 looked nsubj:pass 2 must must AUX VerbForm=Fin 4 looked aux 3 have have AUX VerbForm=Inf 4 looked aux 4 looked look VERB Tense=Past VerbForm=Part Voice=Pass root root 5 at at ADP _ 6 it case 6 it it PRON Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs 4 looked obl 7 through through ADP _ 9 camera case 8 the the DET Definite=Def PronType=Art 9 camera det 9 camera camera NOUN Number=Sing 4 looked obl
# verb tense, mood who what, whom to whom where when other roles by
1 look must · perfect · passive It it through the camera vn seem-109-1-1 «NP V NP»: subject=Attribute
Option 3 Bots only praise really good essays
nsubj advmod advmod amod obj root Bots NOUN only ADV praise VERB really ADV good ADJ essays NOUN The words, one row each (CoNLL-U) # word lemma UPOS features head relation 1 Bots bot NOUN Number=Plur 3 praise nsubj 2 only only ADV _ 3 praise advmod 3 praise praise VERB Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin root root 4 really really ADV _ 5 good advmod 5 good good ADJ Degree=Pos 6 essays amod 6 essays essay NOUN Number=Plur 3 praise obj
# verb tense, mood who what, whom to whom where when other roles by
1 praise present Bots good essays vn judgment-33.1-1 «NP V NP»: agent=Agent essay=Theme
Option 4 · ← Mova's choice · ✓ the right answer Bot praise without seeing the work means nothing; ask a teacher
compound nsubj mark acl det obj obj punct parataxis det obj root Bot NOUN praise NOUN without SCONJ seeing VERB the DET work NOUN means VERB nothing PRON ; PUNCT ask VERB a DET teacher NOUN The words, one row each (CoNLL-U) # word lemma UPOS features head relation 1 Bot bot NOUN Number=Sing 2 praise compound 2 praise praise NOUN Number=Sing 7 means nsubj 3 without without SCONJ _ 4 seeing mark 4 seeing see VERB VerbForm=Ger 2 praise acl 5 the the DET Definite=Def PronType=Art 6 work det 6 work work NOUN Number=Sing 4 seeing obj 7 means mean VERB Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin root root 8 nothing nothing PRON Number=Sing PronType=Neg 7 means obj 9 ; ; PUNCT _ 10 ask punct 10 ask ask VERB Mood=Imp VerbForm=Fin 7 means parataxis 11 a a DET Definite=Ind PronType=Art 12 teacher det 12 teacher teacher NOUN Number=Sing 10 ask obj
# verb tense, mood who what, whom to whom where when other roles by
1 see gerund Bot praise not said here the work vn comprehend-87.2-1-1 «NP V NP»: agent=Experiencer work=Stimulus 2 mean present Bot praise nothing vn intend-61.2-1 «NP V NP»: agent=Agent nothing=Topic 3 ask speech: ask infinitive a teacher vn inquire-37.1.2 «NP V NP.recipient»: agent=Agent teacher=Recipient
Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.
← previous Stories, jokes and riddles with a chat…, exam 4next → Hallucinations: confident made-up answ…, test 2↑ back to Hallucinations: confident made-up answers This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t1/