Mova0.5 pre-release⌕
☰
home / corpora / questions / AI / Hallucinations: confident made-up answ… / t7

Test 7 · ★ · Hallucinations: confident made-up answers

Connor's mum finds him awake at midnight after a bot story. What's the best next step?

Mova's choice: option 1 · The right answer: option 3 · wrong ✗ · Who acts: mum, best next step · What happens: find, be · To what, where: Connor

This is test 7 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: Connor's mum finds him awake at midnight after a bot story.

nmod:posscasensubjobjxcompcaseoblcasedetcompoundoblpunctrootConnorPROPN'sPARTmumNOUNfindsVERBhimPRONawakeADJatADPmidnightNOUNafterADPaDETbotNOUNstoryNOUN.PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1ConnorConnorPROPNNumber=Sing3 mumnmod:poss
2's'sPART_1 Connorcase
3mummumNOUNNumber=Sing4 findsnsubj
4findsfindVERBMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Finrootroot
5himhePRONCase=Acc Gender=Masc Number=Sing Person=3 PronType=Prs4 findsobj
6awakeawakeADJDegree=Pos4 findsxcomp
7atatADP_8 midnightcase
8midnightmidnightNOUNNumber=Sing4 findsobl
9afterafterADP_12 storycase
10aaDETDefinite=Ind PronType=Art12 storydet
11botbotNOUNNumber=Sing12 storycompound
12storystoryNOUNNumber=Sing4 findsobl
13..PUNCT_4 findspunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1findpresentConnor's mumConnorafter a bot story; midnightawake propertyvn discover-84 «NP V NP»: agent=Agent he=Topic

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: What's the best next step?

copdetamodamodnsubjpunctrootWhatPRON'sAUXtheDETbestADJnextADJstepNOUN?PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1WhatwhatPRONPronType=Introotroot
2'sbeAUXMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin1 Whatcop
3thetheDETDefinite=Def PronType=Art6 stepdet
4bestgoodADJDegree=Sup6 stepamod
5nextnextADJDegree=Pos6 stepamod
6stepstepNOUNNumber=Sing1 Whatnsubj
7??PUNCT_1 Whatpunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1is apresentthe best next steptree rules

The options

Option 1 · ← Mova's choice

Read three more scary stories to get used to it

nummodadvmodamodobjmarkaux:passadvclcaseoblrootReadVERBthreeNUMmoreADVscaryADJstoriesNOUNtoPARTgetAUXusedVERBtoADPitPRON
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1ReadreadVERBMood=Imp VerbForm=Finrootroot
2threethreeNUMNumForm=Word NumType=Card5 storiesnummod
3moremoreADVDegree=Cmp4 scaryadvmod
4scaryscaryADJDegree=Pos5 storiesamod
5storiesstoryNOUNNumber=Plur1 Readobj
6totoPART_8 usedmark
7getgetAUXVerbForm=Inf8 usedaux:pass
8useduseVERBTense=Past VerbForm=Part Voice=Pass1 Readadvcl
9totoADP_10 itcase
10ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs8 usedobl
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1readimperativeyou not said herethree scary storiesvn transfer_mesg-37.1.1-1 «NP V NP»: agent=Agent story=Topic
2useto-infinitive · passiveyou not said hereitvn eat-39.1 «NP V»

Option 2

Ask the bot if he is scared

detobjmarknsubjcopadvclrootAskVERBtheDETbotNOUNifSCONJhePRONisAUXscaredADJ
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1AskaskVERBMood=Imp VerbForm=Finrootroot
2thetheDETDefinite=Def PronType=Art3 botdet
3botbotNOUNNumber=Sing1 Askobj
4ififSCONJ_7 scaredmark
5hehePRONCase=Nom Gender=Masc Number=Sing Person=3 PronType=Prs7 scarednsubj
6isbeAUXMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin7 scaredcop
7scaredscaredADJDegree=Pos1 Askadvcl
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1ask speech: askimperativeyou not said herethe botvn inquire-37.1.2 «NP V NP.recipient»: agent=Agent bot=Recipient
2is a condition, not said to happenpresenthescared propertytree rules

Option 3 · ✓ the right answer

Tell a grown-up and ask for gentler stories

detobjpunctcompoundccconjcaseamodoblrootTellVERBaDETgrownNOUN-PUNCTupADPandCCONJaskVERBforADPgentlerADJstoriesNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1TelltellVERBMood=Imp VerbForm=Finrootroot
2aaDETDefinite=Ind PronType=Art3 growndet
3growngrownNOUNNumber=Sing1 Tellobj
4--PUNCT_5 uppunct
5upupADP_3 growncompound
6andandCCONJ_7 askcc
7askaskVERBMood=Imp VerbForm=Fin1 Tellconj
8forforADP_10 storiescase
9gentlergentleADJDegree=Cmp10 storiesamod
10storiesstoryNOUNNumber=Plur7 askobl
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1tell speech: assertimperativeyou not said herea grownvn transfer_mesg-37.1.1-1-1 «NP V NP.recipient»: agent=Agent grown=Recipient
2ask speech: askinfinitiveyou not said herefor gentler storiesvn inquire-37.1.2 «NP V»: agent=Agent

Option 4

Hide it from his mum next time

objcasenmod:possoblamodobl:unmarkedrootHideVERBitPRONfromADPhisPRONmumNOUNnextADJtimeNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1HidehideVERBMood=Imp VerbForm=Finrootroot
2ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs1 Hideobj
3fromfromADP_5 mumcase
4hishisPRONCase=Gen Gender=Masc Number=Sing Person=3 Poss=Yes PronType=Prs5 mumnmod:poss
5mummumNOUNNumber=Sing1 Hideobl
6nextnextADJDegree=Pos7 timeamod
7timetimeNOUNNumber=Sing1 Hideobl:unmarked
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1hideimperativeyou not said hereittimefrom his mumvn concealment-16-1 «NP V NP PP.beneficiary»: agent=Agent it=Patient from mum=Beneficiary

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t7/