Mova0.5 pre-release⌕
☰
home / corpora / questions / AI / Hallucinations: confident made-up answ… / t9

Test 9 · ★ · Hallucinations: confident made-up answers

A bot writes a birthday card for Gran. What must you do before giving it?

Mova's choice: option 1 · The right answer: option 4 · wrong ✗ · Who acts: bot, you · What happens: write, do, give · To what, where: birthday card, card

This is test 9 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: A bot writes a birthday card for Gran.

detnsubjdetcompoundobjcasenmodpunctrootADETbotNOUNwritesVERBaDETbirthdayNOUNcardNOUNforADPGranPROPN.PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1AaDETDefinite=Ind PronType=Art2 botdet
2botbotNOUNNumber=Sing3 writesnsubj
3writeswriteVERBMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Finrootroot
4aaDETDefinite=Ind PronType=Art6 carddet
5birthdaybirthdayNOUNNumber=Sing6 cardcompound
6cardcardNOUNNumber=Sing3 writesobj
7forforADP_8 Grancase
8GranGranPROPNNumber=Sing6 cardnmod
9..PUNCT_3 writespunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1writepresenta bota birthday cardfor Granvn create-26.4-1 «NP V NP PP.beneficiary»: agent=Agent card=Result for gran=Beneficiary

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: What must you do before giving it?

objauxnsubjmarkadvclobjpunctrootWhatPRONmustAUXyouPRONdoVERBbeforeSCONJgivingVERBitPRON?PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1WhatwhatPRONPronType=Int4 doobj
2mustmustAUXVerbForm=Fin4 doaux
3youyouPRONCase=Nom Person=2 PronType=Prs4 donsubj
4dodoVERBVerbForm=Infrootroot
5beforebeforeSCONJ_6 givingmark
6givinggiveVERBTense=Pres VerbForm=Part4 doadvcl
7ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs6 givingobj
8??PUNCT_4 dopunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1domustyouvn act-114-1 «NP V NP»: agent=Agent what=Eventuality
2givegerundyou not said herecardvn give-13.1-1 «NP V NP»: agent=Agent it=Theme

The options

Option 1 · ← Mova's choice

Give it straight away, bots never slip up

iobjadvmodadvmodpunctnsubjadvmodconjcompound:prtrootGiveVERBitPRONstraightADVawayADV,PUNCTbotsNOUNneverADVslipVERBupADP
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1GivegiveVERBMood=Imp VerbForm=Finrootroot
2ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs1 Giveiobj
3straightstraightADV_4 awayadvmod
4awayawayADV_1 Giveadvmod
5,,PUNCT_8 slippunct
6botsbotNOUNNumber=Plur8 slipnsubj
7neverneverADVPronType=Neg8 slipadvmod
8slipslipVERBMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin1 Giveconj
9upupADP_8 slipcompound:prt
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1giveimperativeyou not said hereitaway propertyvn give-13.1-1 «NP V NP»: agent=Agent it=Theme
2not slip uppresentbotsvn calibratable_cos-45.6.1-1 «NP.attribute V»: agent=Attribute

Option 2

Send it to five more bots to check it over

objcasenummodamodoblmarkadvclobjcompound:prtrootSendVERBitPRONtoADPfiveNUMmoreADJbotsNOUNtoPARTcheckVERBitPRONoverADP
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1SendsendVERBMood=Imp VerbForm=Finrootroot
2ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs1 Sendobj
3totoADP_6 botscase
4fivefiveNUMNumForm=Word NumType=Card6 botsnummod
5moremoreADJDegree=Cmp6 botsamod
6botsbotNOUNNumber=Plur1 Sendobl
7totoPART_8 checkmark
8checkcheckVERBVerbForm=Inf1 Sendadvcl
9ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs8 checkobj
10overoverADP_8 checkcompound:prt
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1sendimperativeyou not said hereitfive more botsvn confine-92-1 «NP V NP PP.destination»: agent=Agent it=Theme to bot=Destination
2check overto-infinitiveyou not said hereitvn assessment-34.1 «NP V NP»: agent=Agent it=Theme

Option 3

Print it out in the biggest font possible

objcompound:prtcasedetamodobladvclrootPrintVERBitPRONoutADPinADPtheDETbiggestADJfontNOUNpossibleADJ
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1PrintprintVERBMood=Imp VerbForm=Finrootroot
2ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs1 Printobj
3outoutADP_1 Printcompound:prt
4ininADP_7 fontcase
5thetheDETDefinite=Def PronType=Art7 fontdet
6biggestbigADJDegree=Sup7 fontamod
7fontfontNOUNNumber=Sing1 Printobl
8possiblepossibleADJDegree=Pos1 Printadvcl
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1print outimperativeyou not said hereitthe biggest fontvn scribble-25.2-1 «NP V NP PP.destination»: agent=Agent it=Theme in font=Destination

Option 4 · ✓ the right answer

Read it all and fix bits that don't fit

objdetccconjobjnsubjauxadvmodacl:relclrootReadVERBitPRONallDETandCCONJfixVERBbitsNOUNthatPRONdoAUXn'tPARTfitVERB
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1ReadreadVERBMood=Imp VerbForm=Finrootroot
2ititPRONCase=Acc Gender=Neut Number=Sing Person=3 PronType=Prs1 Readobj
3allallDETPronType=Tot2 itdet
4andandCCONJ_5 fixcc
5fixfixVERBMood=Imp VerbForm=Fin1 Readconj
6bitsbitNOUNNumber=Plur5 fixobj
7thatthatPRONPronType=Rel10 fitnsubj
8dodoAUXMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin10 fitaux
9n'tnotPARTPolarity=Neg10 fitadvmod
10fitfitVERBVerbForm=Inf6 bitsacl:relcl
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1readimperativeyou not said hereitvn transfer_mesg-37.1.1-1 «NP V NP»: agent=Agent it=Topic
2fixinfinitiveyou not said herebitsvn shake-22.3-2 «NP V NP together»: agent=Agent bit=Patient
3not fitpresent · do-supportbitsvn adjust-26.9 «NP V S_ING»: agent=Agent

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t9/