Test 6 · ★ · Hallucinations: confident made-up answers

"the bot knows me, it said i'm kind and brave" What is really going on?

Mova's choice: option 1 · The right answer: option 4 · wrong ✗ · Who acts: bot · What happens: know, say, be, go on · To what, where: bot · Speech: someone speaks here

This is test 6 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	"	"	PUNCT	_	4 knows	punct
2	the	the	DET	Definite=Def PronType=Art	3 bot	det
3	bot	bot	NOUN	Number=Sing	4 knows	nsubj
4	knows	know	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
5	me	I	PRON	Case=Acc Number=Sing Person=1 PronType=Prs	4 knows	obj
6	,	,	PUNCT	_	8 said	punct
7	it	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	8 said	nsubj
8	said	say	VERB	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	4 knows	parataxis
9	i	I	PRON	Case=Nom Number=Sing Person=1 PronType=Prs	11 kind	nsubj
10	'm	be	AUX	Mood=Ind Number=Sing Person=1 Tense=Pres VerbForm=Fin	11 kind	cop
11	kind	kind	ADJ	Degree=Pos	8 said	ccomp
12	and	and	CCONJ	_	13 brave	cc
13	brave	brave	ADJ	Degree=Pos	11 kind	conj
14	"	"	PUNCT	_	18 going	punct
15	What	what	PRON	PronType=Int	18 going	nsubj
16	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	18 going	aux
17	really	really	ADV	_	18 going	advmod
18	going	go	VERB	Tense=Pres VerbForm=Part	8 said	ccomp
19	on	on	ADP	_	18 going	compound:prt
20	?	?	PUNCT	_	4 knows	punct

#	verb	tense, mood	who	what, whom	other	roles by
1	know in a quote	present	the bot	bot		vn comprehend-87.2-1-1-1 «NP V NP PP.attribute»: agent=Experiencer i=Stimulus
2	say speech: assert in a quote	past	bot			vn say-37.7-1-1 «NP V how S»: agent=Agent clause=Topic
3	is in a quote	present	bot		kind property	tree rules
4	be in a quote		bot not said here			tree rules
5	go on	present · progressive				vn function-105.2.1 «NP V»: agent=Theme

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice

Your teacher told it all about you

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Your	your	PRON	Case=Gen Person=2 Poss=Yes PronType=Prs	2 teacher	nmod:poss
2	teacher	teacher	NOUN	Number=Sing	3 told	nsubj
3	told	tell	VERB	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	root	root
4	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	3 told	obj
5	all	all	ADV	_	3 told	advmod
6	about	about	ADP	_	7 you	case
7	you	you	PRON	Case=Acc Person=2 PronType=Prs	3 told	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	tell speech: assert	past	Your teacher		it			about you; all property	vn transfer_mesg-37.1.1-1-1 «NP V NP S_ING»: agent=Agent it=Recipient about you=Topic

Option 2

It has watched you for years through your phone

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 watched	nsubj:pass
2	has	have	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	3 watched	aux
3	watched	watch	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
4	you	you	PRON	Case=Acc Person=2 PronType=Prs	3 watched	obj
5	for	for	ADP	_	6 years	case
6	years	year	NOUN	Number=Plur	3 watched	obl
7	through	through	ADP	_	9 phone	case
8	your	your	PRON	Case=Gen Person=2 Poss=Yes PronType=Prs	9 phone	nmod:poss
9	phone	phone	NOUN	Number=Sing	3 watched	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	watch	present · perfect · passive		It		your phone	year		vn assessment-34.1 «NP V NP.attribute»: subject=Theme you=Attribute

Option 3

It looked at your school reports

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	2 looked	nsubj
2	looked	look	VERB	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	root	root
3	at	at	ADP	_	6 reports	case
4	your	your	PRON	Case=Gen Person=2 Poss=Yes PronType=Prs	6 reports	nmod:poss
5	school	school	NOUN	Number=Sing	6 reports	compound
6	reports	report	NOUN	Number=Plur	2 looked	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	look	past	It					at your school reports	vn peer-30.3 «NP V PP.theme»: agent=Agent at report=Theme
2	report		your						nom report «communication transitive»: poss=agent

Option 4 · ✓ the right answer

Those words fit almost anyone; it is flattering

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Those	that	DET	Number=Plur PronType=Dem	2 words	det
2	words	word	NOUN	Number=Plur	3 fit	nsubj
3	fit	fit	VERB	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	root	root
4	almost	almost	ADV	_	5 anyone	advmod
5	anyone	anyone	PRON	Number=Sing PronType=Ind	3 fit	obj
6	;	;	PUNCT	_	9 flattering	punct
7	it	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	9 flattering	nsubj
8	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	9 flattering	aux
9	flattering	flatter	VERB	Tense=Pres VerbForm=Part	3 fit	conj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	fit	present	that words	anyone					vn adjust-26.9 «NP V NP»: agent=Agent anyone=Patient
2	flatter	present · progressive	it						vn amuse-31.1 «NP V NP-PRO-ARB»: agent=Stimulus

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t6/