Test 11 · ★ · Hallucinations: confident made-up answers

Why might a bot answer a question about your feelings badly?

Mova's choice: option 3 · The right answer: option 1 · wrong ✗ · Who acts: bot · What happens: answer · To what, where: question

This is test 11 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Why	why	ADV	PronType=Int	5 answer	advmod
2	might	might	AUX	VerbForm=Fin	5 answer	aux
3	a	a	DET	Definite=Ind PronType=Art	4 bot	det
4	bot	bot	NOUN	Number=Sing	5 answer	nsubj
5	answer	answer	VERB	VerbForm=Inf	root	root
6	a	a	DET	Definite=Ind PronType=Art	7 question	det
7	question	question	NOUN	Number=Sing	5 answer	obj
8	about	about	ADP	_	10 feelings	case
9	your	your	PRON	Case=Gen Person=2 Poss=Yes PronType=Prs	10 feelings	nmod:poss
10	feelings	feeling	NOUN	Number=Plur	5 answer	obl
11	badly	badly	ADV	Degree=Pos	5 answer	advmod
12	?	?	PUNCT	_	5 answer	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	answer speech: assert	might	a bot	a question				about your feelings; badly property	vn reciprocate-112-1 «NP V PP»: agent=Agent question=Eventuality

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ✓ the right answer

It only knows what you typed, not your life

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 knows	nsubj
2	only	only	ADV	_	3 knows	advmod
3	knows	know	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
4	what	what	PRON	PronType=Int	6 typed	obj
5	you	you	PRON	Case=Nom Person=2 PronType=Prs	6 typed	nsubj
6	typed	type	VERB	Mood=Ind Number=Sing Person=2 Tense=Past VerbForm=Fin	3 knows	ccomp
7	,	,	PUNCT	_	10 life	punct
8	not	not	PART	Polarity=Neg	10 life	advmod
9	your	your	PRON	Case=Gen Person=2 Poss=Yes PronType=Prs	10 life	nmod:poss
10	life	life	NOUN	Number=Sing	3 knows	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	know	present	It	your life					vn comprehend-87.2-1-1-1 «NP V how S_INF»: agent=Experiencer clause=Stimulus
2	type	past	you						vn scribble-25.2-1 «NP V NP»: agent=Agent what=Theme

Option 2

It knows too much about you already

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	2 knows	nsubj
2	knows	know	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
3	too	too	ADV	_	4 much	advmod
4	much	much	ADJ	Degree=Pos	2 knows	obj
5	about	about	ADP	_	6 you	case
6	you	you	PRON	Case=Acc Person=2 PronType=Prs	4 much	nmod
7	already	already	ADV	_	2 knows	advmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	know	present	It	much				about you	vn comprehend-87.2-1-1-1 «NP V NP PP.attribute»: agent=Experiencer much=Stimulus

Option 3 · ← Mova's choice

It is not allowed to talk about feelings

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	4 allowed	nsubj:pass
2	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	4 allowed	aux:pass
3	not	not	PART	Polarity=Neg	4 allowed	advmod
4	allowed	allow	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
5	to	to	PART	_	6 talk	mark
6	talk	talk	VERB	VerbForm=Inf	4 allowed	xcomp
7	about	about	ADP	_	8 feelings	case
8	feelings	feeling	NOUN	Number=Plur	6 talk	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	not allow	present · passive		It					vn allow-64.1-1 «NP V NP S»: subject=Beneficiary clause=Eventuality
2	talk not said to happen	to-infinitive						about feelings	vn talk-37.5 «NP V PP.topic»: agent=Agent about feeling=Topic

Option 4

It always tells you to cheer up

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 tells	nsubj
2	always	always	ADV	PronType=Tot	3 tells	advmod
3	tells	tell	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
4	you	you	PRON	Case=Acc Person=2 PronType=Prs	3 tells	iobj
5	to	to	PART	_	6 cheer	mark
6	cheer	cheer	VERB	VerbForm=Inf	3 tells	xcomp
7	up	up	ADP	_	6 cheer	compound:prt

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	tell speech: assert	present	It		you			always property	vn transfer_mesg-37.1.1-1-1 «NP V NP S_INF»: agent=Agent you=Recipient clause=Topic
2	cheer up not said to happen	to-infinitive							vn other_cos-45.4 «NP.patient V»: agent=Patient

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t11/