Test 2 · ★ · Hallucinations: confident made-up answers

What would happen if you asked "Dogs are better than cats, right?"

Mova's choice: option 4 · The right answer: option 1 · wrong ✗ · Who acts: you, Dogs · What happens: happen, ask, be · Speech: someone speaks here

This is test 2 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	What	what	PRON	PronType=Int	3 happen	nsubj
2	would	would	AUX	VerbForm=Fin	3 happen	aux
3	happen	happen	VERB	VerbForm=Inf	root	root
4	if	if	SCONJ	_	6 asked	mark
5	you	you	PRON	Case=Nom Person=2 PronType=Prs	6 asked	nsubj
6	asked	ask	VERB	Mood=Ind Number=Sing Person=2 Tense=Past VerbForm=Fin	3 happen	advcl
7	"	"	PUNCT	_	10 better	punct
8	Dogs	dog	NOUN	Number=Plur	10 better	nsubj
9	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	10 better	cop
10	better	good	ADJ	Degree=Cmp	6 asked	ccomp
11	than	than	ADP	_	12 cats	case
12	cats	cat	NOUN	Number=Plur	10 better	obl
13	,	,	PUNCT	_	10 better	punct
14	right	right	INTJ	_	3 happen	discourse
15	?	?	PUNCT	_	3 happen	punct
16	"	"	PUNCT	_	3 happen	punct

#	verb	tense, mood	who	other	roles by
1	happen	would			vn occur-48.3-1 «NP V»: agent=Theme
2	ask speech: ask a condition, not said to happen	past	you		vn inquire-37.1.2 «NP V»: agent=Agent
3	is in a quote	present	Dogs	than cats; good property	tree rules

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ✓ the right answer

The bot might just agree with your hint

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 bot	det
2	bot	bot	NOUN	Number=Sing	5 agree	nsubj
3	might	might	AUX	VerbForm=Fin	5 agree	aux
4	just	just	ADV	_	5 agree	advmod
5	agree	agree	VERB	VerbForm=Inf	root	root
6	with	with	ADP	_	8 hint	case
7	your	your	PRON	Case=Gen Person=2 Poss=Yes PronType=Prs	8 hint	nmod:poss
8	hint	hint	NOUN	Number=Sing	5 agree	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	agree speech: agree	might	the bot					with your hint	vn correspond-36.1-1 «NP V PP.co-agent how S»: agent=Agent with hint=Co-Agent
2	hint		your						nom hint «communication intransitive»: poss=agent

Option 2

The bot would refuse to talk about pets

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 bot	det
2	bot	bot	NOUN	Number=Sing	4 refuse	nsubj
3	would	would	AUX	VerbForm=Fin	4 refuse	aux
4	refuse	refuse	VERB	VerbForm=Inf	root	root
5	to	to	PART	_	6 talk	mark
6	talk	talk	VERB	VerbForm=Inf	4 refuse	xcomp
7	about	about	ADP	_	8 pets	case
8	pets	pet	NOUN	Number=Plur	6 talk	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	refuse	would	the bot						vn reject-77.2 «NP V S_ING»: agent=Agent clause=Theme
2	not talk	to-infinitive	the bot not said here					about pets	vn talk-37.5 «NP V PP.topic»: agent=Agent about pet=Topic

Option 3

The bot would ask your dog

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 bot	det
2	bot	bot	NOUN	Number=Sing	4 ask	nsubj
3	would	would	AUX	VerbForm=Fin	4 ask	aux
4	ask	ask	VERB	VerbForm=Inf	root	root
5	your	your	PRON	Case=Gen Person=2 Poss=Yes PronType=Prs	6 dog	nmod:poss
6	dog	dog	NOUN	Number=Sing	4 ask	iobj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	ask speech: ask	would	the bot		your dog				vn inquire-37.1.2 «NP V NP.recipient»: agent=Agent dog=Recipient

Option 4 · ← Mova's choice

The bot would always say cats are better

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 bot	det
2	bot	bot	NOUN	Number=Sing	5 say	nsubj
3	would	would	AUX	VerbForm=Fin	5 say	aux
4	always	always	ADV	PronType=Tot	5 say	advmod
5	say	say	VERB	VerbForm=Inf	root	root
6	cats	cat	NOUN	Number=Plur	8 better	nsubj
7	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	8 better	cop
8	better	good	ADJ	Degree=Cmp	5 say	ccomp

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	say speech: assert	would	the bot					always property	vn say-37.7-1-1 «NP V that S»: agent=Agent
2	is	present	cats					good property	tree rules

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t2/