Test 10 · ★ · Hallucinations: confident made-up answers

"bot says the game's played with 3 bases, our school's wrong then" Is that right?

Mova's choice: option 1 · The right answer: option 1 · right ✓ · Who acts: bot, school, that · What happens: say, play, be · To what, where: game · Speech: someone speaks here

This is test 10 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	"	"	PUNCT	_	3 says	punct
2	bot	bot	NOUN	Number=Sing	3 says	nsubj
3	says	say	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
4	the	the	DET	Definite=Def PronType=Art	5 game	det
5	game	game	NOUN	Number=Sing	3 says	obj
6	's	's	PART	_	5 game	case
7	played	play	VERB	Tense=Past VerbForm=Part Voice=Pass	5 game	acl
8	with	with	ADP	_	10 bases	case
9	3	3	NUM	NumForm=Digit NumType=Card	10 bases	nummod
10	bases	basis	NOUN	Number=Plur	7 played	obl
11	,	,	PUNCT	_	15 wrong	punct
12	our	our	PRON	Case=Gen Number=Plur Person=1 Poss=Yes PronType=Prs	13 school	nmod:poss
13	school	school	NOUN	Number=Sing	15 wrong	nsubj
14	's	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	15 wrong	cop
15	wrong	wrong	ADJ	Degree=Pos	20 right	parataxis
16	then	then	ADV	PronType=Dem	15 wrong	advmod
17	"	"	PUNCT	_	15 wrong	punct
18	Is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	20 right	cop
19	that	that	PRON	Number=Sing PronType=Dem	20 right	nsubj
20	right	right	ADJ	Degree=Pos	3 says	conj
21	?	?	PUNCT	_	3 says	punct

#	verb	tense, mood	who	what, whom	when	other	roles by
1	say speech: assert in a quote	present	bot	the game			vn say-37.7-1-1 «NP V NP.topic»: agent=Agent game=Topic
2	play in a quote	participle		the game not said here		with 3 bases	vn play-114.2-1 «NP V PP.theme»: agent=Agent with basis=Theme
3	is in a quote	present	our school		then	wrong property	tree rules
4	is	present	that			right property	tree rules

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice · ✓ the right answer

No, local rules are decided by the people who play

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	No	no	INTJ	Polarity=Neg	6 decided	discourse
2	,	,	PUNCT	_	1 No	punct
3	local	local	ADJ	Degree=Pos	4 rules	amod
4	rules	rule	NOUN	Number=Plur	6 decided	nsubj:pass
5	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	6 decided	aux:pass
6	decided	decide	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
7	by	by	ADP	_	9 people	case
8	the	the	DET	Definite=Def PronType=Art	9 people	det
9	people	people	NOUN	Number=Plur	6 decided	obl:agent
10	who	who	PRON	PronType=Rel	11 play	nsubj
11	play	play	VERB	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	9 people	acl:relcl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	decide	present · passive	the people	local rules					vn correspond-36.1-1 «NP V S»: agent=Agent subject=Topic
2	play	present	the people						vn performance-26.7-1 «NP V»: agent=Agent

Option 2

No, the game has no rules at all

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	No	no	INTJ	Polarity=Neg	5 has	discourse
2	,	,	PUNCT	_	5 has	punct
3	the	the	DET	Definite=Def PronType=Art	4 game	det
4	game	game	NOUN	Number=Sing	5 has	nsubj
5	has	have	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
6	no	no	DET	PronType=Neg	7 rules	det
7	rules	rule	NOUN	Number=Plur	5 has	obj
8	at	at	ADP	_	9 all	case
9	all	all	DET	PronType=Tot	7 rules	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	have	present	the game	no rules		all			vn birth-28.2-1 «NP V NP»: agent=Agent rule=Patient

Option 3

Yes, there is only one correct version of every game

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Yes	yes	INTJ	Polarity=Pos	4 is	discourse
2	,	,	PUNCT	_	1 Yes	punct
3	there	there	PRON	PronType=Dem	4 is	expl
4	is	be	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
5	only	only	ADV	_	6 one	advmod
6	one	one	NUM	NumForm=Word NumType=Card	8 version	nummod
7	correct	correct	ADJ	Degree=Pos	8 version	amod
8	version	version	NOUN	Number=Sing	4 is	nsubj
9	of	of	ADP	_	11 game	case
10	every	every	DET	PronType=Tot	11 game	det
11	game	game	NOUN	Number=Sing	8 version	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	be	present	one correct version of every game			there			vn exist-47.1 «NP V»: agent=Theme

Option 4

Yes, schools must follow the bot

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Yes	yes	INTJ	Polarity=Pos	5 follow	discourse
2	,	,	PUNCT	_	1 Yes	punct
3	schools	school	NOUN	Number=Plur	5 follow	nsubj
4	must	must	AUX	VerbForm=Fin	5 follow	aux
5	follow	follow	VERB	VerbForm=Inf	root	root
6	the	the	DET	Definite=Def PronType=Art	7 bot	det
7	bot	bot	NOUN	Number=Sing	5 follow	obj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	follow	must	schools	the bot					vn chase-51.6 «NP V NP»: agent=Agent bot=Theme

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t10/