Mova0.5 pre-release⌕

☰

home / corpora / questions / AI / Hallucinations: confident made-up answ… / t5

Test 5 · ★ · Hallucinations: confident made-up answers

Two bots disagree about how tall a mountain is. What does that tell you?

Mova's choice: option 1 · The right answer: option 1 · right ✓ · Who acts: Two bots, mountain, that · What happens: disagree, be, tell · To what, where: you · Speech: someone speaks here

This is test 5 · ★ of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: Two bots disagree about how tall a mountain is.

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Two	two	NUM	NumForm=Word NumType=Card	2 bots	nummod
2	bots	bot	NOUN	Number=Plur	3 disagree	nsubj
3	disagree	disagree	VERB	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	root	root
4	about	about	ADP	_	6 tall	case
5	how	how	ADV	PronType=Int	6 tall	advmod
6	tall	tall	ADJ	Degree=Pos	3 disagree	obl
7	a	a	DET	Definite=Ind PronType=Art	8 mountain	det
8	mountain	mountain	NOUN	Number=Sing	6 tall	nsubj
9	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	6 tall	cop
10	.	.	PUNCT	_	3 disagree	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	disagree	present	Two bots						vn correspond-36.1 «NP V»: agent=Agent
2	is	present	a mountain					tall property	tree rules

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: What does that tell you?

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	What	what	PRON	PronType=Int	4 tell	obj
2	does	do	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	4 tell	aux
3	that	that	PRON	Number=Sing PronType=Dem	4 tell	nsubj
4	tell	tell	VERB	VerbForm=Inf	root	root
5	you	you	PRON	Case=Acc Person=2 PronType=Prs	4 tell	iobj
6	?	?	PUNCT	_	4 tell	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	tell speech: assert	present · do-support	that		you				vn transfer_mesg-37.1.1-1-1 «NP V NP-Dative NP»: agent=Agent you=Recipient what=Topic

The options

Option 1 · ← Mova's choice · ✓ the right answer

It's a sign to check a trusted source

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	4 sign	nsubj
2	's	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	4 sign	cop
3	a	a	DET	Definite=Ind PronType=Art	4 sign	det
4	sign	sign	NOUN	Number=Sing	root	root
5	to	to	PART	_	6 check	mark
6	check	check	VERB	VerbForm=Inf	4 sign	acl
7	a	a	DET	Definite=Ind PronType=Art	9 source	det
8	trusted	trust	VERB	Tense=Past VerbForm=Part Voice=Pass	9 source	amod
9	source	source	NOUN	Number=Sing	6 check	obj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is a	present	It	a sign					tree rules
2	check	to-infinitive		a trusted source					vn assessment-34.1 «NP V NP»: agent=Agent source=Theme
3	trust	participle							vn conjecture-29.5-1 «NP V that S»: agent=Agent

Option 2

One of them must be broken and needs fixing

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	One	one	NUM	NumForm=Word NumType=Card	6 broken	nsubj:pass
2	of	of	ADP	_	3 them	case
3	them	they	PRON	Case=Acc Number=Plur Person=3 PronType=Prs	1 One	nmod
4	must	must	AUX	VerbForm=Fin	6 broken	aux
5	be	be	AUX	VerbForm=Inf	6 broken	aux:pass
6	broken	break	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
7	and	and	CCONJ	_	8 needs	cc
8	needs	need	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	6 broken	conj
9	fixing	fixing	NOUN	Number=Sing	8 needs	obj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	break	must · passive		One of them					vn hurt-40.8.3-1-1 «NP V NP»: subject=Patient
2	need	present		fixing					vn want-32.1-1-1 «NP V NP ADV»: agent=Pivot fixing=Theme

Option 3

The mountain keeps changing its height every year

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 mountain	det
2	mountain	mountain	NOUN	Number=Sing	3 keeps	nsubj
3	keeps	keep	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
4	changing	change	VERB	VerbForm=Ger	3 keeps	xcomp
5	its	its	PRON	Case=Gen Gender=Neut Number=Sing Person=3 Poss=Yes PronType=Prs	6 height	nmod:poss
6	height	height	NOUN	Number=Sing	4 changing	obj
7	every	every	DET	PronType=Tot	8 year	det
8	year	year	NOUN	Number=Sing	4 changing	obl:unmarked

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	keep	present	the mountain						tree rules
2	change	gerund	the mountain not said here	mountain's height			year		vn dress-41.1.1-1-1 «NP V NP»: agent=Agent height=Patient

Option 4

Both are right in their own different way

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Both	both	DET	PronType=Tot	3 right	nsubj
2	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	3 right	cop
3	right	right	ADJ	Degree=Pos	root	root
4	in	in	ADP	_	8 way	case
5	their	their	PRON	Case=Gen Number=Plur Person=3 Poss=Yes PronType=Prs	8 way	nmod:poss
6	own	own	ADJ	Degree=Pos	8 way	amod
7	different	different	ADJ	Degree=Pos	8 way	amod
8	way	way	NOUN	Number=Sing	3 right	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is	present	Both			their own different way		right property	tree rules

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/t5/