Test 9 · ★★ · Why the bot agrees too easily

When should Mia still check a bot's fact, even a famous one?

Mova's choice: option 1 · The right answer: option 3 · wrong ✗ · Who acts: Mia · What happens: check · To what, where: fact

This is test 9 · ★★ of lesson 6 «Why the bot agrees too easily» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	When	when	SCONJ	_	5 check	mark
2	should	should	AUX	VerbForm=Fin	5 check	aux
3	Mia	Mia	PROPN	Number=Sing	5 check	nsubj
4	still	still	ADV	_	5 check	advmod
5	check	check	VERB	VerbForm=Inf	root	root
6	a	a	DET	Definite=Ind PronType=Art	7 bot	det
7	bot	bot	NOUN	Number=Sing	9 fact	nmod:poss
8	's	's	PART	_	7 bot	case
9	fact	fact	NOUN	Number=Sing	5 check	obj
10	,	,	PUNCT	_	14 one	punct
11	even	even	ADV	_	14 one	advmod
12	a	a	DET	Definite=Ind PronType=Art	14 one	det
13	famous	famous	ADJ	Degree=Pos	14 one	amod
14	one	one	NOUN	Number=Sing	9 fact	appos
15	?	?	PUNCT	_	5 check	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	check	should	Mia	a bot's fact			still		vn assessment-34.1 «NP V NP»: agent=Agent fact=Theme

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice

Never, famous facts are always right

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Never	never	ADV	PronType=Neg	7 right	advmod
2	,	,	PUNCT	_	1 Never	punct
3	famous	famous	ADJ	Degree=Pos	4 facts	amod
4	facts	fact	NOUN	Number=Plur	7 right	nsubj
5	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	7 right	cop
6	always	always	ADV	PronType=Tot	7 right	advmod
7	right	right	ADJ	Degree=Pos	root	root

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	not is	present	famous facts					always, right property	tree rules

Option 2

Only on Fridays

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Only	only	ADV	_	3 Fridays	advmod
2	on	on	ADP	_	3 Fridays	case
3	Fridays	Friday	PROPN	Number=Plur	root	root

The frames reader finds no event or fact in this sentence.

Option 3 · ✓ the right answer

When it matters, like for homework

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	When	when	SCONJ	_	3 matters	mark
2	it	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 matters	nsubj
3	matters	matter	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	7 homework	advcl
4	,	,	PUNCT	_	3 matters	punct
5	like	like	ADP	_	7 homework	case
6	for	for	ADP	_	7 homework	case
7	homework	homework	NOUN	Number=Sing	root	root

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	matter	present	it						vn matter-91 «NP V»: agent=Stimulus

Option 4

Only when the bot says "I'm sure"

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Only	only	ADV	_	5 says	advmod
2	when	when	SCONJ	_	5 says	mark
3	the	the	DET	Definite=Def PronType=Art	4 bot	det
4	bot	bot	NOUN	Number=Sing	5 says	nsubj
5	says	say	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
6	"	"	PUNCT	_	9 sure	punct
7	I	I	PRON	Case=Nom Number=Sing Person=1 PronType=Prs	9 sure	nsubj
8	'm	be	AUX	Mood=Ind Number=Sing Person=1 Tense=Pres VerbForm=Fin	9 sure	cop
9	sure	sure	ADJ	Degree=Pos	5 says	ccomp
10	"	"	PUNCT	_	9 sure	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	say speech: assert	present	the bot						vn say-37.7-1-1 «NP V that S»: agent=Agent
2	is in a quote	present	the bot = bot					sure property	tree rules

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/6-why-the-bot-agrees-too-easily/t9/