Exam question 1 · Sounding right and being right

Which of the following statements most accurately characterises the relationship between the plausibility and the correctness of a chatbot's answer?

Mova's choice: option 1 · The right answer: option 3 · wrong ✗ · Who acts: chatbot · What happens: follow, characteris, answer · To what, where: relationship

This is exam question 1 of lesson 3 «Sounding right and being right» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Which	which	PRON	PronType=Rel	8 characterises	nsubj
2	of	of	ADP	_	5 statements	case
3	the	the	DET	Definite=Def PronType=Art	5 statements	det
4	following	follow	VERB	VerbForm=Ger	5 statements	amod
5	statements	statement	NOUN	Number=Plur	8 characterises	obl
6	most	most	ADV	Degree=Sup	7 accurately	advmod
7	accurately	accurately	ADV	_	8 characterises	advmod
8	characterises	characteris	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
9	the	the	DET	Definite=Def PronType=Art	10 relationship	det
10	relationship	relationship	NOUN	Number=Sing	8 characterises	obj
11	between	between	ADP	_	13 plausibility	case
12	the	the	DET	Definite=Def PronType=Art	13 plausibility	det
13	plausibility	plausibility	NOUN	Number=Sing	10 relationship	nmod
14	and	and	CCONJ	_	16 correctness	cc
15	the	the	DET	Definite=Def PronType=Art	16 correctness	det
16	correctness	correctness	NOUN	Number=Sing	10 relationship	conj
17	of	of	ADP	_	21 answer	case
18	a	a	DET	Definite=Ind PronType=Art	19 chatbot	det
19	chatbot	chatbot	NOUN	Number=Sing	21 answer	nmod:poss
20	's	's	PART	_	19 chatbot	case
21	answer	answer	NOUN	Number=Sing	16 correctness	nmod
22	?	?	PUNCT	_	8 characterises	punct

#	verb	tense, mood	who	what, whom	other	roles by
1	follow	gerund				vn occur-48.3-1 «NP V»: agent=Theme
2	characteris	present		the relationship and the correctness of a chatbot's answer	of the following statements; between the plausibility; accurately property	tree rules
3	answer		a chatbot			nom answer «communication transitive»: poss=agent

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice

An implausible answer is invariably correct

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	An	a	DET	Definite=Ind PronType=Art	3 answer	det
2	implausible	implausible	ADJ	Degree=Pos	3 answer	amod
3	answer	answer	NOUN	Number=Sing	6 correct	nsubj
4	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	6 correct	cop
5	invariably	invariably	ADV	_	6 correct	advmod
6	correct	correct	ADJ	Degree=Pos	root	root

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is	present	a implausible answer					correct, invariably property	tree rules

Option 2

Plausibility and correctness are one and the same property

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Plausibility	plausibility	NOUN	Number=Sing	5 one	nsubj
2	and	and	CCONJ	_	3 correctness	cc
3	correctness	correctness	NOUN	Number=Sing	1 Plausibility	conj
4	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	5 one	cop
5	one	one	NUM	NumForm=Word NumType=Card	root	root
6	and	and	CCONJ	_	9 property	cc
7	the	the	DET	Definite=Def PronType=Art	9 property	det
8	same	same	ADJ	Degree=Pos	9 property	amod
9	property	property	NOUN	Number=Sing	5 one	conj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is a	present	Plausibility and correctness	one and the same property					tree rules

Option 3 · ✓ the right answer

An answer may appear entirely plausible and nonetheless be incorrect

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	An	a	DET	Definite=Ind PronType=Art	2 answer	det
2	answer	answer	NOUN	Number=Sing	4 appear	nsubj
3	may	may	AUX	VerbForm=Fin	4 appear	aux
4	appear	appear	VERB	VerbForm=Inf	root	root
5	entirely	entirely	ADV	_	4 appear	advmod
6	plausible	plausible	ADJ	Degree=Pos	4 appear	xcomp
7	and	and	CCONJ	_	8 nonetheless	cc
8	nonetheless	nonetheless	ADJ	Degree=Pos	6 plausible	conj
9	be	be	AUX	VerbForm=Inf	10 incorrect	cop
10	incorrect	incorrect	ADJ	Degree=Pos	6 plausible	conj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	appear	may	a answer					entirely, plausible property	vn appear-48.1.1 «NP V»: agent=Theme
2	is	infinitive	a answer not said here					incorrect property	tree rules

Option 4

A plausible answer is invariably correct

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	A	a	DET	Definite=Ind PronType=Art	3 answer	det
2	plausible	plausible	ADJ	Degree=Pos	3 answer	amod
3	answer	answer	NOUN	Number=Sing	6 correct	nsubj
4	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	6 correct	cop
5	invariably	invariably	ADV	_	6 correct	advmod
6	correct	correct	ADJ	Degree=Pos	root	root

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is	present	a plausible answer					correct, invariably property	tree rules

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/3-sounding-right-and-being-right/e1/