Exam question 3 · Hallucinations: confident made-up answers

Select the response that is consistent with the established facts concerning quotations attributed to a public figure by a chatbot engaged in role-play.

Mova's choice: option 1 · The right answer: option 1 · right ✓ · Who acts: you, response · What happens: select, be, establish, attribute, engage · To what, where: response, concerning quotations, chatbot, role play

This is exam question 3 of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Select	select	VERB	Mood=Imp VerbForm=Fin	root	root
2	the	the	DET	Definite=Def PronType=Art	3 response	det
3	response	response	NOUN	Number=Sing	1 Select	obj
4	that	that	PRON	PronType=Rel	6 consistent	nsubj
5	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	6 consistent	cop
6	consistent	consistent	ADJ	Degree=Pos	3 response	acl:relcl
7	with	with	ADP	_	10 facts	case
8	the	the	DET	Definite=Def PronType=Art	10 facts	det
9	established	establish	VERB	Tense=Past VerbForm=Part Voice=Pass	10 facts	amod
10	facts	fact	NOUN	Number=Plur	6 consistent	obl
11	concerning	concerning	ADJ	Degree=Pos	12 quotations	amod
12	quotations	quotation	NOUN	Number=Plur	10 facts	conj
13	attributed	attribute	VERB	Tense=Past VerbForm=Part Voice=Pass	12 quotations	acl
14	to	to	ADP	_	17 figure	case
15	a	a	DET	Definite=Ind PronType=Art	17 figure	det
16	public	public	ADJ	Degree=Pos	17 figure	amod
17	figure	figure	NOUN	Number=Sing	13 attributed	obl
18	by	by	ADP	_	20 chatbot	case
19	a	a	DET	Definite=Ind PronType=Art	20 chatbot	det
20	chatbot	chatbot	NOUN	Number=Sing	13 attributed	obl:agent
21	engaged	engage	VERB	Tense=Past VerbForm=Part Voice=Pass	20 chatbot	acl
22	in	in	ADP	_	25 play	case
23	role	role	NOUN	Number=Sing	25 play	compound
24	-	-	PUNCT	_	23 role	punct
25	play	play	NOUN	Number=Sing	21 engaged	obl
26	.	.	PUNCT	_	1 Select	punct

#	verb	tense, mood	who	what, whom	other	roles by
1	select	imperative	you not said here	the response		vn obtain-13.5.2 «NP V NP»: agent=Agent response=Theme
2	is	present	the response		with the established facts and concerning quotations; consistent property	tree rules
3	establish	participle				vn indicate-78-1-1 «NP V NP to be NP»: agent=Pivot
4	attribute	participle		concerning quotations not said here	to a public figure	tree rules
5	engage	participle		a chatbot not said here	in role play goal	vn involve-107.1 «NP V NP PP.goal»: agent=Agent in play=Goal

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice · ✓ the right answer

Such quotations are fabricated and were never uttered by that person

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Such	such	ADJ	Degree=Pos	2 quotations	amod
2	quotations	quotation	NOUN	Number=Plur	4 fabricated	nsubj
3	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	4 fabricated	cop
4	fabricated	fabricated	ADJ	Degree=Pos	root	root
5	and	and	CCONJ	_	8 uttered	cc
6	were	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Past VerbForm=Fin	8 uttered	aux:pass
7	never	never	ADV	PronType=Neg	8 uttered	advmod
8	uttered	utter	VERB	Tense=Past VerbForm=Part Voice=Pass	4 fabricated	conj
9	by	by	ADP	_	11 person	case
10	that	that	DET	Number=Sing PronType=Dem	11 person	det
11	person	person	NOUN	Number=Sing	8 uttered	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is	present	Such quotations					fabricated property	tree rules
2	not utter speech: other	past · passive	that person						vn say-37.7-1 «NP V how S»: agent=Agent

Option 2

Such quotations are drawn verbatim from published interviews

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Such	such	ADJ	Degree=Pos	2 quotations	amod
2	quotations	quotation	NOUN	Number=Plur	4 drawn	nsubj:pass
3	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	4 drawn	aux:pass
4	drawn	draw	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
5	verbatim	verbatim	NOUN	Number=Plur	4 drawn	obj
6	from	from	ADP	_	8 interviews	case
7	published	publish	VERB	Tense=Past VerbForm=Part Voice=Pass	8 interviews	amod
8	interviews	interview	NOUN	Number=Plur	4 drawn	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	draw	present · passive		Such quotations		published interviews			vn create-26.4-1-1 «NP V NP.beneficiary NP»: subject=Beneficiary verbatim=Result
2	publish	participle							vn create-26.4 «NP V NP»: agent=Agent

Option 3

Such quotations are approved in advance by that person

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Such	such	ADJ	Degree=Pos	2 quotations	amod
2	quotations	quotation	NOUN	Number=Plur	4 approved	nsubj:pass
3	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	4 approved	aux:pass
4	approved	approve	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
5	in	in	ADP	_	6 advance	case
6	advance	advance	NOUN	Number=Sing	4 approved	obl
7	by	by	ADP	_	9 person	case
8	that	that	DET	Number=Sing PronType=Dem	9 person	det
9	person	person	NOUN	Number=Sing	4 approved	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	approve	present · passive	that person	Such quotations		advance			vn allow-64.1 «NP V NP»: agent=Agent subject=Beneficiary

Option 4

Such quotations are genuine provided they are plausible

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Such	such	ADJ	Degree=Pos	2 quotations	amod
2	quotations	quotation	NOUN	Number=Plur	5 provided	nsubj:pass
3	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	5 provided	aux:pass
4	genuine	genuine	ADJ	Degree=Pos	5 provided	amod
5	provided	provide	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
6	they	they	PRON	Case=Nom Number=Plur Person=3 PronType=Prs	8 plausible	nsubj
7	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	8 plausible	cop
8	plausible	plausible	ADJ	Degree=Pos	5 provided	xcomp

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	provide	present · passive		Such quotations					vn ensure-99 «NP V NP»: subject=Theme
2	is	present	quotations = quotation					plausible property	tree rules

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/e3/