Mova0.5 pre-release⌕

☰

home / corpora / questions / AI / Hallucinations: confident made-up answ… / e2

Exam question 2 · Hallucinations: confident made-up answers

It is given that two distinct chatbots furnish different answers to an identical factual question. Identify the most appropriate course of action.

Mova's choice: option 1 · The right answer: option 4 · wrong ✗ · Who acts: two distinct chatbots, you · What happens: give, furnish, identify · To what, where: It, different answers, identical factual question, appropriate course

This is exam question 2 of lesson 5 «Hallucinations: confident made-up answers» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: It is given that two distinct chatbots furnish different answers to an identical factual question.

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 given	nsubj:pass
2	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	3 given	aux:pass
3	given	give	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
4	that	that	SCONJ	_	8 furnish	mark
5	two	two	NUM	NumForm=Word NumType=Card	7 chatbots	nummod
6	distinct	distinct	ADJ	Degree=Pos	7 chatbots	amod
7	chatbots	chatbot	NOUN	Number=Plur	8 furnish	nsubj
8	furnish	furnish	VERB	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	3 given	advcl
9	different	different	ADJ	Degree=Pos	10 answers	amod
10	answers	answer	NOUN	Number=Plur	8 furnish	obj
11	to	to	ADP	_	15 question	case
12	an	a	DET	Definite=Ind PronType=Art	15 question	det
13	identical	identical	ADJ	Degree=Pos	15 question	amod
14	factual	factual	ADJ	Degree=Pos	15 question	amod
15	question	question	NOUN	Number=Sing	8 furnish	obl
16	.	.	PUNCT	_	3 given	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	give	present · passive		It					vn give-13.1-1 «NP V NP»: subject=Theme
2	furnish	present	two distinct chatbots	different answers	a identical factual question				vn fulfilling-13.4.1-1 «NP V NP PP.recipient»: agent=Agent answer=Theme to question=Recipient

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: Identify the most appropriate course of action.

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Identify	identify	VERB	Mood=Imp VerbForm=Fin	root	root
2	the	the	DET	Definite=Def PronType=Art	5 course	det
3	most	most	ADV	Degree=Sup	4 appropriate	advmod
4	appropriate	appropriate	ADJ	Degree=Pos	5 course	amod
5	course	course	NOUN	Number=Sing	1 Identify	obj
6	of	of	ADP	_	7 action	case
7	action	action	NOUN	Number=Sing	5 course	nmod
8	.	.	PUNCT	_	1 Identify	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	identify	imperative	you not said here	the appropriate course of action					vn characterize-29.2-1-1 «NP V NP S_ING»: agent=Agent course=Theme

The options

Option 1 · ← Mova's choice

Acceptance of the answer of greater length

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Acceptance	acceptance	NOUN	Number=Sing	root	root
2	of	of	ADP	_	4 answer	case
3	the	the	DET	Definite=Def PronType=Art	4 answer	det
4	answer	answer	NOUN	Number=Sing	1 Acceptance	nmod
5	of	of	ADP	_	7 length	case
6	greater	great	ADJ	Degree=Cmp	7 length	amod
7	length	length	NOUN	Number=Sing	4 answer	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	accept			the answer of greater length					nom acceptance «cognition transitive»: of=patient
2	answer			greater length					nom answer «communication transitive»: of=patient

Option 2

Acceptance of the answer received first

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Acceptance	acceptance	NOUN	Number=Sing	5 received	nsubj
2	of	of	ADP	_	4 answer	case
3	the	the	DET	Definite=Def PronType=Art	4 answer	det
4	answer	answer	NOUN	Number=Sing	1 Acceptance	nmod
5	received	receive	VERB	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	root	root
6	first	first	ADV	NumForm=Word NumType=Ord	5 received	advmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	receive	past	Acceptance of the answer					first property	vn obtain-13.5.2 «NP V NP»: agent=Agent
2	accept			the answer					nom acceptance «cognition transitive»: of=patient

Option 3

Repetition of the question until the answers coincide

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Repetition	repetition	NOUN	Number=Sing	8 coincide	nsubj
2	of	of	ADP	_	4 question	case
3	the	the	DET	Definite=Def PronType=Art	4 question	det
4	question	question	NOUN	Number=Sing	1 Repetition	nmod
5	until	until	ADP	_	7 answers	case
6	the	the	DET	Definite=Def PronType=Art	7 answers	det
7	answers	answer	NOUN	Number=Plur	4 question	nmod
8	coincide	coincide	VERB	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	root	root

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	coincide	present	Repetition of the question until the answers						vn amalgamate-22.2-2-1 «NP V»: agent=Patient
2	repeat		the question until the answers						nom repetition «event intransitive»: of=agent

Option 4 · ✓ the right answer

Consultation of a trusted independent source

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Consultation	consultation	NOUN	Number=Sing	root	root
2	of	of	ADP	_	6 source	case
3	a	a	DET	Definite=Ind PronType=Art	6 source	det
4	trusted	trust	VERB	Tense=Past VerbForm=Part Voice=Pass	6 source	amod
5	independent	independent	ADJ	Degree=Pos	6 source	amod
6	source	source	NOUN	Number=Sing	1 Consultation	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	trust	participle							vn conjecture-29.5-1 «NP V that S»: agent=Agent
2	consult		a trusted independent source						nom consultation «communication intransitive»: of=agent

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/5-hallucinations-confident-made-up-answers/e2/