Exam question 4 · Pretend games, quotes and two bots that disagree

Ascertain the reason for which a chatbot fails to retain words invented earlier in a protracted conversation.

Mova's choice: option 1 · The right answer: option 4 · wrong ✗ · Who acts: you, chatbot · What happens: ascertain, fail, not retain, invent, protract · To what, where: reason, words, protracted conversation

This is exam question 4 of lesson 7 «Pretend games, quotes and two bots that disagree» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Ascertain	ascertain	VERB	Mood=Imp VerbForm=Fin	root	root
2	the	the	DET	Definite=Def PronType=Art	3 reason	det
3	reason	reason	NOUN	Number=Sing	1 Ascertain	obj
4	for	for	ADP	_	5 which	case
5	which	which	PRON	PronType=Rel	8 fails	obl
6	a	a	DET	Definite=Ind PronType=Art	7 chatbot	det
7	chatbot	chatbot	NOUN	Number=Sing	8 fails	nsubj
8	fails	fail	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	3 reason	acl
9	to	to	PART	_	10 retain	mark
10	retain	retain	VERB	VerbForm=Inf	8 fails	xcomp
11	words	word	NOUN	Number=Plur	10 retain	obj
12	invented	invent	VERB	Tense=Past VerbForm=Part Voice=Pass	11 words	acl
13	earlier	early	ADV	Degree=Cmp	12 invented	advmod
14	in	in	ADP	_	17 conversation	case
15	a	a	DET	Definite=Ind PronType=Art	17 conversation	det
16	protracted	protract	VERB	Tense=Past VerbForm=Part Voice=Pass	17 conversation	amod
17	conversation	conversation	NOUN	Number=Sing	12 invented	obl
18	.	.	PUNCT	_	1 Ascertain	punct

#	verb	tense, mood	who	what, whom	where	other	roles by
1	ascertain	imperative	you not said here	the reason			vn discover-84 «NP V NP»: agent=Agent reason=Topic
2	fail	present	a chatbot			for the reason	vn succeed-74-3-1-1 «NP V S_INF»: agent=Agent clause=Eventuality
3	not retain	to-infinitive	a chatbot not said here	words			tree rules
4	invent	participle		words not said here	a protracted conversation	early property	vn create-26.4-1 «NP V»: agent=Agent
5	protract	participle					vn sustain-55.6 «NP V NP PP.instrument»: agent=Agent

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice

It retains only the final message of any conversation

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	2 retains	nsubj
2	retains	retain	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
3	only	only	ADV	_	6 message	advmod
4	the	the	DET	Definite=Def PronType=Art	6 message	det
5	final	final	ADJ	Degree=Pos	6 message	amod
6	message	message	NOUN	Number=Sing	2 retains	obj
7	of	of	ADP	_	9 conversation	case
8	any	any	DET	PronType=Ind	9 conversation	det
9	conversation	conversation	NOUN	Number=Sing	6 message	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	retain	present	It	the final message of any conversation					tree rules

Option 2

It has deliberately chosen to disregard the user

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	4 chosen	nsubj
2	has	have	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	4 chosen	aux
3	deliberately	deliberately	ADV	_	4 chosen	advmod
4	chosen	choose	VERB	Tense=Past VerbForm=Part	root	root
5	to	to	PART	_	6 disregard	mark
6	disregard	disregard	VERB	VerbForm=Inf	4 chosen	xcomp
7	the	the	DET	Definite=Def PronType=Art	8 user	det
8	user	user	NOUN	Number=Sing	6 disregard	obj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	choose	present · perfect	It					deliberately property	tree rules
2	disregard	to-infinitive		the user					vn neglect-75.1 «NP V NP»: agent=Agent user=Theme

Option 3

Invented words are prohibited by its makers

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Invented	invent	VERB	Tense=Past VerbForm=Part Voice=Pass	2 words	amod
2	words	word	NOUN	Number=Plur	4 prohibited	nsubj:pass
3	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	4 prohibited	aux:pass
4	prohibited	prohibit	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
5	by	by	ADP	_	7 makers	case
6	its	its	PRON	Case=Gen Gender=Neut Number=Sing Person=3 Poss=Yes PronType=Prs	7 makers	nmod:poss
7	makers	maker	NOUN	Number=Plur	4 prohibited	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	invent	participle							vn create-26.4-1 «NP V»: agent=Agent
2	prohibit	present · passive	its makers	Invented words					vn forbid-64.4-1 «NP V NP»: agent=Causer subject=Theme

Option 4 · ✓ the right answer

Long conversations may exceed the quantity of text it can keep in view at once

The tree, 15 words

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Long	long	ADJ	Degree=Pos	2 conversations	amod
2	conversations	conversation	NOUN	Number=Plur	4 exceed	nsubj
3	may	may	AUX	VerbForm=Fin	4 exceed	aux
4	exceed	exceed	VERB	VerbForm=Inf	root	root
5	the	the	DET	Definite=Def PronType=Art	6 quantity	det
6	quantity	quantity	NOUN	Number=Sing	4 exceed	obj
7	of	of	ADP	_	8 text	case
8	text	text	NOUN	Number=Sing	6 quantity	nmod
9	it	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	11 keep	nsubj
10	can	can	AUX	VerbForm=Fin	11 keep	aux
11	keep	keep	VERB	VerbForm=Inf	4 exceed	conj
12	in	in	ADP	_	13 view	case
13	view	view	NOUN	Number=Sing	11 keep	obl
14	at	at	ADP	_	15 once	case
15	once	once	ADV	NumForm=Word NumType=Mult	11 keep	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	exceed	may	Long conversations	the quantity of text					vn exceed-90 «NP V NP»: agent=Pivot quantity=Theme
2	keep	can	quantity			view			vn keep-15.2 «NP V NP PP.location»: agent=Agent in view=Location

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/7-pretend-games-quotes-and-two-bots/e4/