Exam question 2 · How a language model learns: guessing the next word

Identify the principal reason for which a conversational program may state the time incorrectly.

Mova's choice: option 1 · The right answer: option 3 · wrong ✗ · Who acts: you, conversational program · What happens: identify, state · To what, where: principal reason

This is exam question 2 of lesson 2 «How a language model learns: guessing the next word» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Identify	identify	VERB	Mood=Imp VerbForm=Fin	root	root
2	the	the	DET	Definite=Def PronType=Art	4 reason	det
3	principal	principal	ADJ	Degree=Pos	4 reason	amod
4	reason	reason	NOUN	Number=Sing	1 Identify	obj
5	for	for	ADP	_	6 which	case
6	which	which	PRON	PronType=Rel	11 state	obl
7	a	a	DET	Definite=Ind PronType=Art	9 program	det
8	conversational	conversational	ADJ	Degree=Pos	9 program	amod
9	program	program	NOUN	Number=Sing	11 state	nsubj
10	may	may	AUX	VerbForm=Fin	11 state	aux
11	state	state	VERB	VerbForm=Inf	4 reason	acl
12	the	the	DET	Definite=Def PronType=Art	13 time	det
13	time	time	NOUN	Number=Sing	11 state	obj
14	incorrectly	incorrectly	ADV	_	11 state	advmod
15	.	.	PUNCT	_	1 Identify	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	identify	imperative	you not said here	the principal reason					vn characterize-29.2-1-1 «NP V NP S_ING»: agent=Agent reason=Theme
2	state speech: other	may	a conversational program				time	for the principal reason; incorrectly property	vn say-37.7-1-1 «NP V that S»: agent=Agent

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice

It is required by regulation to conceal the correct time from its users

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 required	nsubj:pass
2	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	3 required	aux:pass
3	required	require	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
4	by	by	ADP	_	5 regulation	case
5	regulation	regulation	NOUN	Number=Sing	3 required	obl
6	to	to	PART	_	7 conceal	mark
7	conceal	conceal	VERB	VerbForm=Inf	3 required	xcomp
8	the	the	DET	Definite=Def PronType=Art	10 time	det
9	correct	correct	ADJ	Degree=Pos	10 time	amod
10	time	time	NOUN	Number=Sing	7 conceal	obj
11	from	from	ADP	_	13 users	case
12	its	its	PRON	Case=Gen Gender=Neut Number=Sing Person=3 Poss=Yes PronType=Prs	13 users	nmod:poss
13	users	user	NOUN	Number=Plur	7 conceal	obl

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	require	present · passive	regulation	It					vn order-58.3-1 «NP V NP S_ING»: agent=Agent subject=Recipient clause=Topic
2	conceal	to-infinitive	regulation not said here			regulation's users	time		vn concealment-16 «NP V NP PP.beneficiary»: agent=Agent from user=Beneficiary

Option 2

It computes time solely from the position of the Moon

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	2 computes	nsubj
2	computes	compute	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
3	time	time	NOUN	Number=Sing	2 computes	obj
4	solely	solely	ADV	_	2 computes	advmod
5	from	from	ADP	_	7 position	case
6	the	the	DET	Definite=Def PronType=Art	7 position	det
7	position	position	NOUN	Number=Sing	2 computes	obl
8	of	of	ADP	_	10 Moon	case
9	the	the	DET	Definite=Def PronType=Art	10 Moon	det
10	Moon	Moon	PROPN	Number=Sing	7 position	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	compute	present	It			the position of the Moon	time	solely property	vn create-26.4 «NP V NP PP.material»: agent=Agent from position=Material

Option 3 · ✓ the right answer

It may lack access to a clock, its knowledge being confined to text gathered before a certain date

The tree, 18 words

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 lack	nsubj
2	may	may	AUX	VerbForm=Fin	3 lack	aux
3	lack	lack	VERB	VerbForm=Inf	root	root
4	access	access	NOUN	Number=Sing	3 lack	obj
5	to	to	ADP	_	7 clock	case
6	a	a	DET	Definite=Ind PronType=Art	7 clock	det
7	clock	clock	NOUN	Number=Sing	3 lack	obl
8	,	,	PUNCT	_	12 confined	punct
9	its	its	PRON	Case=Gen Gender=Neut Number=Sing Person=3 Poss=Yes PronType=Prs	10 knowledge	nmod:poss
10	knowledge	knowledge	NOUN	Number=Sing	12 confined	nsubj:pass
11	being	be	AUX	Tense=Pres VerbForm=Part	12 confined	aux:pass
12	confined	confine	VERB	Tense=Past VerbForm=Part Voice=Pass	3 lack	conj
13	to	to	ADP	_	14 text	case
14	text	text	NOUN	Number=Sing	12 confined	obl
15	gathered	gather	VERB	Tense=Past VerbForm=Part Voice=Pass	14 text	acl
16	before	before	ADP	_	19 date	case
17	a	a	DET	Definite=Ind PronType=Art	19 date	det
18	certain	certain	ADJ	Degree=Pos	19 date	amod
19	date	date	NOUN	Number=Sing	15 gathered	obl

#	verb	tense, mood	who	what, whom	where	when	other	roles by
1	lack	may	It	access			to a clock	tree rules
2	confine	gerund · passive		clock's knowledge	text			vn confine-92-1 «NP V NP PP.destination»: subject=Theme to text=Destination
3	gather	participle		text not said here		before a certain date		vn herd-47.5.2 «NP V»: agent=Theme

Option 4

It deliberately misleads every user in respect of the time

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 misleads	nsubj
2	deliberately	deliberately	ADV	_	3 misleads	advmod
3	misleads	mislead	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
4	every	every	DET	PronType=Tot	5 user	det
5	user	user	NOUN	Number=Sing	3 misleads	obj
6	in	in	ADP	_	7 respect	case
7	respect	respect	NOUN	Number=Sing	3 misleads	obl
8	of	of	ADP	_	10 time	case
9	the	the	DET	Definite=Def PronType=Art	10 time	det
10	time	time	NOUN	Number=Sing	7 respect	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	mislead	present	It	every user		respect of the time		deliberately property	vn trick-59.2 «NP V NP»: agent=Agent user=Patient
2	respect			the time					nom respect «cognition transitive»: of=patient

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/e2/