Test 7 · How a language model learns: guessing the next word

A bot gives an unkind answer about a group of people. What is the best way to think about it?

Mova's choice: option 1 · The right answer: option 2 · wrong ✗ · Who acts: bot, best way · What happens: give, be, think · To what, where: unkind answer

This is test 7 of lesson 2 «How a language model learns: guessing the next word» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: A bot gives an unkind answer about a group of people.

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	A	a	DET	Definite=Ind PronType=Art	2 bot	det
2	bot	bot	NOUN	Number=Sing	3 gives	nsubj
3	gives	give	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
4	an	a	DET	Definite=Ind PronType=Art	6 answer	det
5	unkind	unkind	ADJ	Degree=Pos	6 answer	amod
6	answer	answer	NOUN	Number=Sing	3 gives	obj
7	about	about	ADP	_	9 group	case
8	a	a	DET	Definite=Ind PronType=Art	9 group	det
9	group	group	NOUN	Number=Sing	6 answer	nmod
10	of	of	ADP	_	11 people	case
11	people	people	NOUN	Number=Plur	9 group	nmod
12	.	.	PUNCT	_	3 gives	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	give	present	a bot	a unkind answer				about a group of people	vn give-13.1-1 «NP V NP»: agent=Agent answer=Theme

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: What is the best way to think about it?

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	What	what	PRON	PronType=Int	root	root
2	is	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	1 What	cop
3	the	the	DET	Definite=Def PronType=Art	5 way	det
4	best	good	ADJ	Degree=Sup	5 way	amod
5	way	way	NOUN	Number=Sing	1 What	nsubj
6	to	to	PART	_	7 think	mark
7	think	think	VERB	VerbForm=Inf	5 way	acl
8	about	about	ADP	_	9 it	case
9	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	7 think	obl
10	?	?	PUNCT	_	1 What	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is a	present	the best way						tree rules
2	think speech: other	to-infinitive	the best way not said here					about way	vn focus-87.1-1 «NP V PP.topic»: agent=Agent about it=Topic

The options

Option 1 · ← Mova's choice

Bots are always fair to everyone, so the answer must be right and true

The tree, 14 words

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Bots	bot	NOUN	Number=Plur	4 fair	nsubj
2	are	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin	4 fair	cop
3	always	always	ADV	PronType=Tot	4 fair	advmod
4	fair	fair	ADJ	Degree=Pos	root	root
5	to	to	ADP	_	6 everyone	case
6	everyone	everyone	PRON	Number=Sing PronType=Tot	4 fair	obl
7	,	,	PUNCT	_	13 right	punct
8	so	so	ADV	_	13 right	advmod
9	the	the	DET	Definite=Def PronType=Art	10 answer	det
10	answer	answer	NOUN	Number=Sing	13 right	nsubj
11	must	must	AUX	VerbForm=Fin	13 right	aux
12	be	be	AUX	VerbForm=Inf	13 right	cop
13	right	right	ADJ	Degree=Pos	4 fair	conj
14	and	and	CCONJ	_	15 true	cc
15	true	true	ADJ	Degree=Pos	4 fair	conj

#	verb	tense, mood	who	other	roles by
1	is	present	Bots	to everyone; always, fair property	tree rules
2	is	must	the answer	right property	tree rules
3	be		Bots not said here		tree rules

Option 2 · ✓ the right answer

It may have picked up a bad pattern; tell a grown-up

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	4 picked	nsubj:pass
2	may	may	AUX	VerbForm=Fin	4 picked	aux
3	have	have	AUX	VerbForm=Inf	4 picked	aux
4	picked	pick	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
5	up	up	ADP	_	4 picked	compound:prt
6	a	a	DET	Definite=Ind PronType=Art	8 pattern	det
7	bad	bad	ADJ	Degree=Pos	8 pattern	amod
8	pattern	pattern	NOUN	Number=Sing	4 picked	obj
9	;	;	PUNCT	_	10 tell	punct
10	tell	tell	VERB	VerbForm=Inf	4 picked	conj
11	a	a	DET	Definite=Ind PronType=Art	14 up	det
12	grown	grown	NOUN	Number=Sing	14 up	compound
13	-	-	PUNCT	_	14 up	punct
14	up	up	NOUN	Number=Sing	10 tell	obj

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	pick up	may · perfect · passive		It					tree rules
2	tell speech: assert	infinitive		a grown up					vn transfer_mesg-37.1.1-1-1 «NP V NP.recipient»: agent=Agent up=Recipient

Option 3

Bots cannot say unkind things, so it didn't happen

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Bots	bot	NOUN	Number=Plur	4 say	nsubj
2	can	can	AUX	VerbForm=Fin	4 say	aux
3	not	not	PART	Polarity=Neg	4 say	advmod
4	say	say	VERB	VerbForm=Inf	root	root
5	unkind	unkind	ADJ	Degree=Pos	6 things	amod
6	things	thing	NOUN	Number=Plur	4 say	obj
7	,	,	PUNCT	_	12 happen	punct
8	so	so	ADV	_	12 happen	advmod
9	it	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	12 happen	nsubj
10	did	do	AUX	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	12 happen	aux
11	n't	not	PART	Polarity=Neg	12 happen	advmod
12	happen	happen	VERB	VerbForm=Inf	4 say	parataxis

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	not say speech: assert	can	Bots	unkind things					vn say-37.7-1-1 «NP V NP.topic»: agent=Agent thing=Topic
2	not happen	past · do-support	it						vn occur-48.3-1 «NP V»: agent=Theme

Option 4

It was written that way by a person on purpose

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	It	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	3 written	nsubj:pass
2	was	be	AUX	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	3 written	aux:pass
3	written	write	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
4	that	that	DET	Number=Sing PronType=Dem	5 way	det
5	way	way	NOUN	Number=Sing	3 written	obl:unmarked
6	by	by	ADP	_	8 person	case
7	a	a	DET	Definite=Ind PronType=Art	8 person	det
8	person	person	NOUN	Number=Sing	3 written	obl
9	on	on	ADP	_	10 purpose	case
10	purpose	purpose	NOUN	Number=Sing	8 person	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	write	past · passive	a person on purpose	It				that way obl:unmarked	vn scribble-25.2-1 «NP V NP»: agent=Agent subject=Theme

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/t7/