Test 10 · ★★★ · Olympiad: thinking like a machine, Bebras puzzles ★★★

Put the steps for teaching a picture sorter in a sensible order.

Mova's choice: option 1 · The right answer: option 2 · wrong ✗ · Who acts: you · What happens: put, teach · To what, where: steps, picture sorter, sensible order

This is test 10 · ★★★ of lesson 31 «Olympiad: thinking like a machine, Bebras puzzles ★★★» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Put	put	VERB	Mood=Imp VerbForm=Fin	root	root
2	the	the	DET	Definite=Def PronType=Art	3 steps	det
3	steps	step	NOUN	Number=Plur	1 Put	obj
4	for	for	SCONJ	_	5 teaching	mark
5	teaching	teach	VERB	Tense=Pres VerbForm=Part	1 Put	advcl
6	a	a	DET	Definite=Ind PronType=Art	8 sorter	det
7	picture	picture	NOUN	Number=Sing	8 sorter	compound
8	sorter	sorter	NOUN	Number=Sing	5 teaching	obj
9	in	in	ADP	_	12 order	case
10	a	a	DET	Definite=Ind PronType=Art	12 order	det
11	sensible	sensible	ADJ	Degree=Pos	12 order	amod
12	order	order	NOUN	Number=Sing	5 teaching	obl
13	.	.	PUNCT	_	1 Put	punct

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	put	imperative	you not said here	the steps					vn invest-13.5.4-1 «NP V PP»: agent=Agent step=Goal
2	teach speech: other	gerund	you not said here	a picture sorter		a sensible order			vn transfer_mesg-37.1.1-1-1 «NP V NP.recipient»: agent=Agent sorter=Recipient

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1 · ← Mova's choice

Test it on new photos, collect photos, then let it learn

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Test	test	VERB	Mood=Imp VerbForm=Fin	root	root
2	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	1 Test	obj
3	on	on	ADP	_	5 photos	case
4	new	new	ADJ	Degree=Pos	5 photos	amod
5	photos	photo	NOUN	Number=Plur	1 Test	obl
6	,	,	PUNCT	_	8 photos	punct
7	collect	collect	ADJ	Degree=Pos	8 photos	amod
8	photos	photo	NOUN	Number=Plur	5 photos	conj
9	,	,	PUNCT	_	11 let	punct
10	then	then	ADV	PronType=Dem	11 let	advmod
11	let	let	VERB	Mood=Imp VerbForm=Fin	1 Test	conj
12	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	11 let	obj
13	learn	learn	VERB	VerbForm=Inf	11 let	xcomp

#	verb	tense, mood	who	what, whom	where	when	roles by
1	test	imperative	you not said here	it	new photos and collect photos		vn assessment-34.1 «NP V NP»: agent=Agent it=Theme
2	let	infinitive	you not said here	it		then	tree rules
3	learn	infinitive					vn learn-14-1 «NP V»: agent=Agent

Option 2 · ✓ the right answer

Collect labelled photos, let it learn, test it on new photos

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Collect	collect	NOUN	Number=Sing	5 let	obl:unmarked
2	labelled	labell	VERB	Tense=Past VerbForm=Part Voice=Pass	3 photos	amod
3	photos	photo	NOUN	Number=Plur	1 Collect	conj
4	,	,	PUNCT	_	1 Collect	punct
5	let	let	VERB	Mood=Imp VerbForm=Fin	root	root
6	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	5 let	obj
7	learn	learn	VERB	VerbForm=Inf	5 let	xcomp
8	,	,	PUNCT	_	9 test	punct
9	test	test	VERB	Mood=Imp VerbForm=Fin	5 let	conj
10	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	9 test	obj
11	on	on	ADP	_	13 photos	case
12	new	new	ADJ	Degree=Pos	13 photos	amod
13	photos	photo	NOUN	Number=Plur	9 test	obl

#	verb	tense, mood	who	what, whom	where	roles by
1	labell	participle				tree rules
2	let	imperative	you not said here	Collect and labelled photos		tree rules
3	learn	infinitive	Collect and labelled photos not said here			vn learn-14-1 «NP V»: agent=Agent
4	test	infinitive	you not said here	it	new photos	vn assessment-34.1 «NP V NP»: agent=Agent it=Theme

Option 3

Let it learn first, then collect the photos it needs

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Let	let	VERB	Mood=Imp VerbForm=Fin	root	root
2	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	1 Let	obj
3	learn	learn	VERB	VerbForm=Inf	1 Let	xcomp
4	first	first	ADV	NumForm=Word NumType=Ord	3 learn	advmod
5	,	,	PUNCT	_	7 collect	punct
6	then	then	ADV	PronType=Dem	7 collect	advmod
7	collect	collect	VERB	Mood=Imp VerbForm=Fin	1 Let	conj
8	the	the	DET	Definite=Def PronType=Art	9 photos	det
9	photos	photo	NOUN	Number=Plur	7 collect	obj
10	it	it	PRON	Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs	11 needs	nsubj
11	needs	need	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	9 photos	acl:relcl

#	verb	tense, mood	who	what, whom	when	other	roles by
1	let	imperative	you not said here	it			tree rules
2	learn	infinitive				first property	vn learn-14-1 «NP V»: agent=Agent
3	collect	infinitive	you not said here	the photos	then		vn obtain-13.5.2 «NP V NP»: agent=Agent photo=Theme
4	need	present	it	the photos not said here			vn want-32.1-1-1 «NP V NP ADV»: agent=Pivot photo=Theme

Option 4

Collect photos, test it, then throw away the labels

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Collect	collect	VERB	Mood=Imp VerbForm=Fin	root	root
2	photos	photo	NOUN	Number=Plur	1 Collect	obj
3	,	,	PUNCT	_	4 test	punct
4	test	test	VERB	Mood=Imp VerbForm=Fin	1 Collect	conj
5	it	it	PRON	Case=Acc Gender=Neut Number=Sing Person=3 PronType=Prs	4 test	obj
6	,	,	PUNCT	_	8 throw	punct
7	then	then	ADV	PronType=Dem	8 throw	advmod
8	throw	throw	VERB	Mood=Imp VerbForm=Fin	1 Collect	conj
9	away	away	ADP	_	8 throw	compound:prt
10	the	the	DET	Definite=Def PronType=Art	11 labels	det
11	labels	label	NOUN	Number=Plur	8 throw	obj

#	verb	tense, mood	who	what, whom	when	roles by
1	collect	imperative	you not said here	photos		vn obtain-13.5.2 «NP V NP»: agent=Agent photo=Theme
2	test	infinitive	you not said here	it		vn assessment-34.1 «NP V NP»: agent=Agent it=Theme
3	throw away	infinitive	you not said here	the labels	then	vn throw-17.1-1-1 «NP V NP»: agent=Agent label=Theme

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/31-olympiad-thinking-like-a-machine/t10/