Exam question 1 · In the news: invented court cases and an airline's chatbot

Which of the following statements most accurately characterises the reported submission to a court of cases generated by a chatbot?

Mova's choice: option 2 · The right answer: option 3 · wrong ✗ · What happens: follow, characteris, report, generate · To what, where: reported submission, cases

This is exam question 1 of lesson 20 «In the news: invented court cases and an airline's chatbot» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	Which	which	PRON	PronType=Rel	8 characterises	nsubj
2	of	of	ADP	_	5 statements	case
3	the	the	DET	Definite=Def PronType=Art	5 statements	det
4	following	follow	VERB	VerbForm=Ger	5 statements	amod
5	statements	statement	NOUN	Number=Plur	8 characterises	obl
6	most	most	ADV	Degree=Sup	7 accurately	advmod
7	accurately	accurately	ADV	_	8 characterises	advmod
8	characterises	characteris	VERB	Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin	root	root
9	the	the	DET	Definite=Def PronType=Art	11 submission	det
10	reported	report	VERB	Tense=Past VerbForm=Part Voice=Pass	11 submission	amod
11	submission	submission	NOUN	Number=Sing	8 characterises	obj
12	to	to	ADP	_	14 court	case
13	a	a	DET	Definite=Ind PronType=Art	14 court	det
14	court	court	NOUN	Number=Sing	8 characterises	obl
15	of	of	ADP	_	16 cases	case
16	cases	case	NOUN	Number=Plur	14 court	nmod
17	generated	generate	VERB	Tense=Past VerbForm=Part Voice=Pass	16 cases	acl
18	by	by	ADP	_	20 chatbot	case
19	a	a	DET	Definite=Ind PronType=Art	20 chatbot	det
20	chatbot	chatbot	NOUN	Number=Sing	17 generated	obl:agent
21	?	?	PUNCT	_	8 characterises	punct

#	verb	tense, mood	what, whom	other	roles by
1	follow	gerund			vn occur-48.3-1 «NP V»: agent=Theme
2	characteris	present	the reported submission	of the following statements; to a court of cases; accurately property	tree rules
3	report	participle			vn characterize-29.2-1-2 «NP V NP»: agent=Agent
4	generate	participle	cases not said here		vn grow-26.2.1 «NP.patient V PP.product»: agent=Patient

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

The options

Option 1

The court had authorised the use of invented cases

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 court	det
2	court	court	NOUN	Number=Sing	4 authorised	nsubj
3	had	have	AUX	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	4 authorised	aux
4	authorised	authorise	VERB	Tense=Past VerbForm=Part	root	root
5	the	the	DET	Definite=Def PronType=Art	6 use	det
6	use	use	NOUN	Number=Sing	4 authorised	obj
7	of	of	ADP	_	9 cases	case
8	invented	invent	VERB	Tense=Past VerbForm=Part Voice=Pass	9 cases	amod
9	cases	case	NOUN	Number=Plur	6 use	nmod

#	verb	tense, mood	who	what, whom	roles by
1	authorise	past · perfect	the court	the use of invented cases	tree rules
2	invent	participle			vn create-26.4-1 «NP V»: agent=Agent
3	use			invented cases	nom use «act transitive»: of=patient

Option 2 · ← Mova's choice

The chatbot had appeared before the court in person

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 chatbot	det
2	chatbot	chatbot	NOUN	Number=Sing	4 appeared	nsubj
3	had	have	AUX	Mood=Ind Number=Sing Person=3 Tense=Past VerbForm=Fin	4 appeared	aux
4	appeared	appear	VERB	Tense=Past VerbForm=Part	root	root
5	before	before	ADP	_	7 court	case
6	the	the	DET	Definite=Def PronType=Art	7 court	det
7	court	court	NOUN	Number=Sing	4 appeared	obl
8	in	in	ADP	_	9 person	case
9	person	person	NOUN	Number=Sing	7 court	nmod

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	appear	past · perfect	the chatbot			the court in person			vn appear-48.1.1 «NP V PP.location»: agent=Theme before court=Location

Option 3 · ✓ the right answer

The cases had been invented, and the advocates had failed to verify them

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 cases	det
2	cases	case	NOUN	Number=Plur	5 invented	nsubj:pass
3	had	have	AUX	Mood=Ind Number=Plur Person=3 Tense=Past VerbForm=Fin	5 invented	aux
4	been	be	AUX	Tense=Past VerbForm=Part	5 invented	aux:pass
5	invented	invent	VERB	Tense=Past VerbForm=Part Voice=Pass	root	root
6	,	,	PUNCT	_	11 failed	punct
7	and	and	CCONJ	_	11 failed	cc
8	the	the	DET	Definite=Def PronType=Art	9 advocates	det
9	advocates	advocate	NOUN	Number=Plur	11 failed	nsubj
10	had	have	AUX	Mood=Ind Number=Plur Person=3 Tense=Past VerbForm=Fin	11 failed	aux
11	failed	fail	VERB	Tense=Past VerbForm=Part	5 invented	conj
12	to	to	PART	_	13 verify	mark
13	verify	verify	VERB	VerbForm=Inf	11 failed	xcomp
14	them	they	PRON	Case=Acc Number=Plur Person=3 PronType=Prs	13 verify	obj

#	verb	tense, mood	who	what, whom	roles by
1	invent	past · perfect · passive		the cases	vn create-26.4-1 «NP V NP»: subject=Result
2	fail	past · perfect	the advocates		vn succeed-74-3-1-1 «NP V S_INF»: agent=Agent clause=Eventuality
3	not verify	to-infinitive	the advocates not said here	advocates = advocate	vn indicate-78-1-1 «NP V NP»: agent=Pivot they=Topic

Option 4

The cases were genuine but had been incorrectly summarised by the advocates concerned

The words, one row each (CoNLL-U)

#	word	lemma	UPOS	features	head	relation
1	The	the	DET	Definite=Def PronType=Art	2 cases	det
2	cases	case	NOUN	Number=Plur	4 genuine	nsubj
3	were	be	AUX	Mood=Ind Number=Plur Person=3 Tense=Past VerbForm=Fin	4 genuine	cop
4	genuine	genuine	ADJ	Degree=Pos	root	root
5	but	but	CCONJ	_	9 summarised	cc
6	had	have	AUX	Mood=Ind Number=Plur Person=3 Tense=Past VerbForm=Fin	9 summarised	aux
7	been	be	AUX	Tense=Past VerbForm=Part	9 summarised	aux:pass
8	incorrectly	incorrectly	ADV	_	9 summarised	advmod
9	summarised	summarise	VERB	Tense=Past VerbForm=Part Voice=Pass	4 genuine	conj
10	by	by	ADP	_	12 advocates	case
11	the	the	DET	Definite=Def PronType=Art	12 advocates	det
12	advocates	advocate	NOUN	Number=Plur	9 summarised	obl
13	concerned	concerned	ADJ	Degree=Pos	9 summarised	xcomp

#	verb	tense, mood	who	what, whom	to whom	where	when	other	roles by
1	is	past	the cases					genuine property	tree rules
2	summarise	past · perfect · passive	the advocates					concerned, incorrectly property	tree rules

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/20-news-court-cases-airline/e1/