Exam question 4 · Why the bot agrees too easily
A chatbot, having been instructed to select a team from a user's friends, excludes a newcomer. Ascertain where responsibility for the fairness of the selection resides.
Mova's choice: option 1 · The right answer: option 3 · wrong ✗ · Who acts: chatbot, you, responsibility · What happens: instruct, select, exclude, ascertain, reside · To what, where: chatbot, team, newcomer
This is exam question 4 of lesson 6 «Why the bot agrees too easily» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.
The question
Sentence 1: A chatbot, having been instructed to select a team from a user's friends, excludes a newcomer.
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | A | a | DET | Definite=Ind PronType=Art | 2 chatbot | det |
| 2 | chatbot | chatbot | NOUN | Number=Sing | 17 excludes | nsubj |
| 3 | , | , | PUNCT | _ | 6 instructed | punct |
| 4 | having | have | AUX | Tense=Pres VerbForm=Part | 6 instructed | aux |
| 5 | been | be | AUX | Tense=Past VerbForm=Part | 6 instructed | aux:pass |
| 6 | instructed | instruct | VERB | Tense=Past VerbForm=Part Voice=Pass | 2 chatbot | acl:relcl |
| 7 | to | to | PART | _ | 8 select | mark |
| 8 | select | select | VERB | VerbForm=Inf | 6 instructed | xcomp |
| 9 | a | a | DET | Definite=Ind PronType=Art | 10 team | det |
| 10 | team | team | NOUN | Number=Sing | 8 select | obj |
| 11 | from | from | ADP | _ | 15 friends | case |
| 12 | a | a | DET | Definite=Ind PronType=Art | 13 user | det |
| 13 | user | user | NOUN | Number=Sing | 15 friends | nmod:poss |
| 14 | 's | 's | PART | _ | 13 user | case |
| 15 | friends | friend | NOUN | Number=Plur | 8 select | obl |
| 16 | , | , | PUNCT | _ | 2 chatbot | punct |
| 17 | excludes | exclude | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | root | root |
| 18 | a | a | DET | Definite=Ind PronType=Art | 19 newcomer | det |
| 19 | newcomer | newcomer | NOUN | Number=Sing | 17 excludes | obj |
| 20 | . | . | PUNCT | _ | 17 excludes | punct |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | instruct speech: other | gerund · perfect · passive | a chatbot not said here | vn advise-37.9-1 «NP V how S_INF»: clause=Topic | |||||
| 2 | select | to-infinitive | a team | from a user's friends | vn obtain-13.5.2 «NP V NP PP.source»: agent=Agent team=Theme from friend=Source | ||||
| 3 | exclude | present | a chatbot | a newcomer | vn forbid-64.4-1 «NP V NP»: agent=Causer newcomer=Theme |
One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.
Sentence 2: Ascertain where responsibility for the fairness of the selection resides.
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | Ascertain | ascertain | VERB | Mood=Imp VerbForm=Fin | root | root |
| 2 | where | where | ADV | PronType=Rel | 10 resides | advmod |
| 3 | responsibility | responsibility | NOUN | Number=Sing | 10 resides | nsubj |
| 4 | for | for | ADP | _ | 6 fairness | case |
| 5 | the | the | DET | Definite=Def PronType=Art | 6 fairness | det |
| 6 | fairness | fairness | NOUN | Number=Sing | 3 responsibility | nmod |
| 7 | of | of | ADP | _ | 9 selection | case |
| 8 | the | the | DET | Definite=Def PronType=Art | 9 selection | det |
| 9 | selection | selection | NOUN | Number=Sing | 6 fairness | nmod |
| 10 | resides | reside | VERB | Mood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin | 1 Ascertain | advcl |
| 11 | . | . | PUNCT | _ | 1 Ascertain | punct |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | ascertain | imperative | you not said here | vn discover-84 «NP V how S»: agent=Agent | |||||
| 2 | reside | present | responsibility for the fairness of the selection | vn exist-47.1 «NP V»: agent=Theme |
The options
Option 1 · ← Mova's choice
With the newcomer, for want of friendship
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | With | with | ADP | _ | 3 newcomer | case |
| 2 | the | the | DET | Definite=Def PronType=Art | 3 newcomer | det |
| 3 | newcomer | newcomer | NOUN | Number=Sing | root | root |
| 4 | , | , | PUNCT | _ | 6 want | punct |
| 5 | for | for | ADP | _ | 6 want | case |
| 6 | want | want | NOUN | Number=Sing | 3 newcomer | appos |
| 7 | of | of | ADP | _ | 8 friendship | case |
| 8 | friendship | friendship | NOUN | Number=Sing | 6 want | nmod |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | want | friendship | nom want «state transitive»: of=patient |
Option 2
With the chatbot, it having produced the list of names
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | With | with | ADP | _ | 3 chatbot | case |
| 2 | the | the | DET | Definite=Def PronType=Art | 3 chatbot | det |
| 3 | chatbot | chatbot | NOUN | Number=Sing | 7 produced | obl |
| 4 | , | , | PUNCT | _ | 3 chatbot | punct |
| 5 | it | it | PRON | Case=Nom Gender=Neut Number=Sing Person=3 PronType=Prs | 7 produced | nsubj:pass |
| 6 | having | have | AUX | Tense=Pres VerbForm=Part | 7 produced | aux |
| 7 | produced | produce | VERB | Tense=Past VerbForm=Part Voice=Pass | root | root |
| 8 | the | the | DET | Definite=Def PronType=Art | 9 list | det |
| 9 | list | list | NOUN | Number=Sing | 7 produced | obj |
| 10 | of | of | ADP | _ | 11 names | case |
| 11 | names | name | NOUN | Number=Plur | 9 list | nmod |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | produce | gerund · perfect · passive | chatbot | with the chatbot | tree rules | ||||
| 2 | list | names | nom list «communication transitive»: of=patient |
Option 3 · ✓ the right answer
With the user, decisions concerning persons remaining his own
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | With | with | ADP | _ | 3 user | case |
| 2 | the | the | DET | Definite=Def PronType=Art | 3 user | det |
| 3 | user | user | NOUN | Number=Sing | root | root |
| 4 | , | , | PUNCT | _ | 7 persons | punct |
| 5 | decisions | decision | NOUN | Number=Plur | 7 persons | nsubj |
| 6 | concerning | concerning | ADJ | Degree=Pos | 7 persons | amod |
| 7 | persons | person | NOUN | Number=Plur | 3 user | conj |
| 8 | remaining | remain | VERB | VerbForm=Ger | 7 persons | acl |
| 9 | his | his | PRON | Case=Gen Gender=Masc Number=Sing Person=3 Poss=Yes PronType=Prs | 10 own | nmod:poss |
| 10 | own | own | ADJ | Degree=Pos | 8 remaining | obj |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | person | decisions | tree rules | ||||||
| 2 | remain | gerund | concerning persons not said here | his own | vn seem-109-1-1 «NP V NP»: agent=Theme own=Attribute |
Option 4
With no party, the decision having been mechanical
The words, one row each (CoNLL-U)
| # | word | lemma | UPOS | features | head | relation |
|---|---|---|---|---|---|---|
| 1 | With | with | ADP | _ | 3 party | case |
| 2 | no | no | DET | PronType=Neg | 3 party | det |
| 3 | party | party | NOUN | Number=Sing | 9 mechanical | obl |
| 4 | , | , | PUNCT | _ | 3 party | punct |
| 5 | the | the | DET | Definite=Def PronType=Art | 6 decision | det |
| 6 | decision | decision | NOUN | Number=Sing | 9 mechanical | nsubj |
| 7 | having | have | VERB | VerbForm=Ger | 6 decision | acl |
| 8 | been | be | AUX | Tense=Past VerbForm=Part | 9 mechanical | cop |
| 9 | mechanical | mechanical | NOUN | Number=Sing | root | root |
| # | verb | tense, mood | who | what, whom | to whom | where | when | other | roles by |
|---|---|---|---|---|---|---|---|---|---|
| 1 | have | gerund | the decision not said here | vn birth-28.2-1 «NP V NP»: agent=Agent | |||||
| 2 | is a | participle | the decision | mechanical | with no party | tree rules |
Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.
This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/6-why-the-bot-agrees-too-easily/e4/