Mova0.5 pre-release⌕
☰
home / corpora / questions / AI / Why the bot agrees too easily / e4

Exam question 4 · Why the bot agrees too easily

A chatbot, having been instructed to select a team from a user's friends, excludes a newcomer. Ascertain where responsibility for the fairness of the selection resides.

Mova's choice: option 1 · The right answer: option 3 · wrong ✗ · Who acts: chatbot, you, responsibility · What happens: instruct, select, exclude, ascertain, reside · To what, where: chatbot, team, newcomer

This is exam question 4 of lesson 6 «Why the bot agrees too easily» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: A chatbot, having been instructed to select a team from a user's friends, excludes a newcomer.

detnsubjpunctauxaux:passacl:relclmarkxcompdetobjcasedetnmod:posscaseoblpunctdetobjpunctrootADETchatbotNOUN,PUNCThavingAUXbeenAUXinstructedVERBtoPARTselectVERBaDETteamNOUNfromADPaDETuserNOUN'sPARTfriendsNOUN,PUNCTexcludesVERBaDETnewcomerNOUN.PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1AaDETDefinite=Ind PronType=Art2 chatbotdet
2chatbotchatbotNOUNNumber=Sing17 excludesnsubj
3,,PUNCT_6 instructedpunct
4havinghaveAUXTense=Pres VerbForm=Part6 instructedaux
5beenbeAUXTense=Past VerbForm=Part6 instructedaux:pass
6instructedinstructVERBTense=Past VerbForm=Part Voice=Pass2 chatbotacl:relcl
7totoPART_8 selectmark
8selectselectVERBVerbForm=Inf6 instructedxcomp
9aaDETDefinite=Ind PronType=Art10 teamdet
10teamteamNOUNNumber=Sing8 selectobj
11fromfromADP_15 friendscase
12aaDETDefinite=Ind PronType=Art13 userdet
13useruserNOUNNumber=Sing15 friendsnmod:poss
14's'sPART_13 usercase
15friendsfriendNOUNNumber=Plur8 selectobl
16,,PUNCT_2 chatbotpunct
17excludesexcludeVERBMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Finrootroot
18aaDETDefinite=Ind PronType=Art19 newcomerdet
19newcomernewcomerNOUNNumber=Sing17 excludesobj
20..PUNCT_17 excludespunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1instruct speech: othergerund · perfect · passivea chatbot not said herevn advise-37.9-1 «NP V how S_INF»: clause=Topic
2selectto-infinitivea teamfrom a user's friendsvn obtain-13.5.2 «NP V NP PP.source»: agent=Agent team=Theme from friend=Source
3excludepresenta chatbota newcomervn forbid-64.4-1 «NP V NP»: agent=Causer newcomer=Theme

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: Ascertain where responsibility for the fairness of the selection resides.

advmodnsubjcasedetnmodcasedetnmodadvclpunctrootAscertainVERBwhereADVresponsibilityNOUNforADPtheDETfairnessNOUNofADPtheDETselectionNOUNresidesVERB.PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1AscertainascertainVERBMood=Imp VerbForm=Finrootroot
2wherewhereADVPronType=Rel10 residesadvmod
3responsibilityresponsibilityNOUNNumber=Sing10 residesnsubj
4forforADP_6 fairnesscase
5thetheDETDefinite=Def PronType=Art6 fairnessdet
6fairnessfairnessNOUNNumber=Sing3 responsibilitynmod
7ofofADP_9 selectioncase
8thetheDETDefinite=Def PronType=Art9 selectiondet
9selectionselectionNOUNNumber=Sing6 fairnessnmod
10residesresideVERBMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin1 Ascertainadvcl
11..PUNCT_1 Ascertainpunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1ascertainimperativeyou not said herevn discover-84 «NP V how S»: agent=Agent
2residepresentresponsibility for the fairness of the selectionvn exist-47.1 «NP V»: agent=Theme

The options

Option 1 · ← Mova's choice

With the newcomer, for want of friendship

casedetpunctcaseapposcasenmodrootWithADPtheDETnewcomerNOUN,PUNCTforADPwantNOUNofADPfriendshipNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1WithwithADP_3 newcomercase
2thetheDETDefinite=Def PronType=Art3 newcomerdet
3newcomernewcomerNOUNNumber=Singrootroot
4,,PUNCT_6 wantpunct
5forforADP_6 wantcase
6wantwantNOUNNumber=Sing3 newcomerappos
7ofofADP_8 friendshipcase
8friendshipfriendshipNOUNNumber=Sing6 wantnmod
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1wantfriendshipnom want «state transitive»: of=patient

Option 2

With the chatbot, it having produced the list of names

casedetoblpunctnsubj:passauxdetobjcasenmodrootWithADPtheDETchatbotNOUN,PUNCTitPRONhavingAUXproducedVERBtheDETlistNOUNofADPnamesNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1WithwithADP_3 chatbotcase
2thetheDETDefinite=Def PronType=Art3 chatbotdet
3chatbotchatbotNOUNNumber=Sing7 producedobl
4,,PUNCT_3 chatbotpunct
5ititPRONCase=Nom Gender=Neut Number=Sing Person=3 PronType=Prs7 producednsubj:pass
6havinghaveAUXTense=Pres VerbForm=Part7 producedaux
7producedproduceVERBTense=Past VerbForm=Part Voice=Passrootroot
8thetheDETDefinite=Def PronType=Art9 listdet
9listlistNOUNNumber=Sing7 producedobj
10ofofADP_11 namescase
11namesnameNOUNNumber=Plur9 listnmod
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1producegerund · perfect · passivechatbotwith the chatbottree rules
2listnamesnom list «communication transitive»: of=patient

Option 3 · ✓ the right answer

With the user, decisions concerning persons remaining his own

casedetpunctnsubjamodconjaclnmod:possobjrootWithADPtheDETuserNOUN,PUNCTdecisionsNOUNconcerningADJpersonsNOUNremainingVERBhisPRONownADJ
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1WithwithADP_3 usercase
2thetheDETDefinite=Def PronType=Art3 userdet
3useruserNOUNNumber=Singrootroot
4,,PUNCT_7 personspunct
5decisionsdecisionNOUNNumber=Plur7 personsnsubj
6concerningconcerningADJDegree=Pos7 personsamod
7personspersonNOUNNumber=Plur3 userconj
8remainingremainVERBVerbForm=Ger7 personsacl
9hishisPRONCase=Gen Gender=Masc Number=Sing Person=3 Poss=Yes PronType=Prs10 ownnmod:poss
10ownownADJDegree=Pos8 remainingobj
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1persondecisionstree rules
2remaingerundconcerning persons not said herehis ownvn seem-109-1-1 «NP V NP»: agent=Theme own=Attribute

Option 4

With no party, the decision having been mechanical

casedetoblpunctdetnsubjaclcoprootWithADPnoDETpartyNOUN,PUNCTtheDETdecisionNOUNhavingVERBbeenAUXmechanicalNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1WithwithADP_3 partycase
2nonoDETPronType=Neg3 partydet
3partypartyNOUNNumber=Sing9 mechanicalobl
4,,PUNCT_3 partypunct
5thetheDETDefinite=Def PronType=Art6 decisiondet
6decisiondecisionNOUNNumber=Sing9 mechanicalnsubj
7havinghaveVERBVerbForm=Ger6 decisionacl
8beenbeAUXTense=Past VerbForm=Part9 mechanicalcop
9mechanicalmechanicalNOUNNumber=Singrootroot
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1havegerundthe decision not said herevn birth-28.2-1 «NP V NP»: agent=Agent
2is aparticiplethe decisionmechanicalwith no partytree rules

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/6-why-the-bot-agrees-too-easily/e4/