Mova0.5 pre-release⌕
☰
home / corpora / questions / AI / How a language model learns: guessing… / e4

Exam question 4 · How a language model learns: guessing the next word

It is given that numerous distinct programs, when requested to select a number between one and ten, select seven. Ascertain the most probable explanation.

Mova's choice: option 1 · The right answer: option 1 · right ✓ · Who acts: numerous distinct programs, you · What happens: give, request, select, ascertain · To what, where: It, number, seven, probable explanation

This is exam question 4 of lesson 2 «How a language model learns: guessing the next word» of the AI course of Mova's primary school, asked in stiff, formal language. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: It is given that numerous distinct programs, when requested to select a number between one and ten, select seven.

nsubj:passaux:passmarkamodamodnsubjpunctadvmodacl:relclmarkxcompdetobjcasenmodccconjpunctadvclobjpunctrootItPRONisAUXgivenVERBthatSCONJnumerousADJdistinctADJprogramsNOUN,PUNCTwhenADVrequestedVERBtoPARTselectVERBaDETnumberNOUNbetweenADPoneNUMandCCONJtenNUM,PUNCTselectVERBsevenNUM.PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1ItitPRONCase=Nom Gender=Neut Number=Sing Person=3 PronType=Prs3 givennsubj:pass
2isbeAUXMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin3 givenaux:pass
3givengiveVERBTense=Past VerbForm=Part Voice=Passrootroot
4thatthatSCONJ_20 selectmark
5numerousnumerousADJDegree=Pos7 programsamod
6distinctdistinctADJDegree=Pos7 programsamod
7programsprogramNOUNNumber=Plur20 selectnsubj
8,,PUNCT_10 requestedpunct
9whenwhenADVPronType=Int10 requestedadvmod
10requestedrequestVERBTense=Past VerbForm=Part Voice=Pass7 programsacl:relcl
11totoPART_12 selectmark
12selectselectVERBVerbForm=Inf10 requestedxcomp
13aaDETDefinite=Ind PronType=Art14 numberdet
14numbernumberNOUNNumber=Sing12 selectobj
15betweenbetweenADP_16 onecase
16oneoneNUMNumForm=Word NumType=Card14 numbernmod
17andandCCONJ_18 tencc
18tentenNUMNumForm=Word NumType=Card16 oneconj
19,,PUNCT_7 programspunct
20selectselectVERBVerbForm=Inf3 givenadvcl
21sevensevenNUMNumForm=Word NumType=Card20 selectobj
22..PUNCT_3 givenpunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1givepresent · passiveItvn give-13.1-1 «NP V NP»: subject=Theme
2requestparticiplevn beg-58.2 «NP V S_INF»: agent=Agent clause=Topic
3selectto-infinitivea numberbetween onevn obtain-13.5.2 «NP V NP»: agent=Agent number=Theme
4selectinfinitivenumerous distinct programssevenvn obtain-13.5.2 «NP V NP»: agent=Agent seven=Theme

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: Ascertain the most probable explanation.

detadvmodamodobjpunctrootAscertainVERBtheDETmostADVprobableADJexplanationNOUN.PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1AscertainascertainVERBMood=Imp VerbForm=Finrootroot
2thetheDETDefinite=Def PronType=Art5 explanationdet
3mostmostADVDegree=Sup4 probableadvmod
4probableprobableADJDegree=Pos5 explanationamod
5explanationexplanationNOUNNumber=Sing1 Ascertainobj
6..PUNCT_1 Ascertainpunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1ascertainimperativeyou not said herethe probable explanationvn discover-84 «NP V NP»: agent=Agent explanation=Topic

The options

Option 1 · ← Mova's choice · ✓ the right answer

Such programs tend to reproduce the most frequent human preference

amodnsubjmarkxcompdetadvmodamodamodobjrootSuchADJprogramsNOUNtendVERBtoPARTreproduceVERBtheDETmostADVfrequentADJhumanADJpreferenceNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1SuchsuchADJDegree=Pos2 programsamod
2programsprogramNOUNNumber=Plur3 tendnsubj
3tendtendVERBMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Finrootroot
4totoPART_5 reproducemark
5reproducereproduceVERBVerbForm=Inf3 tendxcomp
6thetheDETDefinite=Def PronType=Art10 preferencedet
7mostmostADVDegree=Sup8 frequentadvmod
8frequentfrequentADJDegree=Pos10 preferenceamod
9humanhumanADJDegree=Pos10 preferenceamod
10preferencepreferenceNOUNNumber=Sing5 reproduceobj
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1tendpresentSuch programstree rules
2reproduceto-infinitiveSuch programs not said herethe frequent human preferencevn other_cos-45.4 «NP V NP.patient»: agent=Agent preference=Patient

Option 2

The programs have conferred with one another in advance of the request

detnsubj:passauxcaseoblfixedcaseoblcasedetnmodrootTheDETprogramsNOUNhaveAUXconferredVERBwithADPoneNUManotherDETinADPadvanceNOUNofADPtheDETrequestNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1ThetheDETDefinite=Def PronType=Art2 programsdet
2programsprogramNOUNNumber=Plur4 conferrednsubj:pass
3havehaveAUXMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin4 conferredaux
4conferredconferVERBTense=Past VerbForm=Part Voice=Passrootroot
5withwithADP_6 onecase
6oneoneNUMNumForm=Word NumType=Card4 conferredobl
7anotheranotherDETPronType=Ind6 onefixed
8ininADP_9 advancecase
9advanceadvanceNOUNNumber=Sing4 conferredobl
10ofofADP_12 requestcase
11thetheDETDefinite=Def PronType=Art12 requestdet
12requestrequestNOUNNumber=Sing9 advancenmod
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1conferpresent · perfect · passivethe programsadvance of the requestwith onetree rules
2advancethe requestnom advance «event intransitive»: of=agent

Option 3

Seven is the only integer such programs are able to produce

nsubjcopdetamodnsubjamodnsubjcopmarkxcomprootSevenNUMisAUXtheDETonlyADJintegerNOUNsuchADJprogramsNOUNareAUXableADJtoPARTproduceVERB
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1SevensevenNUMNumForm=Word NumType=Card9 ablensubj
2isbeAUXMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin9 ablecop
3thetheDETDefinite=Def PronType=Art5 integerdet
4onlyonlyADJDegree=Pos5 integeramod
5integerintegerNOUNNumber=Sing9 ablensubj
6suchsuchADJDegree=Pos7 programsamod
7programsprogramNOUNNumber=Plur9 ablensubj
8arebeAUXMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Fin9 ablecop
9ableableADJDegree=Posrootroot
10totoPART_11 producemark
11produceproduceVERBVerbForm=Inf9 ablexcomp
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1ispresentSevenable propertytree rules
2produceto-infinitiveSeven not said herevn create-26.4 «NP V NP»: agent=Agent

Option 4

The selection is governed by the date of the request

detnsubj:passaux:passcasedetoblcasedetnmodrootTheDETselectionNOUNisAUXgovernedVERBbyADPtheDETdateNOUNofADPtheDETrequestNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1ThetheDETDefinite=Def PronType=Art2 selectiondet
2selectionselectionNOUNNumber=Sing4 governednsubj:pass
3isbeAUXMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin4 governedaux:pass
4governedgovernVERBTense=Past VerbForm=Part Voice=Passrootroot
5bybyADP_7 datecase
6thetheDETDefinite=Def PronType=Art7 datedet
7datedateNOUNNumber=Sing4 governedobl
8ofofADP_10 requestcase
9thetheDETDefinite=Def PronType=Art10 requestdet
10requestrequestNOUNNumber=Sing7 datenmod
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1governpresent · passivethe date of the requestthe selectionvn supervision-95.2.2 «NP V NP.theme»: agent=Agent subject=Theme

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/e4/