Mova0.5 pre-release⌕
☰
home / corpora / questions / AI / How a language model learns: guessing… / t5

Test 5 · How a language model learns: guessing the next word

In a cartoon a chatbot snores in its box at night. What is wrong with that?

Mova's choice: option 2 · The right answer: option 4 · wrong ✗ · Who acts: chatbot · What happens: snore, be

This is test 5 of lesson 2 «How a language model learns: guessing the next word» of the AI course of Mova's primary school. The page gives the question's syntax tree — a dependency tree in the style of Universal Dependencies — and its pragmatics clause by clause, then the 4 options as the student saw them, each with its tree and pragmatics. Every text is parsed by Mova itself. How the student answered it, with the score of every option and why: the test at school.

The question

Sentence 1: In a cartoon a chatbot snores in its box at night.

casedetobldetnsubjcasenmod:possoblcaseoblpunctrootInADPaDETcartoonNOUNaDETchatbotNOUNsnoresVERBinADPitsPRONboxNOUNatADPnightNOUN.PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1IninADP_3 cartooncase
2aaDETDefinite=Ind PronType=Art3 cartoondet
3cartooncartoonNOUNNumber=Sing6 snoresobl
4aaDETDefinite=Ind PronType=Art5 chatbotdet
5chatbotchatbotNOUNNumber=Sing6 snoresnsubj
6snoressnoreVERBMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Finrootroot
7ininADP_9 boxcase
8itsitsPRONCase=Gen Gender=Neut Number=Sing Person=3 Poss=Yes PronType=Prs9 boxnmod:poss
9boxboxNOUNNumber=Sing6 snoresobl
10atatADP_11 nightcase
11nightnightNOUNNumber=Sing6 snoresobl
12..PUNCT_6 snorespunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1snorepresenta chatbotnightin chatbot's box; in a cartoonvn nonverbal_expression-40.2 «NP V PP.theme»: agent=Agent in cartoon=Theme

One row per clause the reader finds. «not said here»: a role filled from the clause above. «roles by»: a VerbNet class and frame when one fits the verb, else the reader's rules on the tree.

Sentence 2: What is wrong with that?

nsubjcopcaseoblpunctrootWhatPRONisAUXwrongADJwithADPthatPRON?PUNCT
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1WhatwhatPRONPronType=Int3 wrongnsubj
2isbeAUXMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin3 wrongcop
3wrongwrongADJDegree=Posrootroot
4withwithADP_5 thatcase
5thatthatPRONNumber=Sing PronType=Dem3 wrongobl
6??PUNCT_3 wrongpunct
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1ispresentwith that; wrong propertytree rules

The options

Option 1

Nothing, bots sleep eight hours a night

vocativepunctnsubjnummodobldetobl:unmarkedrootNothingPRON,PUNCTbotsNOUNsleepVERBeightNUMhoursNOUNaDETnightNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1NothingnothingPRONNumber=Sing PronType=Neg4 sleepvocative
2,,PUNCT_1 Nothingpunct
3botsbotNOUNNumber=Plur4 sleepnsubj
4sleepsleepVERBMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Finrootroot
5eighteightNUMNumForm=Word NumType=Card6 hoursnummod
6hourshourNOUNNumber=Plur4 sleepobl
7aaDETDefinite=Ind PronType=Art8 nightdet
8nightnightNOUNNumber=Sing4 sleepobl:unmarked
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1sleeppresentbotshour; nightNothing vocativevn snooze-40.4-1 «NP V»: agent=Agent

Option 2 · ← Mova's choice

Chatbots only snore in the morning

nsubjadvmodcasedetoblrootChatbotsNOUNonlyADVsnoreVERBinADPtheDETmorningNOUN
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1ChatbotschatbotNOUNNumber=Plur3 snorensubj
2onlyonlyADV_3 snoreadvmod
3snoresnoreVERBMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Finrootroot
4ininADP_6 morningcase
5thetheDETDefinite=Def PronType=Art6 morningdet
6morningmorningNOUNNumber=Sing3 snoreobl
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1snorepresentChatbotsmorningvn nonverbal_expression-40.2 «NP V»: agent=Agent

Option 3

Bots dream but never snore

nsubjccadvmodconjrootBotsNOUNdreamVERBbutCCONJneverADVsnoreVERB
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1BotsbotNOUNNumber=Plur2 dreamnsubj
2dreamdreamVERBMood=Ind Number=Plur Person=3 Tense=Pres VerbForm=Finrootroot
3butbutCCONJ_5 snorecc
4neverneverADVPronType=Neg5 snoreadvmod
5snoresnoreVERBVerbForm=Inf2 dreamconj
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1dreampresentBotsvn cognize-85 «NP V PP.topic»: agent=Agent
2not snoreinfinitiveBots not said herevn nonverbal_expression-40.2 «NP V»: agent=Agent

Option 4 · ✓ the right answer

A program that is not running does nothing at all

detnsubjnsubjauxadvmodacl:relclobjcasenmodrootADETprogramNOUNthatPRONisAUXnotPARTrunningVERBdoesVERBnothingPRONatADPallDET
The words, one row each (CoNLL-U)
#wordlemmaUPOSfeaturesheadrelation
1AaDETDefinite=Ind PronType=Art2 programdet
2programprogramNOUNNumber=Sing7 doesnsubj
3thatthatPRONPronType=Rel6 runningnsubj
4isbeAUXMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Fin6 runningaux
5notnotPARTPolarity=Neg6 runningadvmod
6runningrunVERBTense=Pres VerbForm=Part2 programacl:relcl
7doesdoVERBMood=Ind Number=Sing Person=3 Tense=Pres VerbForm=Finrootroot
8nothingnothingPRONNumber=Sing PronType=Neg7 doesobj
9atatADP_10 allcase
10allallDETPronType=Tot8 nothingnmod
#verbtense, moodwhowhat, whomto whomwherewhenotherroles by
1not runpresent · progressivea programvn run-51.3.2-2-1 «NP V»: agent=Theme
2dopresenta programnothingallvn act-114-1 «NP V NP»: agent=Agent nothing=Eventuality

Text: the tests of Mova's primary school, written for Mova (world/data/school/), as the course runner gave them to the student. Trees: Mova's own parse — the en model on the CPU, when the site is built — not checked by a teacher; they may be wrong. Frames: Mova's frames reader (prag), each text read on its own. Elamur Cosmic License.

This page in Markdown → https://md.mova.elamur.ai/free/en/corpora/questions/ai/2-guessing-the-next-word/t5/