How Mova does at school

Mova's small language model, the student, goes through the lessons of its primary school one by one: it reads each lesson, learns from its exercises, and takes its tests and its exam — four options a question, chance about a quarter. Nothing here is answered by a large model: every choice is the student's own, and every choice says why.

Tests: 18472 of 49635 right (37.2%) · Exam: 5442 of 15723 right (34.6%) · By stars: plain 3291 of 7658 · ★ 11413 of 33041 · ★★ 2674 of 6077 · ★★★ 1094 of 2859 · Courses: 25 · Lessons: 3932 · Controls: all red in 25 of 25 courses · Run: 2026-10-18, commit f3c23ea72

The stars are the wit of a lesson: plain lessons ask what the lesson says, ★★★ is the olympiad level. The exam asks the same knowledge in stiff, formal, official language. A test the student did not understand — read into no frame that matched what it remembers — is a guess: it takes the first option shown.

The controls

Each course is run with three permanent controls beside the real student, and a score counts only when all three are red — below the real student's score. No lesson: a student of its own that reads no lesson, learns from the same exercises and takes the same tests; if it does as well, the score comes from the questions and options, not from the lessons. Questions shuffled: the real student answers each test's options under the next test's question; if that does as well, it is not reading the question. Key sentences removed: a student that reads each lesson without the sentence that holds each test's answer; if it does as well, the answers do not come from where the lesson says them. Two guessers set the bar beside them: one that always picks the longest option, one that always picks the first option shown (what the student does when it understands nothing).

The courses

The numbers

The runner is world knowledge course <course> --trace <file> in Mova's repository (world/src/knowledge.rs): the same run as without the trace, byte for byte, with every test written down. The courses' lessons are on the site too, sentence by sentence with their trees: the school in the corpora.

This page in Markdown → https://md.mova.elamur.ai/free/en/school-run/