Internal and external dynamics in language: Evidence from verb regularity in a historical corpus of English
What it is about
Irregular verbs persist in English although rules are efficient. The paper looks at simple past tense verbs in the Corpus of Historical American English, from 1830 to 1989. For each verb and each decade it computes the share of irregular past tokens. It then sets equal token counts per decade, so that the period size does not bias the result. The total number of irregular types stays roughly constant, and irregular forms make up 65 to 70% of past tokens over the whole period. The growth of the regular class comes from new verbs entering the language (external pressure). Regularisation and irregularisation within the core vocabulary are about equal in size (internal dynamics), and they occur in a specific frequency window. The irregular verbs fall into 52 phonological classes, which the authors use to show that many irregulars follow minority rules.
Ideas
- I1. Sampling: take the equal-tokens-per-decade design for Mova's historical test sets (14. Sample texts, read word by word,
tools/gutenberg), so that one period does not dominate the measures. - I2.
en/src/morph.rs: a table of the 52 phonological classes for past-tense irregulars, with the most frequent irregular form as the class key, as the paper does. Measure the coverage of the irregular past forms on the lesson texts. - I3. 14. Irregular verbs: list the irregular verbs by frequency band, and flag the verbs in the mid-frequency window, where the paper finds the changes happen. Those entries are the ones to check first.
For Mova
The chapters are 14. Irregular verbs and 13. Verbs. The code is en/src/morph.rs (past-tense inflection and the morph::archaic forms). Measure: the share of past forms the morphology gets right on a held-out verb list, run twice, with the classes built from the training part only.
Cite
@misc{cuskley2014internal,
title = {{Internal and external dynamics in language: Evidence from verb regularity in a historical corpus of English}},
author = {Cuskley, Christine F. and Pugliese, Martina and Castellano, Claudio and Colaiori, Francesca and Loreto, Vittorio and Tria, Francesca},
year = {2014},
doi = {10.1371/journal.pone.0102882},
eprint = {1408.2699},
archivePrefix = {arXiv},
url = {https://doi.org/10.1371/journal.pone.0102882}
}References
- Whitney WD (1875) The life and growth of language, an outline of linguistic science. New York: D. Appleton & Company. find
- Liljencrants J, Lindblom B (1972) Numerical simulation of vowel quality systems: The role of perceptual contrast. Language 48: 839–862. find
- Lindblom B (1986) Phonetic universals in vowel systems. Experimental Phonology : 13–44. find
- Labov W (1972) Sociolinguistic patterns. 4. University of Pennsylvania Press. find
- Mühlhäusler P (1996) Linguistic ecology: language change and linguistic imperialism in the Pacific region. London: Routledge, xiv, 396 p pp. find
- Mufwene SS (2001) The Ecology of Language Evolution. Cambridge: Cambridge University Press. URL http://groups.lis.illinois.edu/amag/langev/paper/mufwene01book.html. ↗
- Lupyan G, Dale R (2010) Language structure is partly determined by social structure. PLoS ONE 5: e8559. find
- McMahon AM (1994) Understanding Language Change. Cambridge University Press, Cambridge UK. find
- Croft W (2000) Explaining language change: an evolutionary approach. Pearson Education Limited, Essex UK. find
- Jones MC, Esch E (2002) Language change: the interplay of internal, external, and extralinguistic factors. Walter de Gruter, New York. find
- Gries ST, Hilpert M (2010) Modeling diachronic change in the third person singular: a multifactorial verband author-specific exploratory approach. English Language and Linguistics 14: 293-320. find
- Hilpert M (2013) Constructional change in English: Developments in allomorphy, word formation, and syntax. Cambridge University Press, Cambridge UK. find
- Michel JB, Shen YK, Aiden AP, Veres A, Gray MK, et al. (2011) Quantitative analysis of culture using millions of digitized books. Science 331: 176-182. find
- Perc M (2012) Evolution of the most common english words and phrases over the centuries. Journal of the Royal Society Interface rsif20120491. find
- Petersen AM, Tenenbaum J, Havlin S, Stanley HE (2012) Statistical laws governing fluctuations in word use from word birth to word death. Scientific Reports 2: 1-9. find
- Petersen AM, Tenenbaum J, Havlin S, Stanley HE, Perc M (2012) Languages cool as they expand: Allometric scaling and the decreasing need for new words. Scientific Reports 2: 1-10. find
- Pinker S, Ullman M (2002) The past and future of the past tense. Trends in Cognitive Sciences 6: 456-463. find
- Lieberman E, Michel JB, Jackson J, Tang T, Nowak MA (2007) Quantifying the evolutionary dynamics of language. Nature 449: 713-716. find
- Carrol R, Svare R, Salmons J (2012) Quantifying the evolutionary dynamics of German verbs. Journal of Historical Linguistics 2: 153-172. find
- Bybee J (2007) Frequency of use and the organization of language. Oxford, UK: Oxford University Press. find
- Davies M (2012) Corpus of Historical American English: 400 million words from 1810-2010. URL http://corpus.byu.edu. ↗
- Pinker S (1999) Words and Rules: The ingredients of language. Harper Collins: New York. find
- Rumelhart DE, McClelland JL (1986) On learning the past tenses of english verbs. In: McClelland JL, Rumelhart DE, editors, Parallel Distributed Processing (Vol 2): Psychological and Biological Models, Cambridge: MIT Press. pp. 216-271. find
- McClelland JL, Patterson K (2002) ’words or rules’ cannot exploit the regularity in exceptions. Trends in Cognitive Sciences 6: 464-645. find
- Yang C (2002) Knowledge and learning in natural language. Oxford University Press, Oxford UK. find
- Heaps HS (1978) Information Retrieval: Computational and Theoretical Aspects. Orlando, FL, USA: Academic Press, Inc. find
- Zipf GK (1949) Human Behavior and the Principle of Least Effort. Addison-Wesley, Reading MA (USA). find
- Bybee JL (1985) Morphology: a study of relation between meaning and form. Benjamins: Amsterdam. find
- Kirby S, Cornish H, Smith K (2008) Cumulative cultural evolution in the laboratory: an experimental approach to the origins of structure in human language. Proceedings of the National Academy of Sciences 105: 10681-10686. find
- Albright A, Hayes B (2003) Rules vs. analogy in English past tenses: A computational/experimental study. Cognition 90: 119-161. find
- Pinker S (2000) The irregular verbs. Landfall : 83-85. find
- Bybee J (2001) Phonology and language use. Cambridge University Press: Cambridge. find
- Skousen R (1989) Analogical modeling of language. Dordrecht: Kluwer Academic Publishers. find
- Garside R (1987) The claws word-tagging system. In: Garside R, Leech G, Sampson G, editors, The computational analysis of English: A corpus-based approach,, London: Longman. pp. 30-41. find
- Gerlach M, Altmann EG (2013) Stochastic model for the vocabulary growth in natural languages. Phys Rev X 3: 021006. find
- Pinker S, Prince A (1994) Regular and irregular morphology and the psychological status of rules of grammar. In: Lima SD, L R, editors, The reality of linguistic rules, Philadelphia: John Benjamins. pp. 321-352. find
- Greenbaum S, Quirk R (1996) A student’s grammar of the english language. London: Longman. Figures A 6000 C 6000 5200 4400 2500 all R IR undef. Types find
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/cuskley-2014-internal-external-dynamics-language-evidence/