Exploring diachronic syntactic shifts with dependency length: the case of scientific English
What it is about
The authors test whether scientific English became more efficient over time, in the sense of shorter dependencies. They use the Royal Society Corpus for 1665 to 1996, which has 295,895,749 tokens, and parse it with Stanford CoreNLP. On 1,500 sampled head tags the parser is 91.1% accurate. For sentences of 26 tokens the sum of dependency lengths falls from 81.6 (1650 to 1700) to 77.1 (1800 to 1850) and then stays at 77.2. For sentences of 52 tokens it falls from 249 to 239. Short dependencies, especially nominal premodification, become more frequent. The labels parataxis and coordination could not be interpreted.
Ideas
- I1. Length replication: compute the sum of dependency lengths for sentences of 13, 26 and 52 tokens in EWT and in GUM (test only), and check whether the trend holds across lengths, as the paper argues it does.
- I2. Label audit: in
en ud-eval, report head accuracy for parataxis and conj separately. The paper found these labels unusable for its purpose. - I3. Head-accuracy sample: check 1,500 head tags of
enparses of our own historical-style text, as the paper does, with two annotators, and report the share correct.
For Mova
The code is en ud-eval and en/src/ctx.rs; the chapter is 21. The simple clause. The paper's parser is CoreNLP, which our notes record as weaker than en on some constructions, so the numbers are not comparable. The Royal Society Corpus is outside our licence list.
Cite
@inproceedings{juzek2020exploring,
title = {{Exploring diachronic syntactic shifts with dependency length: the case of scientific English}},
author = {Juzek, Tom S and Krielke, Marie Pauline and Teich, Elke},
booktitle = {Proceedings of the Fourth Workshop on Universal Dependencies (UDW 2020)},
year = {2020},
url = {https://aclanthology.org/2020.udw-1.13/}
}References
- Lars Ahrenberg. 2019. Towards an adequate account of parataxis in universal dependencies. In Proceedings of the Universal Dependencies Workshop 2019, Paris. find our card
- Dwight Atkinson. 1999. Scientific discourse in sociohistorical context: The Philosophical Transactions of the Royal Society of London, 1675-1975. Erlbaum, New York. find
- David Banks. 2008. The development of scientific writing. Linguistic features and historical context. Equinox, London, Oakville. find
- Brian Bartek, Richard L. Lewis, Shravan Vasishth, and Mason R. Smith. 2011. In search of on-line locality effects in sentence comprehension. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37(5):1178. find
- Douglas Biber and Bethany Gray. 2011. The historical shift of scientific academic prose in English towards less explicit styles of expression. Researching specialized languages, 47:11. find
- Douglas Biber and Bethany Gray. 2016. Grammatical complexity in academic English: Linguistic change in writing. Studies in English Language. Cambridge University Press. find
- Stefania Degaetano-Ortlieb and Elke Teich. 2019. Toward an optimal code for communication: The case of scientific English. Corpus Linguistics and Linguistic Theory (open access), pages 1–33. find
- Stefan Fischer, Katrin Menzel, Jörg Knappen, and Elke Teich. 2020. The Royal Society Corpus 6.0 providing 300+ years of scientific writing for humanistic study. In Proceedings of the Conference on Language Resources and Evaluation (LREC). ELRA. find
- Richard Futrell, Kyle Mahowald, and Edward Gibson. 2015. Large-scale evidence of dependency length minimization in 37 languages. Proceedings of the National Academy of Sciences, 112(33):10336–10341. ↗
- Edward Gibson, Richard Futrell, Steven Piantadosi, Isabelle Dautriche, Kyle Mahowald, Leon Bergen, and Roger Levy. 2019. How efficiency shapes human language. Trends in Cognitive Sciences, 23(5):389–407. find
- Edward Gibson. 1998. Linguistic complexity: Locality of syntactic dependencies. Cognition, 68(1):1–76. ↗
- Edward Gibson. 2000. The dependency locality theory: A distance-based theory of linguistic complexity. Image, language, brain, 2000:95–126. find
- Daniel Gildea and David Temperley. 2010. Do grammars minimize dependency length? 34(2):286–310. find
- Cognitive Science, Daniel Grodner and Edward Gibson. 2005. Consequences of the serial nature of linguistic input for sentenial complexity. Cognitive science, 29(2):261–290. find
- Kristina Gulordava and Paola Merlo. 2015. Diachronic trends in word order freedom and dependency length in dependency-annotated corpora of Latin and Ancient Greek. In Proceedings of the Third International Conference on Dependency Linguistics (Depling 2015), pages 121–130, Uppsala, Sweden. Uppsala University. find
- Kristina Gulordava, Paola Merlo, and Benoit Crabbé. 2015. Dependency length minimisation effects in short spans: a large-scale analysis of adjective placement in complex noun phrases. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 477–482. find
- Michael Hahn, Dan Jurafsky, and Richard Futrell. 2020. Universals of word order reflect optimization of grammars for efficient communication. Proceedings of the National Academy of Sciences, 117(5):2347–2353. find
- Michael A. K. Halliday and James R. Martin. 1993. Writing science: Literacy and discursive power. Falmer Press, London. find
- Michael A. K. Halliday. 1988. On the language of physical science. In Mohsen Ghadessy, editor, Registers of written English: Situational factors and linguistic features, pages 162–177. Pinter, London. find
- John A. Hawkins. 1994. A performance theory of order and constituency. Cambridge University Press. ↗
- John A. Hawkins. 2004. Efficiency and complexity in grammars. Oxford University Press. ↗
- John A. Hawkins. 2014. Cross-linguistic variation and efficiency. OUP Oxford. find
- Dan Klein and Christopher D. Manning. 2003. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1, ACL ’03, pages 423–430, Stroudsburg, PA, USA. Association for Computational Linguistics. find our card
- Anthony Kroch, Beatrice Santorini, and Ariel Diertani. 2010. Penn Parsed Corpus of Modern British English. find
- Lei Lei and Ju Wen. 2020. Is dependency distance experiencing a process of minimization? a diachronic study based on the state of the union addresses. Lingua, 239:102762. find
- Natalia Levshina. 2019. Universal dependencies in a galaxy far, far away... what makes Yoda’s English truly alien. In Proceedings of the Third Workshop on Universal Dependencies (UDW, SyntaxFest 2019), pages 35–45, Paris, France, August. Association for Computational Linguistics. find our card
- Haitao Liu, Chunshan Xu, and Junying Liang. 2017. Dependency distance: A new perspective on syntactic patterns in natural languages. Physics of life reviews, 21:171–193. ↗
- Haitao Liu. 2008. Dependency distance as a metric of language comprehension difficulty. Journal of Cognitive Science, 9(2):159–191. find
- Carey McIntosh. 1998. The evolution of English prose, 1700-1800: style, politeness and print culture. Cambridge University Press. find
- Joakim Nivre, Mitchell Abrams, and Željko Agić. 2019. Universal Dependencies 2.4. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University. find
- Rajakrishnan Rajkumar, Marten Van Schijndel, Michael White, and William Schuler. 2016. Investigating locality effects and surprisal in written English syntactic choice phenomena. Cognition, 155:204–232. find
- Jan Rijkhoff. 1990. Explaining word order in the noun phrase. Linguistics, 28(1):5–42. find
- David Temperley and Daniel Gildea. 2018. Minimizing syntactic dependency lengths: typological/cognitive universal? Annual Review of Linguistics, 4:67–80. find
- David Temperley. 2007. Minimization of dependency length in written English. Cognition, 105(2):300–333. find
- Harry Tily. 2010. The role of processing complexity in word order variation and change. Ph.D. thesis, Stanford University. find
- Thomas Wasow. 2002. Postverbal behavior. CSLI Stanford, CA. find
This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/ud-2020-juzek-exploring-diachronic-syntactic-shifts-dependency/