Mova0.5 pre-release⌕
☰
home / docs / papers / English / Finding Variants for Construction-Based Dialectometry: A Corpus-Based Approach to Regional CxGs

Finding Variants for Construction-Based Dialectometry: A Corpus-Based Approach to Regional CxGs

What it is about

The paper proposes dialectometry on whole grammars. A construction grammar (4,504 constructions) is first induced from an independent corpus (ukWac), so no variant has to be chosen in advance. Each construction's relative frequency in a sample becomes a feature, and a linear SVM predicts the region of a sample. Two datasets are used: eight outer-circle varieties from the International Corpus of English (500 to 700 samples each, 2,000-word chunks) and five inner-circle varieties from web text (8,700 to 9,400 samples each). Classification reaches an F-measure of 0.97 for inner-circle and 0.92 for outer-circle varieties, against majority baselines of 0.07 and 0.03. The largest confusion is between Australian and New Zealand English (213 samples). A hierarchical test that merges regions finds no merge that improves accuracy, so the assumed regions hold.

Ideas

For Mova

Chapters: 37. Register and variation (region and register, the paper's key distinction), 08. National varieties. Code: en/src/parse.rs for UD subtrees as features, en/src/udreg.rs for the feature registry, and world/src/knowledge.rs for lesson-level classes. Measures: held-out F-measure per region, the confusion matrix, a majority baseline printed with every number. Run twice and check the output is identical before any claim.

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.1515/cog-2017-0029 · arXiv 2104.01299

@misc{dunn2021finding,
  title = {{Finding Variants for Construction-Based Dialectometry: A Corpus-Based Approach to Regional CxGs}},
  author = {Dunn, Jonathan},
  year = {2021},
  doi = {10.1515/cog-2017-0029},
  eprint = {2104.01299},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.1515/cog-2017-0029}
}

References

82 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Argamon, S., Koppel, M., Fine, J., & Shimoni, A. R. (2003). “Gender, genre, and writing style in formal written texts.” Text, 23(3). find
  2. Baayen, R.; Milin, P.; Durdevic , D.; Hendrix, P.; & Marelli, M. (2011). “An amorphous model for morphological processing in visual comprehension based on naive discriminative learning.” Psychological Review, 118: 438–482. find
  3. Baroni, M., Bernardini, S., Ferraresi, A., & Zanchetta, E. (2009). “The WaCky Wide Web: A Collection of Very Large Linguistically Processed Web-crawled Corpora.” Language Resources and Evaluation, 43: 209–226. find
  4. Biber, D. (2014). “Using multi-dimensional analysis to explore cross-linguistic universals of register variation.” Languages in Contrast, 14(1): 7-34. find
  5. Bybee, J. (2006). “From usage to grammar: The mind’s response to repetition.” Language, 82(4): 711-733. find
  6. Cilibrasi, R. & Vitanyi, P. (2007). “The Google Similarity Distance.” IEEE Trans. on Knowl. and Data Eng. 19(3): 370–383. find
  7. Claes, J. (2014). “A Cognitive Construction Grammar approach to the pluralization of presentational haber in Puerto Rican Spanish.” Language Variation and Change, 26(2): 219-246. find
  8. Dąbrowska, E. (2012). “Different speakers, different grammars: Individual differences in native language attainment.” Linguistic Approaches to Bilingualism, 2(3): 219-253, Dąbrowska, E. (2014). “Words that go together: Measuring individual differences in native speakers’ knowledge of collocations.” The Mental Lexicon, 9(3): 401-418. find
  9. Dijvak, D.; Dąbrowska, E.; Arppe, A. (2016). “Machine Meets Man: Evaluating the Psychological Reality of Corpus-based Probabilistic Models.” Cognitive Linguistics, 27(1): 1-33. find
  10. Dunn, J. (2017). “Computational Learning of Construction Grammars.” Language and Cognition, 9(2): 254-292. find
  11. Dunn, J. (2018). “Modeling the Complexity and Descriptive Adequacy of Construction Grammars.” In Proceedings of the Society for Computation in Linguistics (SCiL 2018). Stroudsburg, PA: Association for Computational Linguistics. 81-90. find
  12. Dunn, J.; Argamon, S; Rasooli, A.; & Kumar, G. (2016) “Profile-Based Authorship Analysis.” Literary and Linguistic Computing, 31(4): 689-710. find
  13. Firth, J. (1957). Papers in Linguistics, 1934-1951. Oxford: Oxford University Press. find
  14. Geeraerts, D. (2010). “Lexical Variation in Space.” In Auer, P. & Schmidt, J. (eds.), Language in Space: An International Handbook of Linguistic Variation. Volume 1: Theories and Methods. Berlin/New York: Mouton de Gruyter, 821–837. find
  15. Geeraerts, D. (2016). “The sociosemiotic commitment.” Cognitive Linguistics, 27(4): 527-542. find
  16. Gisborne, N. (2011). “Constructions, Word Grammar, and grammaticalization.” Cognitive Linguistics, 22(1): 155-182. find
  17. Goebl, H. (1982). Dialektometrie. Prinzipien und Methoden des Einsatzes der numerischen Taxonomie im Bereich der Dialektgeographie. Wien: O sterreichische Akademie der Wissenschaften (Denkschriften, Bd. 157). find
  18. Goebl, H. (1984). Dialektometrische Studien: Anhand italoromanischer, ra ̈toromanischer und galloromanischer Sprachmaterialien aus AIS und ALF. Tu bingen: Niemeyer (Beihefte zur Zeitschrift fu r romanische Philologie, Bd. 191). find
  19. Goebl, H. (2006). “Recent Advances in Salzburg Dialectometry.” Literary and Linguistic Computing, 21(4): 411-435. find
  20. Goldberg, A. (2006). Constructions at Work: The Nature of Generalization in Language. Oxford: Oxford University Press. find
  21. Goldberg, A. (2011). “Corpus Evidence of the Viability of Statistical Preemption.” Cognitive Linguistics, 22(1): 131-154. find
  22. Goldhahn, D.; Eckart, T.; Quasthoff, U. (2012). “Building Large Monolingual Dictionaries at the Leipzig Corpora Collection: From 100 to 200 Languages.” Proceedings of Language Resources and Evaluation 2012. find
  23. Grieve, J. (2013). “A Statistical Comparison of Regional Phonetic and Lexical Variation in American English.” Literary and Linguistic Computing, 28: 82-107. find
  24. Grieve, J. (2014). “A Comparison of Statistical Methods for the Aggregation of Regional Linguistic Variation.” In Szmrecsanyi, B. and Wa lchli, B. (eds.) Aggregating Dialectology, Typology, and Register Analysis: Linguistic Variation in Text and Speech. Berlin/New York: Walter de Gruyter. find
  25. Grieve, J. (2016). Regional Variation in Written American English. Cambridge, UK: Cambridge University Press. find
  26. Grieve, J.; Speelman, D.; & Geeraerts, D. (2011). “A Statistical Method for the Identification and Aggregation of Regional Linguistic Variation.” Language Variation & Change, 23: 1-29. find
  27. Heeringa, W. (2004). Measuring dialect pronunciation differences using Levenshtein distance. PhD. Diss. University of Groningen. find
  28. Henderson, J.; Zarrella, G.; Pfeifer, C.; & Burger, J. (2013). “Discriminating Non-Native English with 350 words.” In Proceedings of the 8 th Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics: Stroudsburg, PA. 101-110. find
  29. Hoffmann, T. & Trousdale, G. (2011). “Variation, Change, and Constructions in English.” Cognitive Linguistics, 22(1): 1-24. find
  30. Hollmann, W. & Siewierska, A. (2011). “The Status of Frequency, Schemas, and Identity in Cognitive Sociolinguistics: A Case Study on Definite Article Reduction.” Cognitive Linguistics, 22(1): 25-54. find
  31. Joachims, T. (1998). “Text categorization with Support Vector Machines: Learning with many relevant features.” In Ne’dellec, C. (ed) Machine Learning: ECML-98: 10th European Conference on Machine Learning. Berlin, Springer. 137-142. find
  32. Kay, P. and Fillmore, C. (1999). Grammatical constructions and linguistic generalizations: the Whats X Doing Y? construction. Language, 75(1): 1-33. find
  33. Koppel, M.; Schler, J.; & Bonchek-Dokow, E. (2007). “Measuring Differentiability: Unmasking Pseudonymous Authors.” Journal of Machine Learning Research, 8: 1,261-1,276. find
  34. Kortmann, B.; Schneider, E.; Burridge, K.; Mesthrie, R.; & Upton, C. (eds). (2004). A Handbook of Varieties of English. Berlin, New York: Mouton de Gruyter. find
  35. Kretzschmar, W. (1992). “Isoglosses and Predictive Modeling.” American Speech, 67(3): 227-249. find
  36. Kretzschmar, W. (1996). “Quantitative Areal Analysis of Dialect Features.” Language Variation & Change, 8: 13-39. find
  37. Kretzschmar, W.; Juuso, I.; & Bailey, C. (2014). “Computer Simulation of Dialect Feature Diffusion.” Journal of Linguistic Geography, 2: 41-57. find
  38. Labov, W.; Ash, S.; & Boberg, C. (2005). The Atlas of North American English: Phonetics, Phonology and Sound Change. Berlin: De Gruyter Mouton. find
  39. Langacker, R. (1987). Foundations of Cognitive Grammar, Vol. 1: Theoretical Prerequisites. Stanford: Stanford University Press. find
  40. Langacker, R. (2008). Cognitive Grammar: A Basic Introduction. Oxford: Oxford University Press. find
  41. Lee, J. & Kretzschmar, W. (1993). “Spatial Analysis of Linguistic Data with GIS Functions.” International Journal of Geographical Information Systems, 7(6): 541-560. find
  42. Levshina, N. (2016). “When variables align: A Bayesian multinomial mixed-effects model of English permissive constructions.” Cognitive Linguistics, 27(2): 235-268. find
  43. Milin, P.; Divjak, D.; Dimitrijevic , S.; & Baayen, H. (2016) “Towards cognitively plausible data science in language research.” Cognitive Linguistics, 27(4): 507-526. find
  44. Nagy, N. (2016). “Heritage Languages as New Dialects.” In Cote, M. & Nerbonne, J. (eds.) The Future of Dialects. Berlin: Language Science Press. 15-35. find
  45. Nelson, G.; Wallis, S.; Aarts, B. (2002). Exploring Natural Language. Working with the British Component of the International Corpus of English. Amsterdam: John Benjamins. find
  46. Nerbonne, J. (2006). “Identifying Linguistic Structure in Aggregate Comparison.’ Literary and Linguistic Computing 21(4): 463-476. find
  47. Nerbonne, J. (2009). “Data-Driven Dialectology.” Language and Linguistics Compass, 3(1); 175-198. find
  48. Nerbonne, J. & Heeringa, W. (2010). “Measuring Dialect Differences.” In: Ju rgen, S. & Auer, P. (eds.) Language and Space: Theories and Methods in series Handbooks of Linguistics and Communication Science. Berlin: Mouton De Gruyter. 550-567. find
  49. Nerbonne, J. & Kleiweg, P. (2007). “Toward a Dialectological Yardstick.” Journal of Quantitative Linguistics, 14(2/3): 148-166. find
  50. Nerbonne, J. & Kretzschmar, W. (2013). “Dialectometry++”. Literary and Linguistic Computing, 28(1): 2-12. find
  51. Nerbonne, J.; Kleiweg, P.; Heeringa, W. & Manni, F. (2008). “Projecting dialect distances to geography: Bootstrap clustering vs. noisy clustering.” In Preisach, C.; Schmidt-Thieme, L.; Burkhardt, H.; & Decker, R. (eds.) Data Analysis, Machine Learning and Applications. Berlin: Springer. 647-654. find
  52. Nguyen, Dat Quoca; Nguyen, Dai Quocb; Pham, Dang Ducc; and Pham, Son Baod. (2016). “A Robust Transformation-based Learning Approach Using Ripple Down Rules for Part-of-Speech Tagging.” AI Communications, 29(3): 409-422. find
  53. Onishi, T. (2016). “Timespan Comparison of Dialectal Distributions.” In Cote, M. & Nerbonne, J. (eds.) The Future of Dialects. Berlin: Language Science Press. 377-388. find
  54. Peirsman, Y.; Geeraerts, D.; & Speelman, D. (2010). “The Automatic Identification of Lexical Variation Between Language Varieties.” Natural Language Engineering, 16(4): 469-491. find
  55. Petrov, S.; Das, D.; and McDonald, R. (2012). “A Universal Part-of-Speech Tagset.” In Proceedings of the Eight International Conference on Language Resources and Evaluation. find
  56. Pickl, S. (2016). “Fuzzy Dialect Areas and Prototype Theory: Discovering Latent Patterns in Geolinguistic Variation.” In Cote, M. & Nerbonne, J. (eds.) The Future of Dialects. Berlin: Language Science Press. 75-98. find
  57. Pickl, S.; Spettl, A.; Proll, S.; Elspaß, S.; Konig, W.; & Schmidt, V. (2014). “Linguistic Distances in Dialectometric Intensity Estimation.” Journal of Linguistic Geography, 2: 25-40. find
  58. Proll, S. (2013). “Detecting Structures in Linguistic Maps: Fuzzy Clustering for Pattern Recognition in Geostatistical Dialectometry.” Literary and Linguistic Computing, 28(1): 108-118. find
  59. Rehurek, R. & Sojka, P. (2010). “Software Framework for Topic Modelling with Large Corpora.” Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. European Language Resources Association, Paris. 45–50. find
  60. Roller, S.; Speriosu, M.; Rallapalli, S.; Wing, B.; Baldridge, J. (2012). “Supervised Text-based Geolocation Using Language Models on an Adaptive Grid.” Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Stroudsburg, PA: Association for Computational Linguistics. 1,500-1,510. find
  61. Ruette, T.; Geeraerts, D.; Speelman, D. (2014). “Lexical Variation in Aggregate Perspective.” In: da Silva Soares, Augusto (Ed.), Pluricentricity: Language Variation and Sociocognitive Dimensions. Berlin: de Gruyter. 103-126. find
  62. Rumpf, J.; Pickl, S.; Elspaß, S.; Konig, W.; & Schmidt, V. (2009). “Structural Analysis of Dialect Maps Using Methods from Spatial Statistics.” In Zeitschrift für Dialektologie und Linguistik, Bd. 76, H. 3 Stuttgart: Franz Steiner Verlag. 280-308. find
  63. Sanders, N. (2007). “Measuring syntactic difference in British English.” Proceedings of the 45th Annual Meeting of the ACL: Student Research Workshop. Association for Computational Linguistics. find
  64. Sanders, N. (2010). A Statistical Method for Syntactic Dialectometry. PhD Diss., Indiana University. find
  65. Schmid, H. (2016). “Why Cognitive Linguistics must embrace the social and pragmatic dimensions of language and how it could do so more seriously.” Cognitive Linguistics, 27(4): 543-557. find
  66. Schneider, E. (2007). Postcolonial English: Varieties Around the World. Cambridge, UK: Cambridge University Press. find
  67. Se guy, J. (1973). “La dialectome trie dans l’Atlas linguistique de la Gascogne.” Revue de linguistique romane, 37:751–24. find
  68. Siblr, P.; Weibel, R.; Glaser, E.; & Bart, G. (2012). “Cartographic Visualization in Support of Dialectology.” In Proceedings of AutoCarto 2012. find
  69. Stefanowitsch, A. (2011). “Constructional preemption by contextual mismatch: A corpus-linguistic investigation.” Cognitive Linguistics, 22(1): 107-129. find
  70. Szmrecsanyi, B. (2009). “Corpus-based Dialectometry: Aggregate Morphosyntactic Variability in British English Dialects.” International Journal of Humanities and Arts Computing, 2(1/2): 279-296. find
  71. Szmrecsanyi, B. (2013). Grammatical Variation in British English Dialects: A Study in Corpus-Based Dialectometry. Studies in English Language, Cambridge: Cambridge University Press. find
  72. Szmrecsanyi, B. (2014). “Forests, Trees, Corpora, and Dialect Grammars.” In Aggregating Dialectology, Typology, and Register Analysis: Linguistic Variation in Text and Speech. Berlin: De Gruyter. 89-112. find
  73. Szmrecsanyi, B. (2016). “About text frequencies in historical linguistics: Disentangling environmental and grammatical change.” Corpus Linguistics and Linguistic Theory, 12(1): 153-171. find
  74. Uiboaed, K.; Hasselblatt, C.; Lindstro m, L.; Muischnek, K.; & Nerbonne, J. (2013). “Variation of verbal constructions in Estonian dialects.” Literary and Linguistic Computing, 28(1): 42-62. find
  75. Wible, D. & Tsao, N. (2010). “StringNet as a computational resource for discovering and investigating linguistic constructions.” In Proceedings of the Workshop on Extracting and Using Constructions in Computational Linguistics (NAACL-HTL): 25-31. find
  76. Wieling, M. & Montemagni, S. (2016). “Infrequent forms: Noise or Not?”. In Cote, M. & Nerbonne, J. (eds.) The Future of Dialects. Berlin: Language Science Press. 215-224. find
  77. Wieling, M. & Nerbonne, J. (2011). “Bipartite spectral graph partitioning for clustering dialect varieties and detecting their linguistic features.” Computer Speech & Language, 25(3): 700-715. find
  78. Wieling, M. & Nerbonne, J. (2015). “Advances in Dialectometry.” Annu. Rev. Linguistics, 1: 243-264. find
  79. Wieling, M.; Heeringa, W.; & Nerbonne, J. (2007). “An aggregate analysis of pronunciation in the Goeman-Taeldeman-Van Reenen-Project data.” Taal en Tongval, 59: 84-116. find
  80. Wieling, M.; Nerbonne, J.; & Baayen, R. (2011). “Quantitative Social Dialectology: Explaining Linguistic Variation Geographically and Socially.” PloS One, 6(9).14 pp. find
  81. Wolk, C. & Szmrecsanyi, B. (2016). “Top-down and Bottom-up Advances in Corpus-based Dialectometry.” In Cote, M. & Nerbonne, J. (eds.) The Future of Dialects. Berlin: Language Science Press. 225-244. find
  82. Zenner, E.; Speelman, D.; & Geeraerts, D. (2012). “Cognitive Sociolinguistics meets loanword research: Measuring variation in the success of anglicisms in Dutch.” Cognitive Linguistics, 23(4) :749-792. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/dunn-2021-finding-variants-construction-based-dialectometry/