Mova0.5 pre-release⌕
☰
home / docs / papers / English / The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

What it is about

The shared task asked systems to split a word into morphemes, covering compounds, derivations and inflections. Subtask 1 is word-level segmentation over about 5 million words in 9 languages. The best of 13 submissions averages 97.29% F1 over the languages, ranging from 93.84% for English to 99.38% for Latin. Subtask 2 is sentence-level segmentation of 18,735 sentences in Czech, English and Mongolian, where the best systems beat BPE, ULM and Morfessor2 by 30.71 points absolute. For English the root category is the hardest, at 83.80 F1. The authors also name compounds and compound-plus-derivation words as hard, and the winning system is the best in those categories across languages.

Ideas

For Mova

The code is en/src/morph.rs, with the check in en morph-eval. The chapter is 18. Compounding, conversion and the minor processes, and 17-derivation-suffixes.md for the affix splits. The shared-task data is for tests and measurements only, never in what is built. Measure first: boundary F1 on English roots and compounds, with two identical runs before any claim.

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.18653/v1/2022.sigmorphon-1.11 · arXiv 2206.07615

@inproceedings{batsuren2022sigmorphon,
  title = {{The SIGMORPHON 2022 Shared Task on Morpheme Segmentation}},
  author = {Batsuren, Khuyagbaatar and Bella, Gabor and Arora, Aryaman},
  booktitle = {SIGMORPHON 2022 (ACL workshop)},
  year = {2022},
  doi = {10.18653/v1/2022.sigmorphon-1.11},
  eprint = {2206.07615},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.18653/v1/2022.sigmorphon-1.11}
}

References

83 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Rie Kubota Ando and Tong Zhang. 2005. A framework for learning predictive structures from multiple tasks and unlabeled data. Journal of Machine Learning Research, 6:1817–1853. find
  2. Galen Andrew and Jianfeng Gao. 2007. Scalable training of L1-regularized log-linear models. In Proceedings of the 24th International Conference on Machine Learning, pages 33–40. find
  3. Duygu Ataman, Matteo Negri, Marco Turchi, and Marcello Federico. 2017. Linguistically motivated vocabulary reduction for neural machine translation from turkish to english. find
  4. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. find
  5. Khuyagbaatar Batsuren, Gábor Bella, and Fausto Giunchiglia. 2019a. Cognet: A large-scale cognate database. In Proceedings of the 57th annual meeting of the association for computational linguistics, pages 3136–3145. find
  6. Khuyagbaatar Batsuren, Gábor Bella, and Fausto Giunchiglia. 2021a. A large and evolving cognate database. Language Resources and Evaluation. find
  7. Khuyagbaatar Batsuren, Gábor Bella, and Fausto Giunchiglia. 2021b. MorphyNet: a large multilingual database of derivational and inflectional morphology. In Proceedings of the 18th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology, pages 39–48, Online. Association… find our card
  8. Khuyagbaatar Batsuren, Amarsanaa Ganbold, Altangerel Chagnaa, and Fausto Giunchiglia. 2019b. Building the Mongolian WordNet. In Proceedings of the 10th Global Wordnet Conference, pages 238–244, Wroclaw, Poland. Global Wordnet Association. find
  9. Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina J. Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Lane, Mohit Raj, Matt Col… find our card
  10. Jan Bodnár. 2022. Jb132 submission to the sigmorphon 2022 shared task 3 on morphological segmentation. In 19th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. find
  11. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems, 33:1877–1901. find
  12. Ryan Cotterell, Tim Vieira, and Hinrich Schütze. 2016. A joint model of orthography and morphological segmentation. Association for Computational Linguistics. find
  13. Mathias Creutz and Krista Lagus. 2002. Unsupervised discovery of morphemes. In Proceedings of the ACL-02 Workshop on Morphological and Phonological Learning, pages 21–30. find
  14. Mathias Creutz and Krista Lagus. 2005. Unsupervised morpheme segmentation and morphology induction from text corpora using Morfessor 1.0. Helsinki University of Technology Helsinki. find
  15. Mathias Creutz and Krista Lagus. 2007. Unsupervised models for morpheme segmentation and morphology learning. ACM Transactions on Speech and Language Processing (TSLP), 4(1):1–34. find
  16. Marie-Catherine de Marneffe, Christopher Manning, Joakim Nivre, and Daniel Zeman. 2021. Universal dependencies. Computational Linguistics, 47(2):255– 308. find our card
  17. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… find
  18. Miguel Domingo, Mercedes Garcıa-Martınez, Alexandre Helle, Francisco Casacuberta, and Manuel Her-ranz. 2018. How much does tokenization affect neural machine translation? arXiv preprint arXiv:1812.08621. — [arXiv:1812.08621](https://arxiv.org/abs/1812.08621) find
  19. Clémentine Fourrier and Benoît Sagot. 2020. Methodological aspects of developing and managing an etymological lexical resource: Introducing etymdb 2.0. In LREC 2020-12th Language Resources and Evaluation Conference. find
  20. Philip Gage. 1994. A new algorithm for data compression. C Users Journal, 12(2):23–38. find
  21. Leander Girrbach. 2022. find
  22. Sigmorphon 2022 shared task on morpheme segmentation submission description: Sequence labelling for word-level morpheme segmentation. In 19th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. find
  23. Edward Gow-Smith, Harish Tayyar Madabushi, Carolina Scarton, and Aline Villavicencio. 2022. Improving tokenisation by alternative treatment of spaces. arXiv preprint arXiv:2204.04058. find
  24. Stig-Arne Grönroos, Sami Virpioja, and Mikko Kurimo. 2020. Morfessor em+ prune: Improved subword segmentation with expectation maximization and pruning. arXiv preprint arXiv:2003.03131. find
  25. Stig-Arne Grönroos, Sami Virpioja, Peter Smit, and Mikko Kurimo. 2014. Morfessor flatcat: An hmm-based method for unsupervised and semi-supervised learning of morphology. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pages 1177– 1185… find
  26. Xuanli He, Gholamreza Haffari, and Mohammad Norouzi. 2020. Dynamic programming encoding for subword segmentation in neural machine translation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 3042–3051. find
  27. Oliver Hellwig and Sebastian Nehrdich. 2018. Sanskrit word segmentation using character-level recurrent and convolutional neural networks. In Proceedings of the 2018 conference on empirical methods in natural language processing, pages 2754–2763. find
  28. Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki, and Naoaki Okazaki. 2021. Joint optimization of tokenization and downstream model. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 244–255. find
  29. Melvin Johnson, Mike Schuster, Quoc V Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, et al. 2017. Google’s multilingual neural machine translation system: Enabling zero-shot translation. Transactions of the Association for Computational L… find
  30. Katharina Kann, Ryan Cotterell, and Hinrich Schütze. 2016. Neural morphological analysis: Encoding-decoding canonical segments. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 961–967, Austin, Texas. Association for Computational Linguistics. find
  31. Katharina Kann, Jesus Manuel Mager Hois, Ivan Vladimir Meza-Ruiz, and Hinrich Schütze. 2018. Fortification of neural morphological segmentation models for polysynthetic minimal-resource languages. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computationa… find
  32. Taku Kudo. 2018. Subword regularization: Improving neural network translation models with multiple subword candidates. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 66–75, Melbourne, Australia. Association for Computational… find
  33. Mikko Kurimo, Mathias Creutz, and Matti Varjokallio. 2007. Unsupervised morpheme analysis evaluation by a comparison to a linguistic gold standard-morpho challenge 2007. In CLEF (Working Notes). find
  34. Mikko Kurimo, Ville Turunen, and Matti Varjokallio. 2008. Overview of morpho challenge 2008. In Workshop of the Cross-Language Evaluation Forum for European Languages, pages 951–966. Springer. find
  35. Mikko Kurimo, Sami Virpioja, Ville Turunen, and Krista Lagus. 2010a. Morpho challenge 2005-2010: Evaluations and results. In Proceedings of the 11th Meeting of the ACL Special Interest Group on Computational Morphology and Phonology, pages 87–95. find
  36. Mikko Kurimo, Sami Virpioja, Ville T Turunen, Graeme W Blackwood, and William Byrne. 2009. Overview and results of morpho challenge 2009. In Workshop of the Cross-Language Evaluation Forum for European Languages, pages 578–597. Springer. find
  37. Mikko Kurimo, Sami Virpioja, Ville T Turunen, et al. 2010b. Proceedings of the morpho challenge 2010 workshop. In Morpho Challenge Workshop; 2010; Espoo. Aalto University School of Science and Technology. find
  38. Lauren Levine. 2022. Sharing data by language family: Data augmentation for romance language morpheme segmentation. In 19th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. find
  39. Jingwen Li and Leander Girrbach. 2022. Word segmentation and morphological parsing for sanskrit. arXiv preprint arXiv:2201.12833. — [arXiv:2201.12833](https://arxiv.org/abs/2201.12833) find
  40. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692. find
  41. Dominik Macháček, Jonáš Vidra, and Ondřej Bojar. 2018. Morphological and language-agnostic word segmentation for nmt. In International Conference on Text, Speech, and Dialogue, pages 277–284. Springer. find
  42. Peter Makarov and Simon Clematide. 2018a. Imitation learning for neural morphological string transduction. arXiv preprint arXiv:1808.10701. find
  43. Ivan Provilkov, Dmitrii Emelianenko, and Elena Voita. 2019. Bpe-dropout: Simple and effective subword regularization. arXiv preprint arXiv:1910.13267. find
  44. Peter Makarov and Simon Clematide. 2018b. Uzh at conll-sigmorphon 2018 shared task on universal morphological reinflection. Association for Computational Linguistics. find
  45. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9. find
  46. Peter Makarov and Simon Clematide. 2020. CLUZH at SIGMORPHON 2020 shared task on multilingual grapheme-to-phoneme conversion. In Proceedings of the 17th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology, pages 171–176, Online. Association for Computational Linguis… find
  47. Mohammad Sadegh Rasooli and Joel R. Tetreault. 2015. Yara parser: A fast and accurate dependency parser. Computing Research Repository, arXiv:1503.06733. Version 2. — [arXiv:1503.06733](https://arxiv.org/abs/1503.06733) find
  48. Austin Matthews, Graham Neubig, and Chris Dyer. 2018. Using morphological knowledge in open-vocabulary neural language models. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pa… find
  49. Sabrina J Mielke, Zaid Alyafeai, Elizabeth Salesky, Colin Raffel, Manan Dey, Matthias Gallé, Arun Raja, Chenglei Si, Wilson Y Lee, Benoît Sagot, et al. 2021. Between words and characters: A brief history of open-vocabulary modeling and tokenization in nlp. arXiv preprint arXiv:2112.10508. find
  50. Zoljargal Munkhjargal, Altangerel Chagnaa, and Purev Jaimai. 2016. Morphological transducer for mongolian. In International Conference on Computational Collective Intelligence, pages 546–554. Springer. find
  51. Aku Rouhe, Stig-Arne Grönroos, Sami Virpioja, Mathias Creutz, and Mikko Kurimo. 2022. Morfessor-enriched features and multilingual training for canonical morphological segmentation. In 19th SIGMOR-PHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. find
  52. Jonne Saleva and Constantine Lignos. 2021. The effectiveness of morphology-aware segmentation in low-resource neural machine translation. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 164–174, Online.… find
  53. Mike Schuster and Kaisuke Nakajima. 2012. Japanese and korean voice search. In 2012 IEEE international conference on acoustics, speech and signal processing (ICASSP), pages 5149–5152. IEEE. find
  54. Antoine Nzeyimana and Andre Niyongabo Rubungo. 2022. Kinyabert: a morphology-aware kinyarwanda language model. arXiv preprint arXiv:2203.08459. find
  55. Lane Schwartz, Francis Tyers, Lori Levin, Christo Kirov, Patrick Littell, Chi-kiu Lo, Emily Prud’hommeaux, Hyunji Hayley Park, Kenneth Steimel, Rebecca Knowles, et al. 2020. Neural polysynthetic language modelling. arXiv preprint arXiv:2005.05477. — [arXiv:2005.05477](https://arxiv.org/abs/2005.05477) find
  56. Kateřina Pelegrinová, Viktor Elšík, Radek Čech, and Ján Mačutek. 2021. MorfoCzech. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University. find
  57. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Neural machine translation of rare words with subword units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1715–1725. find
  58. Ben Peters and André F. T. Martins. 2020. One-size-fits-all multilingual models. In Proceedings of the 17th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology, pages 63–69, Online. Association for Computational Linguistics. find
  59. Gilles Sérasset. 2015. Dbnary: Wiktionary as a lemon-based multilingual lexical resource in rdf. Semantic Web, 6(4):355–361. find
  60. Ben Peters and André F. T. Martins. 2022. Beyond characters: Subword-level morpheme segmentation. In 19th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. find
  61. Ben Peters and André FT Martins. 2019. IT–IST at the sigmorphon 2019 shared task: Sparse two-headed models for inflection. In Proceedings of the 16th Workshop on Computational Research in Phonetics, Phonology, and Morphology, pages 50–56. find
  62. Natalia Silveira, Timothy Dozat, Marie-Catherine de Marneffe, Samuel Bowman, Miriam Connor, John Bauer, and Christopher D. Manning. 2014. A gold standard dependency corpus for English. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC-2014). find
  63. Eleonora Slavíčková, Jaroslava Hlaváčová, and Patrice Pognan. 2017. Retrograde morphemic dictionary of czech - verbs. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University. find
  64. Haiyue Song, Raj Dabre, Chenhui Chu, Sadao Kurohashi, and Eiichiro Sumita. 2022. Self-supervised dynamic programming encoding for neural machine translation. find
  65. Luigi Talamo, Chiara Celata, and Pier Marco Bertinetto. 2016. Derivatario: An annotated lexicon of italian derivatives. Word Structure, 9(1):72–102. find
  66. Yi Tay, Vinh Q Tran, Sebastian Ruder, Jai Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, and Donald Metzler. 2021. Charformer: Fast character transformers via gradient-based subword tokenization. arXiv preprint arXiv:2106.12672. find
  67. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, 30. find
  68. Jonáš Vidra, Zdeněk Žabokrtský, Magda Ševčíková, and Lukáš Kyjánek. 2019. Derinet 2.0: Towards an all-in-one word-formation resource. In Proceedings of the Second International Workshop on Resources and Tools for Derivational Morphology (DeriMo 2019), pages 81–89, Praha, Czechia. ÚFAL MFF UK. find
  69. Sami Virpioja, Peter Smit, Stig-Arne Grönroos, Mikko Kurimo, et al. 2013. Morfessor 2.0: Python implementation and extensions for morfessor baseline. find
  70. Daniil Vodolazsky. 2020. Derivbase. ru: A derivational morphology resource for russian. In Proceedings of The 12th Language Resources and Evaluation Conference, pages 3937–3943. find
  71. Xinyi Wang, Sebastian Ruder, and Graham Neubig. 2021. Multi-view subword regularization. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 473–482. find
  72. Silvan Wehrli, Simon Clematide, and Peter Makarov. 2022. Cluzh at sigmorphon 2022 shared tasks on morpheme segmentation and inflection generation. In 19th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. find
  73. Wei Wu, Houfeng Wang, Tianyu Liu, and Shuming Ma. 2018. Phrase-level self-attention networks for universal sentence encoding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3729–3738. find
  74. Winston Wu and David Yarowsky. 2020. Computational etymology and word emergence. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 3252–3259, Marseille, France. European Language Resources Association. find
  75. Xlnet: Generalized autoregressive pretraining for language understanding. Advances in neural information processing systems, 32. find
  76. Wenpeng Yin, Katharina Kann, Mo Yu, and Hinrich Schütze. 2017. Comparative study of cnn and rnn for natural language processing. arXiv preprint arXiv:1702.01923. — [arXiv:1702.01923](https://arxiv.org/abs/1702.01923) find
  77. Zdeněk Žabokrtský, Nyati Bafna, Jan Bodnár, Lukáš Kyjánek, Emil Svoboda, Magda Ševčíková, Jonáš Vidra, Sachi Angle, Ebrahim Ansari, Timofey Arkhangelskiy, Khuyagbaatar Batsuren, Gábor Bella, Pier Marco Bertinetto, Olivier Bonami, Chiara Celata, Michael Daniel, Alexei Fedorenko, Matea Filko, Fausto… find
  78. Britta Zeller, Jan Šnajder, and Sebastian Padó. 2013. Derivbase: Inducing and evaluating a derivational morphology resource for german. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1201–1211. find
  79. Daniel Zeman, Martin Popel, Milan Straka, Jan Hajic, Joakim Nivre, Filip Ginter, Juhani Luotolahti, Sampo Pyysalo, Slav Petrov, Martin Potthast, et al. 2017. find
  80. Conll 2017 shared task: Multilingual parsing from raw text to universal dependencies. In CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 1–19. Association for Computational Linguistics. find our card
  81. Tsolmon Zundui and Chinbat Avaajargal. 2022. Word-live morpheme segmentation using transformer neural network. In 19th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. find
  82. Zdeněk Žabokrtský, Niyati Bafna, Jan Bodnár, Lukáš Kyjánek, Emil Svoboda, Magda Ševčíková, and Jonáš Vidra. 2022. Towards Universal Segmentations: UniSegments 1.0. In Proceedings of the 13th International Conference on Language Resources and Evaluation (LREC 2018), Marseille, France. European Lang… find
  83. Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/lex-2022-batsuren-morpheme-segmentation/