Mova0.5 pre-release⌕
☰
home / docs / papers / Ancient Hebrew / A Dataset for Metaphor Detection in Early Medieval Hebrew Poetry

A Dataset for Metaphor Detection in Early Medieval Hebrew Poetry

What it is about

The authors release the first metaphor-annotated corpus of Hebrew piyyut, the liturgical poetry of the 5th–8th centuries CE, taken from Cairo Genizah reconstructions. It has two units: 172 pre-classical poems (Galilee, 5th century) and 137 poems by Pinchas ha-Cohen (8th century), 309 poems and 73,179 words. An expert annotated metaphor spans in CATMA; a second expert re-annotated about a quarter of each unit, with Cohen's kappa of 0.618 and 0.628. Metaphor is 16.3% and 21.3% of the words. The splits are 64/16/20 by text, stratified by length and metaphor ratio. Metaphor detection is BIO sequence labelling. Fine-tuned AlephBERT reaches F1 about 41–42 and fine-tuned BEREL (rabbinic pretraining) about 44–47. Adding adaptation and weighted cross-entropy gives the best F1 of 48.7 and 49.4. The lexical memorisation baseline is weak: 52–55% of test metaphors never appear as metaphors in training.

Ideas

For Mova

I3 goes into The lexicon and 11. Mishnaic Hebrew (hbo-x-mishnaic), since piyyut is a later stratum of Hebrew with its own senses. I1 and I2 are evaluation rules for any tools/hbo lexical or sense work. Metaphor detection is not on the current prag roadmap, which is English only; this card does not add it.

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.18653/v1/2024.eacl-short.39

@inproceedings{toker2024dataset,
  title = {{A Dataset for Metaphor Detection in Early Medieval Hebrew Poetry}},
  author = {Toker, Michael and Mishali, Oren and Münz-Manor, Ophir and Kimelfeld, Benny and Belinkov, Yonatan},
  booktitle = {Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 2: Short Papers)},
  year = {2024},
  doi = {10.18653/v1/2024.eacl-short.39},
  url = {https://doi.org/10.18653/v1/2024.eacl-short.39}
}

References

28 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. George Aaron Broadwell, Umit Boz, Ignacio Cases, Tomek Strzalkowski, Laurie Feldman, Sarah Taylor, Samira Shaikh, Ting Liu, Kit Cho, and Nick Webb. 2013. Using imageability and topic chaining to locate metaphors in linguistic corpora. In Social Computing, Behavioral-Cultural Modeling and Prediction, pages 102–110, Berlin, Heidelberg. Springer Berlin Heidelberg. find
  2. Minjin Choi, Sunkyung Lee, Eunseong Choi, Heesoo Park, Junhyuk Lee, Dongwon Lee, and Jongwuk Lee. 2021. Melbert: Metaphor detection via contextualized late interaction using metaphorical identification theories. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1763–1773. find
  3. Avihay Chriqui and Inbal Yahav. 2021. Hebert & HebEMO: a Hebrew BERT model and a tool for polarity analysis and emotion recognition. arXiv preprint arXiv:2102.01909. ↗ our card
  4. Marina Litvak, Natalia Vanetik, Chaya Liebeskind, Omar Hmdia, and Rizek Abu Madeghem. 2022. Offensive language detection in Hebrew: can other languages help? In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 3715–3723. find our card
  5. Jerry Liu, Nathan O’Hara, Alexander Rubin, Rachel Draelos, and Cynthia Rudin. 2020. Metaphor detection using contextual word embeddings from transformers. In Proceedings of the Second Workshop on Figurative Language Processing, pages 250–255, Online. Association for Computational Linguistics. find
  6. Zachary J. Mason. 2004. CorMet: A computational, corpus-based conventional metaphor extraction system. Computational Linguistics, 30(1):23–44. find
  7. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota. Association for Computational Linguistics. Dicta. Dicta Library. https://library.dicta.org.il. ↗
  8. Shulamit Elizur, editor. 2004. The Liturgical Poems of Rabbi Pinhas Ha-Kohen. World Union of Jewish Studies, Jerusalem. In Hebrew. find
  9. Jan Christoph Meister, Evelyn Gius, Jan Horstmann, Janina Jacke, and Marco Petris. 2017. CATMA 5.0 tutorial. In DH. Alliance of Digital Humanities Organizations (ADHO). find
  10. Ophir Münz-Manor. 2011. Figurative language in early Piyyut. In Giving a Diamond, pages 51–67. Brill. find
  11. Barbara Plank. 2022. The “problem” of human label variation: On ground truth in data, modeling and evaluation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 10671–10682, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics. Project Ben-Yehuda volunteers. Project Ben-Yehuda. https://benyehuda.org. ↗
  12. Dan Fass. 1991. met*: A method for discriminating metonymy and metaphor by computer. Computational Linguistics, 17(1):49–90. find
  13. Hongyu Gong, Kshitij Gupta, Akriti Jain, and Suma Bhat. 2020. IlliniMet: Illinois system for metaphor detection with contextual and linguistic information. In Proceedings of the Second Workshop on Figurative Language Processing, pages 146–153, Online. Association for Computational Linguistics. find
  14. Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A Smith. 2020. Don’t stop pretraining: Adapt language models to domains and tasks. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8342–8360. find
  15. Marina Rustow, editor. 2020. The Lost Archive: Traces of a Caliphate in a Cairo Synagogue. H-Africa. Sefaria. Sefaria Library. https://www.sefaria.org.il/texts. ↗
  16. Amit Seker, Elron Bandel, Dan Bareket, Idan Brusilovsky, Refael Shaked Greenfeld, and Reut Tsarfaty. 2021. AlephBERT: A Hebrew large pre-trained language model to start-off your Hebrew NLP application with. arXiv preprint arXiv:2104.04052. ↗ our card
  17. Avi Shmidman, Joshua Guedalia, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Eli Handel, and Moshe Koppel. 2022. Introducing BEREL: BERT embeddings for rabbinic-encoded language. arXiv preprint arXiv:2208.01875. ↗ our card
  18. Omri Keren and Omer Levy. 2021. Parashoot: A hebrew question answering dataset. In Proceedings of the 3rd Workshop on Machine Reading for Question Answering, pages 106–112. find our card
  19. Ekaterina Shutova, Douwe Kiela, and Jean Maillard. 2016. Black holes and white rabbits: Metaphor identification with visual features. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 160–170, San Diego, California. Association for Computational Linguistics. find
  20. Laura S. Lieber. 2010. Yannai on Genesis: An Invitation to Piyyut, volume 36 of Monographs of the Hebrew Union College. Hebrew Union College Press. find
  21. Ekaterina Shutova, Simone Teufel, and Anna Korhonen. 2013. Statistical metaphor processing. Computational Linguistics, 39(2):301–353. find
  22. Chuandong Su, Fumiyo Fukumoto, Xiaoxi Huang, Jiyi Li, Rongbo Wang, and Zhiqun Chen. 2020. DeepMet: A reading comprehension paradigm for token-level metaphor detection. In Proceedings of the second workshop on figurative language processing, pages 30–39. find
  23. Yulia Tsvetkov, Elena Mukomel, and Anatole Gershman. 2013. Cross-lingual metaphor detection using common semantic features. In Proceedings of the First Workshop on Metaphor in NLP, pages 45–51, Atlanta, Georgia. Association for Computational Linguistics. find
  24. Peter Turney, Yair Neuman, Dan Assaf, and Yohai Cohen. 2011. Literal and metaphorical sense identification through concrete and abstract context. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 680– 690, Edinburgh, Scotland, UK. Association for Computational Linguistics. find
  25. Wout Jac Van Bekkum. 2008. The Hebrew liturgical poetry of Byzantine Palestine: Recent research and new perspectives. Prooftexts: A Journal of Jewish Literary History, 28(2):232–246. find
  26. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, 30. find
  27. Tony Veale, Ekaterina Shutova, and Beata Beigman Klebanov. 2016. Metaphor: A computational perspective. Synthesis Lectures on Human Language Technologies, 9(1):1–160. find
  28. Yorick Wilks. 1975. A preferential, pattern-seeking, semantics for natural language inference. Artificial intelligence, 6(1):53–74. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/eacl-2024-toker-dataset-metaphor-detection-early-medieval/