Mova0.5 pre-release⌕
☰
home / docs / papers / English / An Annotated Dataset of Coreference in English Literature

An Annotated Dataset of Coreference in English Literature

What it is about

LitBank coreference covers about 2,000-word excerpts of 100 English novels from 1719–1922 (210,532 tokens, 29,103 mentions), four times longer per document than OntoNotes. Markables are the LitBank entity types (people 83%, plus facilities, locations, geo-political entities, organisations, vehicles) and all personal pronouns, including archaic and dialect forms (thou, thee, thine, ye, 'em, yer); singletons, quantified and negated NPs are marked (singletons 17.4%). Guidelines follow OntoNotes with literary changes: copular identity only when asserted as currently true, generics not linked to generics, honorifics inside the name, near-identity and «revelation of identity» judged from the whole text. Agreement on double-annotated texts is high. Analysis: most entities live briefly (half span under 173 tokens), but most mentions belong to long, bursty chains of main characters; a pronoun's nearest antecedent is a median 2 mentions back, 90% within 5 and 95% within 9 mentions. A neural model trained on LitBank beats one trained on OntoNotes by about 6 F1, and equals one trained on the much larger PreCo.

Ideas

For Mova

35. Reference and coreference §6 (reference in quoted speech), §8–9; 09-early-modern-and-archaic.md (archaic pronouns). Code: coref/src/mention.rs, coref/src/sieve.rs, prag/src/frames.rs (Ctx salience). Measures: per-pronoun precision and CoNLL F1 on LitBank and GUM dev; frame bench coref F1.

Topics: Coreference resolution

Cite

The paper itself, not this card. BibTeX from the library's record of the work. arXiv 1912.01140

@inproceedings{bamman2020annotated,
  title = {{An Annotated Dataset of Coreference in English Literature}},
  author = {Bamman, David and Lewke, Olivia and Mansoor, Anya},
  booktitle = {Proceedings of the Twelfth Language Resources and Evaluation Conference},
  year = {2020},
  eprint = {1912.01140},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1912.01140}
}

References

58 references, 10 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Agarwal, A., Corvalan, A., Jensen, J., and Rambow, O. (2012). Social network analysis of alice in wonderland. In Proceedings of the NAACL-HLT 2012 Workshop on Computational Linguistics for Literature, pages 88–96, Montréal, Canada, June. Association for Computational Linguistics. find
  2. Bagga, A. and Baldwin, B. (1998). Algorithms for scoring coreference chains. In The First International Conference on Language Resources and Evaluation Workshop on Linguistics Coreference, volume 1, pages 563–566. Granada. find our card
  3. Bamman, D., Underwood, T., and Smith, N. A. (2014). A Bayesian mixed effects model of literary character. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 370–379, Baltimore, Maryland, June. Association for Computational Linguistics. find
  4. Bamman, D., Popat, S., and Shen, S. (2019). An annotated dataset of literary entities. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 2138–2144, Minneapolis, Minnesota, June. Association for Computational Linguistics. find
  5. Chen, H., Fan, Z., Lu, H., Yuille, A., and Rong, S. (2018). PreCo: A large-scale dataset in preschool vocabulary for coreference resolution. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 172–181, Brussels, Belgium, October-November. Association for Computational Linguistics. find our card
  6. Clark, K. and Manning, C. D. (2016). Improving coreference resolution by learning entity-level distributed representations. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 643–653, Berlin, Germany, August. Association for Computational Linguistics. find
  7. Cohen, K. B., Lanfranchi, A., Choi, M. J.-y., Bada, M., Baumgartner, W. A., Panteleyeva, N., Verspoor, K., Palmer, M., and Hunter, L. E. (2017). Coreference annotation and resolution in the Colorado Richly Annotated Full Text (CRAFT) corpus of biomedical journal articles. BMC Bioinformatics, 18(1):372, Aug. find
  8. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota, June. Association for Computational Linguistics. find
  9. D’Souza, J. and Ng, V. (2012). Anaphora resolution in biomedical literature: A hybrid approach. In Proceedings of the ACM Conference on Bioinformatics, Computational Biology and Biomedicine, BCB ’12, pages 113–122, New York, NY, USA. ACM. find
  10. Elson, D. K., Dames, N., and McKeown, K. R. (2010). Extracting social networks from literary fiction. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, ACL ’10, pages 138–147, Stroudsburg, PA, USA. Association for Computational Linguistics. find
  11. Gallois, A. (2016). The Metaphysics of Identity. Routledge. find
  12. Gasperin, C., Karamanis, N., and Seal, R. (2007). Annotation of anaphoric relations in biomedical full-text articles using a domain-relevant scheme. In Proceedings of DAARC, volume 2007. Citeseer. find
  13. Ghaddar, A. and Langlais, P. (2016). WikiCoref: An English coreference-annotated corpus of Wikipedia articles. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pages 136–142, Portorož, Slovenia, May. European Language Resources Association (ELRA). find our card
  14. Guha, A., Iyyer, M., Bouman, D., and Boyd-Graber, J. (2015). Removing the training wheels: A coreference dataset that entertains humans and challenges computers. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1108–1118, Denver, Colorado, May–June. Association for Computational Linguistics. find
  15. Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., and Weischedel, R. (2006). OntoNotes: the 90% solution. In Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers, NAACL-Short ’06, pages 57–60, Stroudsburg, PA, USA. Association for Computational Linguistics. find
  16. Jannidis, F., Reger, I., Krug, M., Weimer, L., Macharowsky, L., and Puppe, F. (2016). Comparison of methods for the identification of main characters in German novels. In Digital Humanities. find
  17. Ju, M., Miwa, M., and Ananiadou, S. (2018). A neural layered model for nested named entity recognition. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 1446–1459, New Orleans, Louisiana, June. Association for Computational Linguistics. find
  18. Kantor, B. and Globerson, A. (2019). Coreference resolution with entity equalization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 673–677, Florence, Italy, July. Association for Computational Linguistics. find
  19. Kingma, D. P. and Ba, J. (2014). Adam: A method for stochastic optimization. http://arxiv.org/abs/1412.6980. ↗
  20. Kraicer, E. and Piper, A. (2018). Social characters: The hierarchy of gender in contemporary English-language fiction. Cultural Analytics. find
  21. Krug, M., Puppe, F., Jannidis, F., Macharowsky, L., Reger, I., and Weimar, L. (2015). Rule-based coreference resolution in German historic novels. In Proceedings of the Fourth Workshop on Computational Linguistics for Literature, pages 98–104, Denver, Colorado, USA, June. Association for Computational Linguistics. find
  22. Krug, M., Weimer, L., Reger, I., Macharowsky, L., Feldhaus, S., Puppe, F., and Jannidis, F. (2017). Description of a corpus of character references in German novels - DROC [Deutsches ROman Corpus]. DARIAH-DE Working Papers No. 27. find
  23. Lee, J. and Yeung, C. Y. (2012). Extracting networks of people and places from literary texts. In Proceedings of the 26th Pacific Asia Conference on Language, Information, and Computation, pages 209–218, Bali, Indonesia, November. Faculty of Computer Science, Universitas Indonesia. find
  24. Lee, K., He, L., Lewis, M., and Zettlemoyer, L. (2017). End-to-end neural coreference resolution. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 188–197, Copenhagen, Denmark, September. Association for Computational Linguistics. find our card
  25. Lee, K., He, L., and Zettlemoyer, L. (2018). Higher-order coreference resolution with coarse-to-fine inference. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 687–692, New Orleans, Louisiana, June. Association for Computational Linguistics. find
  26. Lestari, V. A. (2018). Building effective representations for domain adaptation in coreference resolution. Ph.D. thesis, UT-Austin. find
  27. Luo, X. (2005). On coreference resolution performance metrics. In Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, HLT ’05, pages 25–32, Stroudsburg, PA, USA. Association for Computational Linguistics. find our card
  28. Moosavi, N. S. and Strube, M. (2017). Lexical features in coreference resolution: To be used with caution. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 14–19, Vancouver, Canada, July. Association for Computational Linguistics. find our card
  29. Moosavi, N. S. and Strube, M. (2018). Using linguistic features to improve the generalization capability of neural coreference resolvers. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 193–203, Brussels, Belgium, October-November. Association for Computational Linguistics. find our card
  30. Nguyen, N., Kim, J.-D., and Tsujii, J. (2011). Overview of BioNLP 2011 protein coreference shared task. In Proceedings of BioNLP Shared Task 2011 Workshop, pages 74–82, Portland, Oregon, USA, June. Association for Computational Linguistics. find
  31. Nunberg, G. (1984). Individuation in context. In Proceedings of the Second West Coast Conference on Formal Linguistics. find
  32. Piper, A., Algee-Hewitt, M., Sinha, K., Ruths, D., and Vala, H. (2017). Studying literary characters and character networks. In DH 2017. find
  33. Piper, A. (2018). Enumerations. University of Chicago Press. find
  34. Pradhan, S., Ramshaw, L., Marcus, M., Palmer, M., Weischedel, R., and Xue, N. (2011). CoNLL-2011 shared task: Modeling unrestricted coreference in OntoNotes. In Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task, pages 1–27, Portland, Oregon, USA, June. Association for Computational Linguistics. find our card
  35. Pradhan, S., Moschitti, A., Xue, N., Uryupina, O., and Zhang, Y. (2012). CoNLL-2012 shared task: Modeling multilingual unrestricted coreference in OntoNotes. In Joint Conference on EMNLP and CoNLL - Shared Task, pages 1–40, Jeju Island, Korea, July. Association for Computational Linguistics. find our card
  36. Recasens, M., Hovy, E., and Martí, M. A. (2010). A typology of near-identity relations for coreference (NIDENT). In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta, May. European Language Resources Association (ELRA). find
  37. Recasens, M., Hovy, E., and Martí, M. A. (2011). Identity, non-identity, and near-identity: Addressing the complexity of coreference. Lingua, 121(6):1138 – 1152. find
  38. Recasens, M., de Marneffe, M.-C., and Potts, C. (2013). The life and death of discourse entities: Identifying singleton mentions. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 627–633. Association for Computational Linguistics. find
  39. Reiter, N. and Frank, A. (2010). Identifying generic noun phrases. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, ACL ’10, pages 40–49, Stroudsburg, PA, USA. Association for Computational Linguistics. find
  40. Roesiger, I., Schulz, S., and Reiter, N. (2018). Towards coreference for literary text: Analyzing domain-specific phenomena. In Proceedings of the Second Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature, pages 129–138, Santa Fe, New Mexico, August. Association for Computational Linguistics. find
  41. Schäfer, U., Spurk, C., and Steffen, J. (2012). A fully coreference-annotated corpus of scholarly papers from the ACL anthology. In Proceedings of COLING 2012: Posters, pages 1059–1070, Mumbai, India, December. find
  42. The COLING 2012 Organizing Committee. find
  43. Sims, M., Park, J.-H., and Bamman, D. (2019). Literary event detection. In ACL. find
  44. Stenetorp, P., Pyysalo, S., Topić, G., Ohta, T., Ananiadou, S., and Tsujii, J. (2012). BRAT: A web-based tool for NLP-assisted text annotation. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL ’12, pages 102–107, Stroudsburg, PA, USA. Association for Computational Linguistics. find
  45. Su, J., Yang, X., Hong, H., Tateisi, Y., and Tsujii, J. (2008). Coreference resolution in biomedical texts: a machine learning approach. In Dagstuhl Seminar Proceedings. Schloss Dagstuhl-Leibniz-Zentrum für Informatik. find
  46. Subramanian, S. and Roth, D. (2019). Improving generalization in coreference resolution via adversarial training. In Proceedings of the Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019), pages 192–197, Minneapolis, Minnesota, June. Association for Computational Linguistics. find
  47. Sudhahar, S. and Cristianini, N. (2013). Automated analysis of narrative content for digital humanities. In International Journal of Advanced Computer Science. find
  48. Tenen, D. Y. (2018). Toward a computational archaeology of fictional space. New Literary History. find
  49. Underwood, T., Bamman, D., and Lee, S. (2018). The transformation of gender in English-language fiction. Cultural Analytics. find
  50. Underwood, T. (2019). Distant Horizons: Digital Evidence and Literary Change. University of Chicago Press. find
  51. Vala, H., Jurgens, D., Piper, A., and Ruths, D. (2015). Mr. Bennet, his coachman, and the Archbishop walk into a bar but only one of them gets recognized: On the difficulty of detecting characters in literary texts. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 769–774, Lisbon, Portugal, September. Association for Computational Linguistics. find
  52. Vala, H., Dimitrov, S., Jurgens, D., Piper, A., and Ruths, D. (2016). Annotating characters in literary corpora: A scheme, the CHARLES tool, and an annotated novel. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pages 184–189, Portorož, Slovenia, May. European Language Resources Association (ELRA). find
  53. Vilain, M., Burger, J., Aberdeen, J., Connolly, D., and Hirschman, L. (1995). A model-theoretic coreference scoring scheme. In Proceedings of the 6th Conference on Message Understanding, MUC6 ’95, pages 45–52, Stroudsburg, PA, USA. Association for Computational Linguistics. find our card
  54. Walker, C., Strassel, S., Medero, J., and Maeda, K. (2006). ACE 2005 multilingual training corpus. LDC. find
  55. Wiseman, S., Rush, A. M., and Shieber, S. M. (2016). Learning global features for coreference resolution. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 994– 1004, San Diego, California, June. Association for Computational Linguistics. find
  56. Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, L., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., Stevens, K., Kurian, G., Patil, N., Wang, W., Young, C., Smith, J., Riesa, J., Rudnick, A., Vinyals, O., Corrado, G., Hughes, M., and Dean, J. (2016). Google’s neural machine translation system: Bridging the gap between human and machine translation. CoRR, abs/1609.08144. ↗
  57. Yang, X., Zhou, G., Su, J., and Tan, C. L. (2005). Improving noun phrase coreference resolution by matching strings. In Proceedings of the First International Joint Conference on Natural Language Processing, IJCNLP’04, pages 22– 31, Berlin, Heidelberg. Springer-Verlag. find
  58. Zeldes, A. (2017). The GUM corpus: Creating multi-layer resources in the classroom. Language Resources and Evaluation, 51(3):581–612. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/bamman-2020-annotated-dataset-coreference-english-literature/