The CODI-CRAC 2021 Shared Task on Anaphora, Bridging, and Discourse Deixis in Dialogue

What it is about

The shared task asks systems to find anaphoric relations in conversation, a genre that OntoNotes-style corpora barely cover. Three tasks are set: identity coreference (including split-antecedent plurals), bridging references, and discourse deixis. The data are four newly annotated dialogue corpora (AMI meetings, LIGHT fantasy-game dialogues, PERSUASION conversations, SWITCHBOARD telephone talks) with the ARRAU scheme, plus the TRAINS dialogues from ARRAU for training. The new part has 147,725 tokens and 41,807 markables in total. Annotation is in MMAX with mentions from a mention detector, and scoring uses the Universal Anaphora CoNLL-U extension and its scorer. The paper reports 115 runs from six teams, with most systems beating the baselines. This card rests on the paper's introduction, data and task sections; I did not verify the per-task results tables.

Ideas

• I1. Dialogue markables for Mova: count the discourse-deictic cases ("that", "this" referring to an event or fact) in dialogue lessons in coref/, and score them with a separate measure, since the identity scorer cannot see them.
• I2. Split-antecedent plurals as a rule in coref/src/sieve.rs: when a plural pronoun ("they", "both") has no single plural antecedent, search for two singular antecedents in the same sentence or the previous one and link them as one plural entity, reporting how many such links fire.
• I3. Keep the scorer separate: coref/src/eval.rs should report identity, bridging and discourse deixis as three numbers on a dialogue set, so that a gain on identity is not read as progress on the other relations.

For Mova

Code: coref/src/sieve.rs (split antecedents, discourse deixis), coref/src/eval.rs (per-relation scores), coref/src/corefud.rs (CoNLL-U with anaphoric extensions). Chapters: 38. Dialogue, discourse markers and reported speech, 36. Discourse relations and coherence, 35. Reference and coreference. Measure: per-relation F1 on one dialogue set (not used for tuning), run twice, and a negative control with turns shuffled, which should lower the score.

Topics: Discourse analysis · Coreference resolution

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.18653/v1/2021.codi-sharedtask.1

@inproceedings{khosla2021codi,
  title = {{The CODI-CRAC 2021 Shared Task on Anaphora, Bridging, and Discourse Deixis in Dialogue}},
  author = {Khosla, Sopan and Yu, Juntao and Manuvinakurike, Ramesh and Ng, Vincent and Poesio, Massimo and Strube, Michael and Rosé, Carolyn},
  booktitle = {Proceedings of the CODI-CRAC 2021 Shared Task on Anaphora, Bridging, and Discourse Deixis in Dialogue},
  year = {2021},
  doi = {10.18653/v1/2021.codi-sharedtask.1},
  url = {https://doi.org/10.18653/v1/2021.codi-sharedtask.1}
}

References

1 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. David Bamman, Olivia Lewke, and Anya Mansoor. 2020. An annotated dataset of coreference in english literature. In Proc. of LREC. European Language Resources Association (ELRA), Association for Computational Linguistics (ACL). find our card

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/khosla-2021-codi-crac-2021-shared-task/