Recognizing Expressions of Commonsense Psychology in English Text

What it is about

The authors hand-write local grammars, compiled into finite-state transducers with the Intex tool, that recognise expressions of commonsense psychology (beliefs, memory, explanation, similarity) in English. Four conceptual areas were completed. A survey of 99 volunteers supplied 297 positive and 297 negative sentences per area; six raters then filtered sentences that did not follow the instructions (inter-rater kappa 0.56 to 0.81). On the filtered data the grammars reach 95.15% precision and 81.51% recall overall. They beat unigram and bigram SVMs on accuracy in three of four areas, and an SVM that also gets the grammar's concept hits as features beats both. Applied to the U.S. State of the Union addresses from 1790 to 2003, the grammars find 4,290 references to adversarial and competitive goals, peaking in years of war.

Ideas

• I1. Psychological verb grammar in UD terms: rules over lemma and dependency (believe, remember, explain with ccomp, xcomp and nsubj) instead of surface strings, in prag/src/frames.rs. Each hit becomes a frame with a reason, which can feed world/src/events.rs.
• I2. Report precision and recall before and after filtering the test sentences, as the paper does, and fix the filter rules before measuring, so that the filter does not favour the system.
• I3. Use the grammar hits as extra features in a perceptron that decides speech-act or hedge labels in prag. The paper shows that such features help a classifier; measure on cross-validation, not on the held-out set.
• I4. Corpus rate: hits per 100 words over a dated open corpus, to show when a category rises, as in the paper's Figure 1.

For Mova

Chapters: 23. Complementation (believe that, remember to), 19. The lexicon: vocabulary, multiword expressions and register and 30. Pragmatics and discourse: overview. Code: prag/src/frames.rs, prag/src/roles.rs, world/src/events.rs. Measure: precision and recall on the school sentences before and after filtering, run twice.

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.3115/1075096.1075123

@inproceedings{gordon2003recognizing,
  title = {{Recognizing Expressions of Commonsense Psychology in English Text}},
  author = {Gordon, Andrew and Kazemzadeh, Abe and Nair, Anish and Petrova, Milena},
  booktitle = {Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics},
  year = {2003},
  doi = {10.3115/1075096.1075123},
  url = {https://doi.org/10.3115/1075096.1075123}
}

References

12 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Baker, C., Fillmore, C., & Lowe, J. (1998) The Berkeley FrameNet project. in Proceedings of the COLING-ACL, Montreal, Canada. find our card
2. Bartsch, K. & Wellman, H. (1995) Children talk about the mind. New York: Oxford University Press. find
3. Dyer, J., Shatz, M., & Wellman, H. (2000) Young children’s storybooks as a source of mental state information. Cognitive Development 15:17-37. find
4. Ferguson, G. & Allen, J. (1993) Cooperative Plan Reasoning for Dialogue Systems, in AAAI-93 Fall Symposium on Human-Computer Collaboration: Reconciling Theory, Synthesizing Practice, AAAI Technical Report FS-93-05. Menlo Park, CA: AAAI Press. find
5. Gordon, A. (2002) The Theory of Mind in Strategy Representations. 24th Annual Meeting of the Cognitive Science Society. Mahwah, NJ: Lawrence Erlbaum Associates. find
6. Gordon, A. & Hobbs (2003) Coverage and competency in formal theories: A commonsense theory of memory. AAAI Spring Symposium on Formal Theories of Commonsense knowledge, March 24-26, Stanford. find
7. Platt, J. (1998). Fast Training of Support Vector Machines using Sequential Minimal Optimization. In B. Schölkopf, C. Burges, and A. Smola (eds.) Advances in Kernel Methods - Support Vector Learning, Cambridge, MA: MIT Press. find
8. Reboul A., Sabatier P., Noël-Jorand M-C. (2001) Le discours des schizophrènes: une étude de cas. Revue française de Psychiatrie et de Psychologie Médicale, 49, pp 6-11. find
9. Silberztein, M. (1999) Text Indexing with INTEX. Computers and the Humanities 33(3). find
10. Traum, D. (1993) Mental state in the TRAINS-92 dialogue manager. In Working Notes of the AAAI Spring Symposium on Reasoning about Mental States: Formal Theories and Applications, pages 143-149, 1993. Menlo Park, CA: AAAI Press. find
11. Voorhees, E. & Buckland, L. (2002) The Eleventh Text REtrieval Conference (TREC 2002). Washington, DC: Department of Commerce, National Institute of Standards and Technology. find
12. Witten, I. & Frank, E. (1999) Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufman. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/gordon-2003-recognizing-expressions-commonsense-psychology-english/