Knowledge-Free Induction of Inflectional Morphologies

What it is about

The paper induces the morphology of an inflectional language from raw text, with no human input. The algorithm combines three cues: orthography, semantics, and syntactic distributions. Its output is a set of conflation sets, groups of the inflected and derived forms of one word. The method is applied to German, Dutch and English. Using the hand-labelled CELEX lexicon as the gold standard, the current version reaches an F-score of 88.1% for conflation sets in English, which the author reports as better than the earlier knowledge-free algorithms. The paper also lists the precision of the suffix pairs it finds, mostly between about 70% and 96%.

Ideas

• I1. en/src/lexgen.rs: group the forms of data/forms.tsv that are not yet linked to a lemma into conflation sets from a raw English corpus, using the orthographic and distributional cues of the paper. Measure the F-score of the sets against the dictionary on a held-out part of the forms.
• I2. Use the suffix-pair table as a candidate list for the rules in en/src/morph.rs: each pair from raw text with a high count becomes a candidate rule, and the rule is accepted only if it is right on the held-out forms.
• I3. Add a negative control: shuffle the words of the corpus so that the distributional cue is gone, and show that the F-score falls. This tests whether the semantic cue is doing the work.

For Mova

The code is en/src/lexgen.rs and en/src/morph.rs, with the commands en lexicon and en morph-eval. The chapters are 16. Derivation I: prefixes and 17. Derivation II: suffixes. CELEX is a licensed lexicon, so it is test only. Measure first on held-out English forms, twice, with a two-fold check (en folds).

Cite

The paper itself, not this card. BibTeX from the library's record of the work. DOI 10.3115/1073336.1073360

@inproceedings{schone2001knowledge,
  title = {{Knowledge-Free Induction of Inflectional Morphologies}},
  author = {Schone, Patrick and Jurafsky, Daniel},
  booktitle = {Second Meeting of the North American Chapter of the Association for Computational Linguistics},
  year = {2001},
  doi = {10.3115/1073336.1073360},
  url = {https://doi.org/10.3115/1073336.1073360}
}

References

17 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Baayen, R.H., R. Piepenbrock, and H. van Rijn. (1993) The CELEX lexical database (CD-ROM), LDC, Univ. of Pennsylvania, Philadelphia, PA. find
2. Brent, M., S. K. Murthy, A. Lundberg. (1995). Discovering morphemic suffixes: A case study in MDL induction. Proc. Of 5 th Int’l Workshop on Artificial Intelligence and Statistics DéJean, H. (1998) Morphemes as necessary concepts for structures: Discovery from untagged corpora. Workshop on paradigms… find
3. Dumais, G.W. Furnas, T.K. Landauer, and R. Harshman. (1990) Indexing by Latent Semantic Analysis. Journal of the American Society of Information Science, Vol. 41, pp.391-407. find
4. Gaussier, É. (1999) Unsupervised learning of derivational morphology from inflectional lexicons. ACL '99 Workshop: Unsupervised Learning in Natural Language Processing, Univ. of Maryland. find
5. Goldsmith, J. (1997/2000) Unsupervised learning of the morphology of a natural language. Univ. of Chicago. http://humanities.uchicago.edu/faculty/goldsmith. ↗
6. Grabar, N. and P. Zweigenbaum. (1999) Acquisition automatique de connaissances morphologiques sur le vocabulaire médical, TALN, Cargése, France. find
7. Harris, Z. (1951) Structural Linguistics. University of Chicago Press. find
8. Jacquemin, C. (1997) Guessing morphology from terms and corpora. SIGIR'97, pp. 156-167, Philadelphia, PA. find
9. Kazakov, D. (1997) Unsupervised learning of naïve morphology with genetic algorithms. In W. Daelemans, et al., eds., ECML/Mlnet Workshop on Empirical Learning of Natural Language Processing Tasks, Prague, pp. 105-111. find
10. Landauer, T.K., P.W. Foltz, and D. Laham. (1998) Introduction to Latent Semantic Analysis. Discourse Processes. Vol. 25, pp. 259-284. find
11. Manning, C.D. and H. Schütze. (1999) Foundations of Statistical Natural Language Processing, MIT Press, Cambridge, MA. find
12. Nakisa, R.C., U.Hahn. (1996) Where defaults don't help: the case of the German plural system. Proc. of the 18th Conference of the Cognitive Science Society. find
13. Schone, P. and D. Jurafsky. (2000) Knowledge-free induction of morphology using latent semantic analysis. Proc. of the Computational Natural Language Learning Conference, Lisbon, pp. 67-72. find
14. Schütze, H. (1993) Distributed syntactic representations with an application to part-of-speech tagging. Proceedings of the IEEE International Conference on Neural Networks, pp. 1504-1509. find
15. Sproat, R. (1992) Morphology and Computation. MIT Press, Cambridge, MA. find
16. Xu, J., B.W. Croft. (1998) Corpus-based stemming using co-occurrence of word variants. ACM Transactions on Information Systems, 16 (1), pp. 61-81. find
17. Yarowsky, D. and R. Wicentowski. (2000) Minimally supervised morphological analysis by multimodal alignment. Proc. of the ACL 2000, Hong Kong. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/aclbulk-2001-schone-knowledge-free-induction-inflectional-morphologies/