Mova0.5 pre-release⌕
☰
home / docs / papers / English / Joint English Spelling Error Correction and POS Tagging for Language Learners Writing

Joint English Spelling Error Correction and POS Tagging for Language Learners Writing

What it is about

Spelling correction is usually a pipeline step before tagging, but it cannot fix learner errors that produce real words (homophones, confusions, split and merge errors, inflection and derivation errors such as "badly" for "bad"), and the tagger needs the context to choose the fix. The authors use a Japanese-style lattice tagger (MeCab, a CRF) that jointly chooses a path of words and tags. A misspelling lexicon adds each error with a cost, a flag and its correct form. On the Cambridge Learner Corpus FCE data (2,488 essays) the joint model raises tagging F-value from 0.960 to 0.981, against 0.968 for the pipeline. On the Konan-JIEM corpus the gain is 3.8 points. Spelling correction F-value rises by 5.0 points, with recall up 19.5 points and precision down from 0.519 to 0.445. Of the 8,349 spelling errors in the FCE data, 58.2% are typographical and 22.9% derivation errors.

Ideas

For Mova

The chapter is 06. Spelling rules: inflection, derivation, compounds and national standards, with 05. The writing system for characters. The code points are en/src/dict.rs (the misspelling entries), en/src/tok.rs (tokens that are real words but wrong in context) and en/src/tag.rs (the context tag for candidate choice). The measure: correction precision and recall per error type on a held-out learner set that Mova owns, with and without the threshold, run twice for determinism.

Topics: Part-of-speech tagging

Cite

The paper itself, not this card. BibTeX from the library's record of the work.

@inproceedings{sakaguchi2012joint,
  title = {{Joint English Spelling Error Correction and POS Tagging for Language Learners Writing}},
  author = {Sakaguchi, Keisuke and Mizumoto, Tomoya and Komachi, Mamoru and Matsumoto, Yuji},
  booktitle = {Proceedings of COLING 2012},
  year = {2012},
  url = {https://aclanthology.org/C12-1144/}
}

References

31 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Baba, Y. and Suzuki, H. (2012). How Are Spelling Errors Generated and Corrected? A Study of Corrected and Uncorrected Spelling Errors Using Keystroke Logs. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pages 373–377. find
  2. Bao, Z., Kimelfeld, B., and Li, Y. (2011). A Graph Approach to Spelling Correction in Domain-Centric Search. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pages 905–914. find
  3. Brants, T. and Franz, A. (2006). Web 1T 5-gram Corpus version 1.1. Technical report, Google Research. find
  4. Brill, E. and Moore, R. C. (2000). An Improved Error Model for Noisy Channel Spelling Correction. Proceedings of the 38th Annual Meeting on Association for Computational Linguistics, pages 286–293. find
  5. Brockett, C., Dolan, W. B., and Gamon, M. (2006). Correcting ESL Errors Using Phrasal SMT Techniques. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 249–256. find
  6. Chen, Q., Li, M., and Zhou, M. (2007). Improving Query Spelling Correction Using Web Search Results. Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 181–189. find
  7. Dahlmeier, D. and Ng, H. T. (2011). Grammatical Error Correction with Alternating Structure Optimization. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pages 915–923. find
  8. Dahlmeier, D. and Ng, H. T. (2012). A Beam-Search Decoder for Grammatical Error Correction. Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 568–578. find
  9. Dale, R., Anisimoff, I., and Narroway, G. (2012). HOO 2012 : A Report on the Preposition and Determiner Error Correction Shared Task. The 7th Workshop on the Innovative Use of NLP for Building Educational Applications, pages 54–62. find
  10. Felice, R. D. and Pulman, S. G. (2008). A Classifier-based Approach to Preposition and Determiner Error Correction in L2 English. Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), pages 169–176. find
  11. Gamon, M. (2010). Using Mostly Native Data to Correct Errors in Learners’ Writing: a Meta-Classifier Approach. Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 163–171. find
  12. Gao, J., Li, X., Micol, D., Quirk, C., and Sun, X. (2010). A Large Scale Ranker-based System for Search Query Spelling Correction. Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pages 358–366. find
  13. Goldberg, Y. and Tsarfaty, R. (2008). A Single Generative Model for Joint Morphological Segmentation and Syntactic Parsing. Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics, pages 371–379. find
  14. Golding, A. R. and Roth, D. (1999). A Winnow-Based Approach to Context-Sensitive Spelling Correction. Machine Learning, 34:107–130. find
  15. Han, N.-R., Chodorow, M., and Leacock, C. (2006). Detecting Errors in English Article Usage by Non-Native Speakers. Natural Language Engineering, 12(02):115–129. find
  16. Hatori, J., Matsuzaki, T., Miyao, Y., and Tsujii, J. (2012). Incremental Joint Approach to Word Segmentation, POS Tagging, and Dependency Parsing in Chinese. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pages 1045–1053. find
  17. Islam, A. and Inkpen, D. (2009). Real-Word Spelling Correction using Google Web 1T 3-grams. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 1241–1249. find
  18. Izumi, E., Uchimoto, K., Saiga, T., Supnithi, T., and Isahara, H. (2003). Automatic Error Detection in the Japanese Learners’ English Spoken Data. Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, pages 145–148. find
  19. Kudo, T., Yamamoto, K., and Matsumoto, Y. (2004). Applying Conditional Random Fields to Japanese Morphological Analysis. Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pages 230–237. find
  20. Kukich, K. (1992). Techniques for Automatically Correcting Words in Text. ACM Computing Surveys, 24(4):377–439. find
  21. Lafferty, J., McCallum, A., and Pereira, F. (1999). Conditional Random Fields : Probabilistic Models for Segmenting and Labeling Sequence Data. Proceedings of the 18th International Conference on Machine Learning 2001 (ICML 2001), pages 282–289. find
  22. Lee, J. and Seneff, S. (2008). Correcting Misuse of Verb Forms. Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics, pages 174–182. find
  23. Nagata, R., Whittaker, E., and Sheinman, V. (2011). Creating a Manually Error-tagged and Shallow-parsed Learner Corpus. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pages 1210–1219. find
  24. Park, Y. A. and Levy, R. (2011). Automated Whole Sentence Grammar Correction Using a Noisy Channel Model. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pages 934–944. find
  25. Rozovskaya, A. and Roth, D. (2011). Algorithm Selection and Model Adaptation for ESL Correction Tasks. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pages 924–933. find
  26. Sun, X., Gao, J., Micol, D., and Quirk, C. (2010). Learning Phrase-Based Spelling Error Models from Clickthrough Data. Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 266–274. find
  27. Surdeanu, M., Johansson, R., Meyers, A., Màrquez, L., and Nivre, J. (2008). The CoNLL-2008 Shared Task on Joint Parsing of Syntactic and Semantic Dependencies. Proceedings of the 12th Conference on Computational Natural Language Learning, pages 159–177. find our card
  28. Tajiri, T., Komachi, M., and Matsumoto, Y. (2012). Tense and Aspect Error Correction for ESL Learners Using Global Context. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 198–202. find
  29. Toutanova, K. and Moore, R. C. (2002). Pronunciation Modeling for Improved Spelling Correction. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 144–151. find
  30. Yannakoudakis, H., Briscoe, T., and Medlock, B. (2011). A New Dataset and Method for Automatically Grading ESOL Texts. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pages 180–189. find
  31. Zhang, Y. and Clark, S. (2010). A Fast Decoder for Joint Word Segmentation and POS -Tagging Using a Single Discriminative Model. Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pages 843–852. find

This page in Markdown → https://md.mova.elamur.ai/free/en/docs/papers/sakaguchi-2012-joint-english-spelling-error-correction/