論文 ·日本語 ·未確認
A Text Editing Approach to Joint Japanese Word Segmentation, POS Tagging, and Lexical Normalization
Shohei Higashiyama ・ Masao Utiyama ・ Taro Watanabe ・ Eiichiro Sumita
- 刊行年
- 2021-01-01
- 言語
- 英語
- OpenAlex
- W3212496399
- DOI
- 10.18653/v1/2021.wnut-1.9
- MAG
- 3212496399
- URL
- https://aclanthology.org/2021.wnut-1.9.pdf
要旨
Lexical normalization, in addition to word segmentation and part-of-speech tagging, is a fundamental task for Japanese user-generated text processing. In this paper, we propose a text editing model to solve the three task jointly and methods of pseudo-labeled data generation to overcome the problem of data deficiency. Our experiments showed that the proposed model achieved better normalization performance when trained on more diverse pseudo-labeled data.
主題
この書誌の出所
- openalex— W3212496399（2026-08-12取得）
引用
Shohei Higashiyama・Masao Utiyama・Taro Watanabe・Eiichiro Sumita（2021-01-01） A Text Editing Approach to Joint Japanese Word Segmentation, POS Tagging, and Lexical Normalization pp. 67-80
Higashiyama2021TextEditingApproach