論文 ·日本語 ·未確認

How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese

Takuro Fujii ・ Koki Shibata ・ Atsuki Yamaguchi ・ Terufumi Morishita ・ Yasuhiro Sogawa

刊行年: 2023-01-01
言語: 英語
OpenAlex: W4385570439
DOI: 10.18653/v1/2023.acl-srw.5
URL: https://aclanthology.org/2023.acl-srw.5.pdf

要旨

Takuro Fujii, Koki Shibata, Atsuki Yamaguchi, Terufumi Morishita, Yasuhiro Sogawa. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop). 2023.

主題

Natural Language Processing Techniques Topic Modeling Speech and dialogue systems

この書誌の出所

openalex— W4385570439（2026-08-14取得）

引用

Takuro Fujii・Koki Shibata・Atsuki Yamaguchi・Terufumi Morishita・Yasuhiro Sogawa（2023-01-01）　How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese　pp. 39-49

Fujii2023HowDoDifferent