BaseTokenizer
CharacterTokenizer
MeCabTokenizer
KyTeaTokenizer
SentencepieceTokenizer
SudachiTokenizer
JanomeTokenizer
NagisaTokenizer
WhitespaceTokenizer