nagisa Tokenizer

class konoha.word_tokenizers.nagisa_tokenizer.NagisaTokenizer
tokenize(text: str) List[Token]

Abstract method forkonoha.tokenization