.. module:: konoha.word_tokenizers.tokenizer

Base Word Tokenizer
==========================

.. autoclass:: BaseTokenizer
    :members: