sudachipy.tokenizer package
===========================


Note
---------------

* Import from ``sudachipy.tokenizer`` is deprecated.
   * Use ``from sudachipy import Tokenizer`` instead.
   * You can also import ``SplitMode``: ``from sudachipy import SplitMode``.


Module contents
---------------

.. automodule:: sudachipy.tokenizer
   :members:
   :undoc-members: