.. _tokenprocessing:


tokenprocessing
===============


.. py:function:: make_token_tag(identifier)

   Feature engineering for identifiers, tags each character as a vowel, consonant, number, special character, or other.

   :param identifier: The identifier to tag.
   :type identifier: str
   :return: A string of tag characters the same length as the input string.
   :rtype: str


.. toctree::
    :maxdepth: 2
    :caption: Contents: