define a token symbol
Get the name of the token manager
Get a token string by index
Get the TokenSymbol for a string
Get an enumerator over the symbol table
Get the token vocabulary (read-only).returnA Vector of Strings indexed by token type
Is this token manager read-only?
Get the highest token type in use
Get the next unused token type
Is a token symbol defined?