The ISymbolTokenization type exposes the following members.
Methods
| Name | Description | |
|---|---|---|
 | AddChangeListener | Overloaded. |
| IsUnchanging |
A particular ChangeType can never be raised by this Changeable.
(Inherited from IChangeable.) |
| ParseToken |
Returns the symbol for a single token.
|
| RemoveChangeListener | Overloaded. |
| TokenizeSymbol |
Return a token representing a single symbol.
|
| TokenizeSymbolList |
Return a string representation of a list of symbols.
|
Properties
| Name | Description | |
|---|---|---|
 | Alphabet |
The alphabet to which this tokenization applies.
|
| Annotation |
Should return the associated annotation object.
(Inherited from IAnnotatable.) |
| TokenType |
Determine the style of tokenization represented by this object.
|
