The WordTokenization type exposes the following members.
Properties
Name | Description | |
---|---|---|
Alphabet |
The alphabet to which this tokenization applies.
| |
Annotation |
Should return the associated annotation object.
| |
TokenType |
Determine the style of tokenization represented by this object.
|