The WordTokenization type exposes the following members.
Properties
| Name | Description | |
|---|---|---|
| Alphabet |
The alphabet to which this tokenization applies.
| |
| Annotation |
Should return the associated annotation object.
| |
| TokenType |
Determine the style of tokenization represented by this object.
|