The WordTokenization type exposes the following members.
Properties
Name | Description | |
---|---|---|
![]() | Alphabet |
The alphabet to which this tokenization applies.
|
![]() | Annotation |
Should return the associated annotation object.
|
![]() | TokenType |
Determine the style of tokenization represented by this object.
|