The WordTokenization type exposes the following members.

Properties

  NameDescription
Alphabet
The alphabet to which this tokenization applies.
Annotation
Should return the associated annotation object.
TokenType
Determine the style of tokenization represented by this object.

See Also