View Source Haystack.Tokenizer.Token (Haystack v0.1.0)
A module for Tokens.
Link to this section Summary
Functions
Create a new token.
Link to this section Types
Link to this section Functions
Create a new token.
examples
Examples
iex> Token.new("abc", offset: 0, length: 3)