# `IREE.Tokenizers.Model`
[🔗](https://github.com/goodhamgupta/iree_tokenizers/blob/v0.7.0/lib/iree/tokenizers/model.ex#L1)

Pure Elixir model specification used to build IREE-backed tokenizers.

These structs are not tokenizers by themselves. They are small declarative
descriptions that can be passed to `IREE.Tokenizers.Tokenizer.init/1`.

Currently supported model constructors live in:

- `IREE.Tokenizers.Model.BPE`
- `IREE.Tokenizers.Model.WordPiece`
- `IREE.Tokenizers.Model.Unigram`

# `t`

```elixir
@type t() :: %IREE.Tokenizers.Model{info: map(), spec: map(), type: binary()}
```

A model specification that can be turned into an IREE tokenizer with
`IREE.Tokenizers.Tokenizer.init/1`.

# `info`

```elixir
@spec info(t()) :: map()
```

Returns metadata about the model specification.

The exact keys vary by model type, but always include `"model_type"`.

---

*Consult [api-reference.md](api-reference.md) for complete listing*