tiktoken_ex
Pure-Elixir TikToken-style byte-level BPE tokenizer, with helpers for Kimi K2 encodings.
Maintained on Hex by nshkrdotcom
Latest version
0.2.0
Last run
17 days ago
Checks
2
Assumed compatible: this package and its resolved dependencies passed host compilation and were identified as pure Elixir. No firmware targets were built.
| Target / check | Status | Firmware size | Run |
|---|---|---|---|
|
host
host
|
pass | — |
tiktoken_ex-0.2.0-1793819662828
|
|
Pure Elixir
|
pass | — |
tiktoken_ex-0.2.0-1793819662828
|
Add this badge to your README
It updates itself as tiktoken_ex's compatibility is reassessed.
Markdown
HTML