/ sandbox / tokenizer
In-browser tokenizer playground
Compare GPT-4o · GPT-4 · Claude · Llama · Mistral · GPT-22 files · monaco editor↗ Open on GitHub
// tokenizertap to switch · downloads once, caches in IndexedDB
› input
Chars
288
Words
47
Tokens
-
Chars / token
-
tokens / GPT-4o
// load a tokenizer to see the breakdown