Skip to content
Yunedia Tools

LLM Token 计数器

使用真实的 BPE 分词器为 OpenAI 模型精确计算 token,并为 Claude、Gemini 等其他模型提供明确标注的估算值。

Enter some text to see the count.

使用方法

  1. Paste the text you want to count.
  2. Pick a model. GPT-4o family and GPT-4/3.5 are counted exactly with the real tokenizer.
  3. Claude, Gemini, Llama and Mistral show an estimate, always labeled as one, with the heuristic stated.

注意事项

Exact counts run entirely in your browser with gpt-tokenizer (o200k_base / cl100k_base); your text is never sent to a server. Other providers do not publish a browser tokenizer, so this page offers only a character-based estimate for them and never presents it as exact.

常见问题

How far off can the estimates be?
For English prose, often within 10–20%, but code, long numbers and CJK text can be far off. Keep a margin when budgeting from an estimate.
Why does Japanese cost more tokens?
BPE tokenizers are trained mostly on English, so a Japanese character typically becomes about one token (sometimes more). You can verify this with the exact GPT counters on this page.