← Packages
python-tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
- Current
- 0.12.0
- Candidate
- 0.14.0Stale
- License
- MIT AND ((MIT OR Apache-2.0) AND Unicode-DFS-2016) AND Apache-2.0 AND (Apache-2.0 OR MIT) AND (Unlicense OR MIT)
RuntimeDeps
| Dependency | Observed source | Current requirement | Candidate requirement |
|---|---|---|---|
2026.1.15 | |||
2.33.1 | |||
3.14.9 |
Optional RuntimeDeps
Description
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Changelog
PR · 5
Checks
| Monitor | Observation | Last checked |
|---|---|---|
Stale Repository refresh: git fetch exited 128 (authentication) | ||
Stale Source last confirmed at 2026-11-10T23:09:30+00:00; repository refresh overdue. | ||
Checked | ||
Checked | ||
Not configured No reliable monitor identity/configuration. | — | |
Metadata unavailable Provider license expression is invalid SPDX metadata or exceeds the comparison budget. | Last attempted | |
Checked | Last attempted | |
Checked Current source component only; local patches, build options, bundled dependencies and binary artifacts are not evaluated. | ||
Checked |