Skip to content

Pull requests: mlc-ai/tokenizers-cpp

New pull request New
4 Open 42 Closed
4 Open 42 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

cargo extra envs flags for aarch64
#90 opened Dec 11, 2025 by NaveenMittal0 Loading…
Add full support for MLC_ENABLE_SENTENCEPIECE_TOKENIZER
#85 opened Jul 28, 2025 by WilliamTambellini Loading…
Add method to return attn-mask for HF Tokenizer.
#60 opened Feb 11, 2025 by cptspacemanspiff Loading…
Add hf tokenizer class definition header
#57 opened Jan 26, 2025 by cptspacemanspiff Loading…
ProTip! Filter pull requests by the default branch with base:main.