Categories: None [Edit]
tokenizer-ruby
Fast tokenization for Ruby using HuggingFace's Rust-powered tokenizers library. Supports GPT, BERT, LLaMA, Claude, and any HuggingFace tokenizer.
Total
Ranking: 178,331 of 198,575
Downloads: 2,523
Daily
Ranking: 21,048 of 198,547
Downloads: 7
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | johannesdwicahyo |