Categories: None [Edit]
tokenizer-ruby
Fast tokenization for Ruby using HuggingFace's Rust-powered tokenizers library. Supports GPT, BERT, LLaMA, Claude, and any HuggingFace tokenizer.
Total
Ranking: 188,684 of 191,391
Downloads: 426
Daily
Ranking: 56,244 of 191,335
Downloads: 4
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | johannesdwicahyo |