Categories: None [Edit]
tokenizer-ruby
Fast tokenization for Ruby using HuggingFace's Rust-powered tokenizers library. Supports GPT, BERT, LLaMA, Claude, and any HuggingFace tokenizer.
Total
Ranking: 188,846 of 192,071
Downloads: 473
Daily
Ranking: 86,098 of 192,060
Downloads: 3
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | johannesdwicahyo |