Categories: None [Edit]
tokenizers
Fast state-of-the-art tokenizers for Ruby
Total
Ranking: 5,053 of 196,721
Downloads: 1,631,340
Daily
Ranking: 2,980 of 196,694
Downloads: 1,822
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 4,204 | 2,557,355 | informers |
| 9,003 | 443,945 | discourse_ai-tokenizers |
| 47,320 | 26,094 | llm_memory |
| 99,779 | 8,687 | clip-rb |
| 125,944 | 5,543 | transformers-rb |
| 143,708 | 4,401 | fastembed |
| 164,404 | 3,348 | gliner |
| 180,402 | 2,232 | mlx-ruby-lm |
| 180,883 | 2,183 | vectorsearch |
| 182,104 | 2,035 | llm-lsp |
| 184,380 | 1,677 | token_estimator |
| 187,913 | 1,124 | kiribi |
| 188,813 | 1,006 | kiribi-multilingual_e5-small |
| 188,935 | 988 | prompt_guard |
| 189,979 | 864 | ruby_llm-tokenizer |
| 190,223 | 837 | fine |
| 191,901 | 654 | siglip2 |
| 192,533 | 584 | trainers-rb |
| 192,860 | 545 | kiribi-ruri_v3-30m |
| 192,992 | 529 | kiribi-gemma4_e2b |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,311 | 36,153,393 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | ankane |
xmisao