Categories: None [Edit]
tokenizers
Fast state-of-the-art tokenizers for Ruby
Total
Ranking: 5,127 of 195,571
Downloads: 1,535,755
Daily
Ranking: 2,887 of 195,548
Downloads: 1,120
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 4,188 | 2,522,720 | informers |
| 9,356 | 397,605 | discourse_ai-tokenizers |
| 48,136 | 25,228 | llm_memory |
| 103,593 | 8,094 | clip-rb |
| 127,270 | 5,349 | transformers-rb |
| 161,186 | 3,500 | fastembed |
| 165,383 | 3,171 | gliner |
| 179,901 | 2,145 | vectorsearch |
| 180,351 | 2,090 | mlx-ruby-lm |
| 181,935 | 1,866 | llm-lsp |
| 183,298 | 1,623 | token_estimator |
| 186,813 | 1,061 | kiribi |
| 187,663 | 948 | kiribi-multilingual_e5-small |
| 187,886 | 921 | prompt_guard |
| 189,400 | 757 | ruby_llm-tokenizer |
| 189,613 | 732 | fine |
| 190,783 | 606 | siglip2 |
| 191,598 | 515 | trainers-rb |
| 191,752 | 497 | kiribi-ruri_v3-30m |
| 191,847 | 486 | kiribi-gemma4_e2b |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,327 | 34,882,953 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | ankane |
xmisao