Categories: None [Edit]
tokenizers
Fast state-of-the-art tokenizers for Ruby
Total
Ranking: 4,835 of 198,430
Downloads: 1,866,723
Daily
Ranking: 2,595 of 198,401
Downloads: 5,437
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 4,237 | 2,624,228 | informers |
| 7,995 | 604,541 | discourse_ai-tokenizers |
| 35,806 | 38,641 | llm_memory |
| 52,450 | 23,057 | mlx-ruby-lm |
| 94,625 | 9,612 | clip-rb |
| 124,911 | 5,790 | transformers-rb |
| 139,424 | 4,736 | fastembed |
| 162,199 | 3,605 | gliner |
| 163,115 | 3,549 | laya |
| 169,107 | 3,092 | trainers-rb |
| 180,587 | 2,351 | siglip2 |
| 181,322 | 2,287 | vectorsearch |
| 181,629 | 2,259 | llm-lsp |
| 183,718 | 2,015 | ruby-laya |
| 185,298 | 1,771 | token_estimator |
| 188,747 | 1,229 | kiribi |
| 189,159 | 1,166 | ruby_llm-tokenizer |
| 189,572 | 1,110 | prompt_guard |
| 189,812 | 1,077 | kiribi-multilingual_e5-small |
| 191,259 | 922 | fine |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,292 | 37,918,875 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | ankane |
xmisao