Categories: None [Edit]
tokenizers
Fast state-of-the-art tokenizers for Ruby
Total
Ranking: 4,998 of 197,051
Downloads: 1,687,745
Daily
Ranking: 3,194 of 197,010
Downloads: 2,527
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 4,212 | 2,581,866 | informers |
| 8,832 | 469,677 | discourse_ai-tokenizers |
| 43,691 | 29,216 | llm_memory |
| 97,650 | 9,030 | clip-rb |
| 107,420 | 7,697 | mlx-ruby-lm |
| 125,901 | 5,602 | transformers-rb |
| 142,741 | 4,493 | fastembed |
| 164,364 | 3,400 | gliner |
| 164,662 | 3,380 | laya |
| 181,388 | 2,205 | vectorsearch |
| 182,512 | 2,073 | llm-lsp |
| 183,913 | 1,877 | ruby-laya |
| 184,947 | 1,709 | token_estimator |
| 188,401 | 1,162 | kiribi |
| 189,366 | 1,027 | kiribi-multilingual_e5-small |
| 189,482 | 1,014 | prompt_guard |
| 190,319 | 913 | ruby_llm-tokenizer |
| 190,743 | 861 | fine |
| 192,376 | 675 | siglip2 |
| 192,967 | 607 | trainers-rb |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,308 | 36,786,547 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | ankane |
xmisao