Categories: None [Edit]
tokenizers
Fast state-of-the-art tokenizers for Ruby
Total
Ranking: 4,933 of 197,744
Downloads: 1,752,231
Daily
Ranking: 2,407 of 197,724
Downloads: 6,318
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 4,219 | 2,605,149 | informers |
| 8,512 | 514,973 | discourse_ai-tokenizers |
| 38,003 | 35,407 | llm_memory |
| 61,023 | 18,640 | mlx-ruby-lm |
| 96,012 | 9,334 | clip-rb |
| 125,658 | 5,670 | transformers-rb |
| 141,254 | 4,601 | fastembed |
| 163,450 | 3,493 | gliner |
| 163,466 | 3,492 | laya |
| 180,658 | 2,306 | siglip2 |
| 181,206 | 2,254 | vectorsearch |
| 181,271 | 2,249 | trainers-rb |
| 182,229 | 2,150 | llm-lsp |
| 183,743 | 1,949 | ruby-laya |
| 185,147 | 1,726 | token_estimator |
| 188,524 | 1,192 | kiribi |
| 189,462 | 1,057 | prompt_guard |
| 189,534 | 1,047 | kiribi-multilingual_e5-small |
| 189,680 | 1,031 | ruby_llm-tokenizer |
| 190,891 | 884 | fine |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,302 | 37,362,741 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | ankane |
xmisao