Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,729 of 196,480
Downloads: 7,365,494
Daily
Ranking: 1,718 of 196,444
Downloads: 11,335
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,982 | 446,987 | discourse_ai-tokenizers |
| 14,416 | 162,199 | slack-smart-bot |
| 40,984 | 31,594 | jekyll-chatgpt-translate |
| 71,751 | 14,583 | smart_prompt |
| 80,266 | 12,311 | openai.rb |
| 84,586 | 11,362 | llm_conductor |
| 107,192 | 7,674 | kward |
| 112,705 | 6,931 | dorian-commit |
| 126,662 | 5,479 | htm |
| 181,457 | 2,130 | myrr-rb |
| 182,486 | 1,998 | roseflow-tiktoken |
| 184,877 | 1,606 | nanogpt |
| 185,389 | 1,522 | ask-tokens |
| 188,044 | 1,115 | rubocop-prompt |
| 189,319 | 944 | ghostest |
| 189,570 | 914 | ask-token-usage |
| 189,995 | 866 | ruby_llm-tokenizer |
| 192,764 | 552 | crimson-code |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,311 | 36,236,408 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao