Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,711 of 197,108
Downloads: 7,560,629
Daily
Ranking: 1,694 of 197,085
Downloads: 8,343
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,719 | 480,948 | discourse_ai-tokenizers |
| 14,480 | 162,719 | slack-smart-bot |
| 30,322 | 48,096 | llm_conductor |
| 40,871 | 31,938 | jekyll-chatgpt-translate |
| 46,354 | 27,030 | openai.rb |
| 70,607 | 15,068 | crimson-code |
| 71,138 | 14,900 | smart_prompt |
| 104,371 | 8,151 | kward |
| 112,387 | 7,037 | dorian-commit |
| 126,603 | 5,545 | htm |
| 181,910 | 2,153 | myrr-rb |
| 182,589 | 2,069 | roseflow-tiktoken |
| 184,070 | 1,857 | ask-tokens |
| 185,309 | 1,653 | nanogpt |
| 188,629 | 1,132 | rubocop-prompt |
| 189,940 | 960 | ghostest |
| 190,067 | 946 | ask-token-usage |
| 190,249 | 923 | ruby_llm-tokenizer |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,309 | 36,839,383 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao