Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,755 of 196,218
Downloads: 7,200,668
Daily
Ranking: 1,840 of 196,179
Downloads: 10,306
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 9,164 | 424,329 | discourse_ai-tokenizers |
| 14,362 | 162,131 | slack-smart-bot |
| 41,163 | 31,299 | jekyll-chatgpt-translate |
| 74,000 | 13,871 | smart_prompt |
| 81,218 | 12,061 | openai.rb |
| 86,859 | 10,841 | llm_conductor |
| 113,479 | 6,814 | kward |
| 116,449 | 6,504 | dorian-commit |
| 126,766 | 5,441 | htm |
| 181,047 | 2,110 | myrr-rb |
| 182,213 | 1,955 | roseflow-tiktoken |
| 184,270 | 1,598 | nanogpt |
| 187,386 | 1,105 | rubocop-prompt |
| 187,612 | 1,073 | ask-tokens |
| 188,623 | 942 | ghostest |
| 189,008 | 897 | ask-token-usage |
| 189,545 | 838 | ruby_llm-tokenizer |
| 192,443 | 521 | crimson-code |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,316 | 35,558,664 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao