Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,891 of 190,317
Downloads: 5,850,642
Daily
Ranking: 2,206 of 190,280
Downloads: 8,142
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,088 | 152,472 | slack-smart-bot |
| 14,646 | 141,647 | discourse_ai-tokenizers |
| 46,151 | 25,419 | jekyll-chatgpt-translate |
| 116,006 | 6,177 | openai.rb |
| 126,780 | 5,109 | dorian-commit |
| 150,757 | 3,786 | llm_conductor |
| 154,656 | 3,621 | htm |
| 179,950 | 1,632 | roseflow-tiktoken |
| 184,793 | 828 | rubocop-prompt |
| 185,029 | 798 | ghostest |
| 185,134 | 784 | nanogpt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,342 | 31,626,622 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao