Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,844 of 192,692
Downloads: 6,248,599
Daily
Ranking: 2,324 of 192,666
Downloads: 1,771
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 10,427 | 298,963 | discourse_ai-tokenizers |
| 14,248 | 156,368 | slack-smart-bot |
| 44,101 | 27,637 | jekyll-chatgpt-translate |
| 99,797 | 8,405 | openai.rb |
| 124,119 | 5,473 | dorian-commit |
| 124,339 | 5,451 | llm_conductor |
| 141,899 | 4,322 | htm |
| 180,605 | 1,737 | roseflow-tiktoken |
| 183,616 | 1,205 | nanogpt |
| 185,525 | 923 | rubocop-prompt |
| 186,015 | 857 | ghostest |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,340 | 32,953,769 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao