Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,824 of 193,214
Downloads: 6,414,632
Daily
Ranking: 2,175 of 193,188
Downloads: 4,050
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 9,970 | 332,418 | discourse_ai-tokenizers |
| 14,271 | 157,533 | slack-smart-bot |
| 43,183 | 28,596 | jekyll-chatgpt-translate |
| 90,822 | 9,763 | openai.rb |
| 115,375 | 6,430 | llm_conductor |
| 122,915 | 5,633 | dorian-commit |
| 134,685 | 4,756 | htm |
| 180,823 | 1,769 | roseflow-tiktoken |
| 183,261 | 1,323 | nanogpt |
| 185,610 | 959 | rubocop-prompt |
| 186,256 | 875 | ghostest |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,337 | 33,376,815 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao