Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 3,160 of 186,698
Downloads: 4,249,993
Daily
Ranking: 269 of 186,685
Downloads: 45,030
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,000 | 141,707 | slack-smart-bot |
| 36,657 | 32,309 | discourse_ai-tokenizers |
| 52,390 | 20,004 | jekyll-chatgpt-translate |
| 145,724 | 3,754 | openai.rb |
| 162,999 | 2,750 | dorian-commit |
| 178,708 | 1,241 | roseflow-tiktoken |
| 183,162 | 568 | ghostest |
| 185,263 | 320 | rubocop-prompt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,389 | 27,567,989 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao