Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,925 of 188,277
Downloads: 5,470,061
Daily
Ranking: 2,173 of 188,252
Downloads: 5,253
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,049 | 147,978 | slack-smart-bot |
| 21,951 | 69,360 | discourse_ai-tokenizers |
| 48,781 | 23,074 | jekyll-chatgpt-translate |
| 128,575 | 4,888 | openai.rb |
| 137,662 | 4,379 | dorian-commit |
| 171,120 | 2,472 | llm_conductor |
| 176,194 | 2,080 | htm |
| 179,315 | 1,545 | roseflow-tiktoken |
| 184,057 | 748 | ghostest |
| 184,706 | 674 | rubocop-prompt |
| 186,673 | 441 | nanogpt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,360 | 29,951,868 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao