Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,902 of 189,654
Downloads: 5,742,118
Daily
Ranking: 2,092 of 189,628
Downloads: 7,388
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,102 | 150,451 | slack-smart-bot |
| 16,104 | 117,350 | discourse_ai-tokenizers |
| 47,205 | 24,491 | jekyll-chatgpt-translate |
| 124,307 | 5,290 | openai.rb |
| 129,065 | 4,929 | dorian-commit |
| 159,301 | 3,373 | htm |
| 161,554 | 3,189 | llm_conductor |
| 179,845 | 1,598 | roseflow-tiktoken |
| 184,747 | 792 | rubocop-prompt |
| 184,780 | 788 | ghostest |
| 185,284 | 730 | nanogpt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,346 | 31,187,032 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao