Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,660 of 198,547
Downloads: 8,096,492
Daily
Ranking: 1,430 of 198,526
Downloads: 11,183
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 7,924 | 616,188 | discourse_ai-tokenizers |
| 14,586 | 164,031 | slack-smart-bot |
| 24,864 | 65,133 | llm_conductor |
| 38,040 | 35,618 | openai.rb |
| 40,422 | 32,827 | jekyll-chatgpt-translate |
| 55,242 | 21,492 | crimson-code |
| 69,928 | 15,476 | smart_prompt |
| 100,392 | 8,779 | kward |
| 111,618 | 7,225 | dorian-commit |
| 125,010 | 5,788 | htm |
| 181,811 | 2,248 | ask-tokens |
| 182,290 | 2,199 | rubocop-prompt |
| 182,409 | 2,186 | myrr-rb |
| 182,959 | 2,119 | roseflow-tiktoken |
| 184,911 | 1,842 | nanogpt |
| 189,004 | 1,196 | ruby_llm-tokenizer |
| 190,520 | 1,014 | ghostest |
| 190,668 | 1,000 | ask-token-usage |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,292 | 37,994,321 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao