Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,694 of 197,835
Downloads: 7,810,242
Daily
Ranking: 1,521 of 197,813
Downloads: 4,899
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,455 | 523,177 | discourse_ai-tokenizers |
| 14,526 | 163,290 | slack-smart-bot |
| 28,388 | 53,255 | llm_conductor |
| 40,697 | 32,310 | jekyll-chatgpt-translate |
| 43,456 | 29,618 | openai.rb |
| 65,273 | 16,964 | crimson-code |
| 70,495 | 15,183 | smart_prompt |
| 101,421 | 8,592 | kward |
| 112,067 | 7,117 | dorian-commit |
| 125,872 | 5,651 | htm |
| 182,120 | 2,170 | myrr-rb |
| 182,241 | 2,158 | ask-tokens |
| 182,748 | 2,095 | roseflow-tiktoken |
| 185,124 | 1,743 | nanogpt |
| 187,168 | 1,411 | rubocop-prompt |
| 189,685 | 1,040 | ruby_llm-tokenizer |
| 190,154 | 984 | ghostest |
| 190,278 | 971 | ask-token-usage |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,300 | 37,445,527 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao