Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,776 of 195,671
Downloads: 7,015,325
Daily
Ranking: 1,766 of 195,647
Downloads: 11,434
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 9,333 | 401,131 | discourse_ai-tokenizers |
| 14,322 | 161,412 | slack-smart-bot |
| 41,546 | 30,742 | jekyll-chatgpt-translate |
| 75,349 | 13,435 | smart_prompt |
| 82,148 | 11,797 | openai.rb |
| 95,908 | 9,149 | llm_conductor |
| 117,075 | 6,398 | dorian-commit |
| 123,473 | 5,721 | kward |
| 128,344 | 5,270 | htm |
| 181,919 | 1,890 | roseflow-tiktoken |
| 183,896 | 1,542 | nanogpt |
| 186,864 | 1,074 | rubocop-prompt |
| 188,019 | 924 | ghostest |
| 189,384 | 775 | ruby_llm-tokenizer |
| 192,195 | 469 | crimson-code |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,326 | 35,023,094 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao