Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,931 of 187,967
Downloads: 5,391,799
Daily
Ranking: 2,297 of 187,960
Downloads: 2,735
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,043 | 146,888 | slack-smart-bot |
| 23,973 | 60,468 | discourse_ai-tokenizers |
| 49,388 | 22,555 | jekyll-chatgpt-translate |
| 130,774 | 4,737 | openai.rb |
| 141,390 | 4,141 | dorian-commit |
| 176,214 | 2,035 | llm_conductor |
| 179,174 | 1,493 | roseflow-tiktoken |
| 179,733 | 1,365 | htm |
| 183,794 | 724 | ghostest |
| 184,576 | 635 | rubocop-prompt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,365 | 29,613,624 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao