Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,917 of 188,757
Downloads: 5,559,511
Daily
Ranking: 2,110 of 188,742
Downloads: 6,301
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,050 | 149,231 | slack-smart-bot |
| 17,986 | 96,209 | discourse_ai-tokenizers |
| 47,959 | 23,786 | jekyll-chatgpt-translate |
| 125,884 | 5,117 | openai.rb |
| 132,240 | 4,713 | dorian-commit |
| 167,053 | 2,741 | llm_conductor |
| 167,847 | 2,694 | htm |
| 179,619 | 1,566 | roseflow-tiktoken |
| 184,511 | 766 | ghostest |
| 184,733 | 738 | rubocop-prompt |
| 185,727 | 627 | nanogpt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,358 | 30,348,208 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao