Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,712 of 197,085
Downloads: 7,552,286
Daily
Ranking: 2,223 of 197,066
Downloads: 3,384
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,727 | 480,314 | discourse_ai-tokenizers |
| 14,479 | 162,709 | slack-smart-bot |
| 30,350 | 48,021 | llm_conductor |
| 40,864 | 31,934 | jekyll-chatgpt-translate |
| 46,409 | 26,975 | openai.rb |
| 70,644 | 15,050 | crimson-code |
| 71,173 | 14,886 | smart_prompt |
| 105,674 | 7,972 | kward |
| 112,463 | 7,025 | dorian-commit |
| 126,619 | 5,542 | htm |
| 181,913 | 2,151 | myrr-rb |
| 182,604 | 2,066 | roseflow-tiktoken |
| 184,083 | 1,854 | ask-tokens |
| 185,309 | 1,650 | nanogpt |
| 188,631 | 1,131 | rubocop-prompt |
| 189,954 | 957 | ghostest |
| 190,058 | 945 | ask-token-usage |
| 190,268 | 920 | ruby_llm-tokenizer |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,309 | 36,816,915 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao