Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,921 of 188,354
Downloads: 5,489,594
Daily
Ranking: 2,114 of 188,339
Downloads: 6,008
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,054 | 148,083 | slack-smart-bot |
| 20,425 | 77,688 | discourse_ai-tokenizers |
| 48,681 | 23,158 | jekyll-chatgpt-translate |
| 128,229 | 4,916 | openai.rb |
| 136,848 | 4,427 | dorian-commit |
| 168,950 | 2,606 | llm_conductor |
| 175,801 | 2,129 | htm |
| 179,372 | 1,547 | roseflow-tiktoken |
| 184,131 | 751 | ghostest |
| 184,734 | 682 | rubocop-prompt |
| 186,278 | 501 | nanogpt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,360 | 30,050,064 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao