Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,908 of 189,104
Downloads: 5,657,901
Daily
Ranking: 1,984 of 189,083
Downloads: 7,191
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,073 | 149,903 | slack-smart-bot |
| 16,708 | 109,369 | discourse_ai-tokenizers |
| 47,303 | 24,342 | jekyll-chatgpt-translate |
| 124,890 | 5,222 | openai.rb |
| 130,439 | 4,833 | dorian-commit |
| 161,246 | 3,203 | htm |
| 164,713 | 2,901 | llm_conductor |
| 179,763 | 1,588 | roseflow-tiktoken |
| 184,675 | 781 | ghostest |
| 184,731 | 773 | rubocop-prompt |
| 185,403 | 697 | nanogpt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,351 | 30,739,944 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao