Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,956 of 186,947
Downloads: 5,069,855
Daily
Ranking: 426 of 186,938
Downloads: 38,271
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,003 | 143,418 | slack-smart-bot |
| 29,397 | 44,012 | discourse_ai-tokenizers |
| 51,471 | 20,742 | jekyll-chatgpt-translate |
| 140,452 | 4,062 | openai.rb |
| 159,032 | 3,172 | dorian-commit |
| 178,740 | 1,335 | roseflow-tiktoken |
| 183,344 | 611 | ghostest |
| 184,981 | 414 | rubocop-prompt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,372 | 28,618,469 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao