Categories: None [Edit]
tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.
Total
Ranking: 2,930 of 187,591
Downloads: 5,315,445
Daily
Ranking: 2,520 of 187,571
Downloads: 1,952
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 14,040 | 145,805 | slack-smart-bot |
| 25,156 | 56,053 | discourse_ai-tokenizers |
| 50,089 | 21,982 | jekyll-chatgpt-translate |
| 133,293 | 4,552 | openai.rb |
| 144,915 | 3,927 | dorian-commit |
| 178,618 | 1,551 | llm_conductor |
| 178,995 | 1,457 | roseflow-tiktoken |
| 183,496 | 701 | ghostest |
| 184,515 | 582 | rubocop-prompt |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 1,368 | 29,278,086 | rb_sys |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | iapark |
| 2 | | gjtorikian |
xmisao