Categories: None [Edit]

tiktoken_ruby

https://rubygems.org/gems/tiktoken_ruby
https://github.com/IAPark/tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.

Total

Ranking: 3,160 of 186,698
Downloads: 4,249,993

Daily

Ranking: 269 of 186,685
Downloads: 45,030

Depended by

RankDownloadsName
14,000141,707slack-smart-bot
36,65732,309discourse_ai-tokenizers
52,39020,004jekyll-chatgpt-translate
145,7243,754openai.rb
162,9992,750dorian-commit
178,7081,241roseflow-tiktoken
183,162568ghostest
185,263320rubocop-prompt

Depends on

RankDownloadsName
1,38927,567,989rb_sys

Owners

#GravatarHandle
1iconiapark
2icongjtorikian