Categories: None [Edit]

tiktoken_ruby

https://rubygems.org/gems/tiktoken_ruby
https://github.com/IAPark/tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.

Total

Ranking: 2,956 of 186,947
Downloads: 5,069,855

Daily

Ranking: 426 of 186,938
Downloads: 38,271

Depended by

RankDownloadsName
14,003143,418slack-smart-bot
29,39744,012discourse_ai-tokenizers
51,47120,742jekyll-chatgpt-translate
140,4524,062openai.rb
159,0323,172dorian-commit
178,7401,335roseflow-tiktoken
183,344611ghostest
184,981414rubocop-prompt

Depends on

RankDownloadsName
1,37228,618,469rb_sys

Owners

#GravatarHandle
1iconiapark
2icongjtorikian