Categories: None [Edit]

tiktoken_ruby

https://rubygems.org/gems/tiktoken_ruby
https://github.com/IAPark/tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.

Total

Ranking: 3,561 of 184,150
Downloads: 2,738,728

Daily

Ranking: 2,142 of 184,132
Downloads: 5,133

Depended by

RankDownloadsName
13,655137,687slack-smart-bot
55,55017,755jekyll-chatgpt-translate
152,4833,363openai.rb
173,5151,913dorian-commit
177,8591,064roseflow-tiktoken
181,874448ghostest

Depends on

RankDownloadsName
1,53819,198,414rb_sys

Owners

#GravatarHandle
1iconiapark
2icongjtorikian