Categories: None [Edit]

tiktoken_ruby

https://rubygems.org/gems/tiktoken_ruby
https://github.com/IAPark/tiktoken_ruby
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.

Total

Ranking: 4,090 of 180,001
Downloads: 1,533,534

Daily

Ranking: 2,262 of 179,986
Downloads: 4,829

Depended by

RankDownloadsName
26,85942,733langchainrb
81,0069,491jekyll-chatgpt-translate
162,5522,318openai.rb
176,457696roseflow-tiktoken
179,412236ghostest

Depends on

RankDownloadsName
2,1366,785,198rb_sys

Owners

#GravatarHandle
1iconiapark