Categories: None [Edit]

ru_token

https://rubygems.org/gems/ru_token
https://github.com/LoganBresnahan/ru_token
[DEPRECATED] switch to 'j_r_r_token'. RuToken is a Ruby gem that wraps the tiktoken Rust library, enabling fast and efficient tokenization for OpenAI models. It supports multiple models including o200k_base, cl100k_base, p50k_base, and r50k_base.

Total

Ranking: 47,259 of 198,650
Downloads: 26,663

Daily

Ranking: 17,048 of 198,575
Downloads: 20

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,956,487,633bundler
81,466,417,310rake
1,45532,016,145rake-compiler

Owners

#GravatarHandle
1iconloganbresnahan