Categories: None [Edit]

j_r_r_token

https://rubygems.org/gems/j_r_r_token
https://github.com/LoganBresnahan/j_r_r_token
JRRToken is a Ruby gem that wraps the tiktoken Rust library, enabling fast and efficient tokenization for OpenAI models. It supports multiple models including o200k_base, cl100k_base, p50k_base, p50k_edit, and r50k_base.

Total

Ranking: 63,140 of 198,650
Downloads: 17,894

Daily

Ranking: 16,063 of 198,575
Downloads: 24

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,956,487,633bundler
81,466,417,310rake
1,45532,016,145rake-compiler

Owners

#GravatarHandle
1iconloganbresnahan