Categories: None [Edit]

tokenizer-ruby

https://rubygems.org/gems/tokenizer-ruby
https://github.com/johannesdwicahyo/tokenizer-ruby
Fast tokenization for Ruby using HuggingFace's Rust-powered tokenizers library. Support...

Total

Ranking: 190,451 of 195,589
Downloads: 643

Daily

Ranking: 192,753 of 195,564
Downloads: 0

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName
192,701405ner-ruby

Depends on

RankDownloadsName
1,32734,912,501rb_sys

Owners

#GravatarHandle
1iconjohannesdwicahyo