Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 186,485 of 187,603
Downloads: 341

Daily

Ranking: 110,823 of 187,591
Downloads: 1

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
101,165,909,119rake
28925,144,006rspec
98425,289,329simplecov
1,20035,789,363standard
1,36829,283,195rb_sys
1,57322,036,823rake-compiler

Owners

#GravatarHandle
1iconcpetersen