Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 187,459 of 188,609
Downloads: 387

Daily

Ranking: 128,836 of 188,587
Downloads: 0

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
101,198,633,275rake
29939,539,610rspec
99435,721,038simplecov
1,13338,829,822standard
1,35930,220,796rb_sys
1,54123,984,872rake-compiler

Owners

#GravatarHandle
1iconcpetersen