Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 189,574 of 192,692
Downloads: 451

Daily

Ranking: 143,659 of 192,666
Downloads: 3

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,311,002,349rake
29976,634,844rspec
99464,953,038simplecov
1,05045,612,842standard
1,34032,953,769rb_sys
1,48427,625,796rake-compiler

Owners

#GravatarHandle
1iconcpetersen