Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 189,906 of 193,214
Downloads: 462

Daily

Ranking: 129,210 of 193,188
Downloads: 0

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,330,047,653rake
29983,045,376rspec
97470,376,754simplecov
1,04146,521,623standard
1,33733,376,815rb_sys
1,47728,222,056rake-compiler

Owners

#GravatarHandle
1iconcpetersen