Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 188,312 of 190,280
Downloads: 407

Daily

Ranking: 91,929 of 190,253
Downloads: 1

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,254,137,753rake
29956,893,742rspec
99449,278,982simplecov
1,09042,303,477standard
1,34331,589,606rb_sys
1,52025,608,049rake-compiler

Owners

#GravatarHandle
1iconcpetersen