Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 189,247 of 192,104
Downloads: 435

Daily

Ranking: 106,871 of 192,085
Downloads: 1

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,291,638,605rake
29970,683,748rspec
99459,987,123simplecov
1,05944,672,660standard
1,34232,536,425rb_sys
1,49626,993,015rake-compiler

Owners

#GravatarHandle
1iconcpetersen