Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 188,026 of 197,108
Downloads: 1,223

Daily

Ranking: 84,238 of 197,085
Downloads: 0

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,429,009,039rake
291,025,659,218rspec
98506,043,246simplecov
1,00152,242,160standard
1,30936,839,383rb_sys
1,45431,042,430rake-compiler

Owners

#GravatarHandle
1iconcpetersen