Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 188,165 of 197,861
Downloads: 1,262

Daily

Ranking: 73,908 of 197,834
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,447,561,113rake
291,033,456,311rspec
97513,037,789simplecov
99453,312,827standard
1,29837,471,878rb_sys
1,45331,536,301rake-compiler

Owners

#GravatarHandle
1iconcpetersen