Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 186,908 of 196,218
Downloads: 1,176

Daily

Ranking: 59,748 of 196,179
Downloads: 0

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,397,047,795rake
291,011,902,583rspec
98494,495,411simplecov
1,01550,408,895standard
1,31635,558,664rb_sys
1,46330,056,924rake-compiler

Owners

#GravatarHandle
1iconcpetersen