Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 187,558 of 196,480
Downloads: 1,185

Daily

Ranking: 68,498 of 196,444
Downloads: 0

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,412,729,553rake
291,018,839,902rspec
98500,173,958simplecov
1,00651,345,178standard
1,31136,236,408rb_sys
1,45830,561,759rake-compiler

Owners

#GravatarHandle
1iconcpetersen