Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 190,259 of 193,756
Downloads: 465

Daily

Ranking: 110,042 of 193,649
Downloads: 0

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,345,947,699rake
29989,540,006rspec
97475,839,609simplecov
1,03547,451,467standard
1,33633,875,951rb_sys
1,47528,684,964rake-compiler

Owners

#GravatarHandle
1iconcpetersen