Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 188,876 of 191,429
Downloads: 417

Daily

Ranking: 119,687 of 191,405
Downloads: 1

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,272,305,385rake
29963,925,737rspec
99454,556,942simplecov
1,07343,450,697standard
1,34232,112,493rb_sys
1,51226,294,430rake-compiler

Owners

#GravatarHandle
1iconcpetersen