Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 188,021 of 197,085
Downloads: 1,223

Daily

Ranking: 28,078 of 197,066
Downloads: 5

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,428,256,062rake
291,025,379,194rspec
98505,778,426simplecov
1,00152,206,783standard
1,30936,816,915rb_sys
1,45531,022,977rake-compiler

Owners

#GravatarHandle
1iconcpetersen