Categories: None [Edit]

tokenkit

https://rubygems.org/gems/tokenkit
https://github.com/scientist-labs/tokenkit
TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Total

Ranking: 188,036 of 189,628
Downloads: 401

Daily

Ranking: 56,931 of 189,601
Downloads: 1

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

RankDownloadsName

Depends on

RankDownloadsName
91,237,600,515rake
29950,830,885rspec
99444,585,885simplecov
1,10441,325,199standard
1,34631,156,736rb_sys
1,52525,128,780rake-compiler

Owners

#GravatarHandle
1iconcpetersen