Categories: None [Edit]

gigatoken

https://rubygems.org/gems/gigatoken
https://github.com/jetpks/gigatoken-rb
Ruby bindings to the gigatoken core crate: BPE and SentencePiece tokenization at GB/s.

Total

Ranking: 84,290 of 198,430
Downloads: 11,660

Daily

Ranking: 18,838 of 198,401
Downloads: 20

Depended by

RankDownloadsName

Depends on

RankDownloadsName
95655,827,448async
1,18142,334,387dry-cli
1,29237,918,875rb_sys
1,80120,274,832async-http

Owners

#GravatarHandle
1iconjetpks