Categories: None [Edit]

gtokenizer

https://rubygems.org/gems/gtokenizer
https://github.com/alexpeattie/gtokenizer
GTokenizer recreates the closed-source tokenization library used by Google for their Google NGrams app (http://ngrams.googlelabs.com/), based on the information in the associated Science paper (http://www.sciencemag.org/content/suppl/2010/12/16/science.1199644.DC1/Michel.SOM.revision.2.pdf)

Total

Ranking: 121,480 of 183,477
Downloads: 4,911

Daily

Ranking: 63,432 of 183,470
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
25825,073,950rspec

Owners

#GravatarHandle
1iconalexpeattie