Categories: None [Edit]

tiktoken_ruby

An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens in text before sending it to OpenAI APIs.

Total

Ranking: - of 0

Downloads: -

Daily

Ranking: - of 0

Downloads: -

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

Rank	Downloads	Name

Depends on

Rank	Downloads	Name

Owners

#	Gravatar	Handle
1		iapark
2		gjtorikian