Categories: None [Edit]

tehcurtis-Roboto

https://rubygems.org/gems/tehcurtis-Roboto
https://github.com/tehcurtis/roboto
A simple robots.txt parser and wrapper method for open-uri's open that respects robot.txt files

Total

Ranking: 160,641 of 198,274
Downloads: 3,665

Daily

Ranking: 114,303 of 198,225
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName

Owners

#GravatarHandle