Categories: None [Edit]

robot_rules

https://rubygems.org/gems/robot_rules
https://github.com/hasmanydevelopers/robot_rules
A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Total

Ranking: 77,627 of 187,239
Downloads: 11,760

Daily

Ranking: 58,247 of 187,224
Downloads: 6

Depended by

RankDownloadsName
49,38922,267rdaneel

Depends on

RankDownloadsName
221,044,220,967addressable

Owners

#GravatarHandle
1iconhmd