Categories: None [Edit]

robot_rules

https://rubygems.org/gems/robot_rules
https://github.com/hasmanydevelopers/robot_rules
A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Total

Ranking: 80,825 of 197,085
Downloads: 12,291

Daily

Ranking: 55,182 of 197,066
Downloads: 1

Depended by

RankDownloadsName
51,70423,262rdaneel

Depends on

RankDownloadsName
151,276,740,491addressable

Owners

#GravatarHandle
1iconhmd