Categories: None [Edit]

robot_rules

https://rubygems.org/gems/robot_rules
https://github.com/hasmanydevelopers/robot_rules
A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Total

Ranking: 78,588 of 190,402
Downloads: 12,022

Daily

Ranking: 54,140 of 190,364
Downloads: 3

Depended by

RankDownloadsName
50,03422,777rdaneel

Depends on

RankDownloadsName
171,135,436,448addressable

Owners

#GravatarHandle
1iconhmd