Categories: None [Edit]

robot_rules

https://rubygems.org/gems/robot_rules
https://github.com/hasmanydevelopers/robot_rules
A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Total

Ranking: 79,331 of 193,262
Downloads: 12,171

Daily

Ranking: 37,674 of 193,241
Downloads: 5

Depended by

RankDownloadsName
50,69123,039rdaneel

Depends on

RankDownloadsName
161,191,438,284addressable

Owners

#GravatarHandle
1iconhmd