Categories: None [Edit]

robot_rules

https://rubygems.org/gems/robot_rules
https://github.com/hasmanydevelopers/robot_rules
A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Total

Ranking: 79,008 of 192,384
Downloads: 12,114

Daily

Ranking: 52,097 of 192,352
Downloads: 5

Depended by

RankDownloadsName
50,47922,936rdaneel

Depends on

RankDownloadsName
161,169,879,903addressable

Owners

#GravatarHandle
1iconhmd