Categories: None [Edit]
robot_rules
A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.
Total
Ranking: 81,143 of 198,121
Downloads: 12,316
Daily
Ranking: 119,574 of 198,088
Downloads: 1
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 51,959 | 23,294 | rdaneel |
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 15 | 1,299,331,585 | addressable |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | hmd |