Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,508 of 196,721
Downloads: 502,354
Daily
Ranking: 6,678 of 196,694
Downloads: 217
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,515 | 501,140 | katello |
| 15,159 | 147,152 | validate-website |
| 26,589 | 57,685 | wayback_archiver |
| 27,073 | 56,097 | esearchy |
| 47,386 | 26,049 | monet |
| 65,928 | 16,499 | ronin-web-spider |
| 66,655 | 16,238 | hacker-gems |
| 69,389 | 15,331 | contentar |
| 119,744 | 2,080 | ping_thing |
| 120,725 | 6,085 | spidr_cli |
| 126,311 | 5,509 | snackhack2 |
| 139,954 | 4,613 | stupid_crawler |
| 142,357 | 4,478 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |