Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,541 of 193,756
Downloads: 475,275
Daily
Ranking: 6,940 of 193,649
Downloads: 305
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,646 | 463,848 | katello |
| 14,964 | 144,937 | validate-website |
| 26,489 | 56,402 | wayback_archiver |
| 26,663 | 55,833 | esearchy |
| 47,106 | 25,602 | monet |
| 66,493 | 15,904 | hacker-gems |
| 69,123 | 15,022 | contentar |
| 69,624 | 14,860 | ronin-web-spider |
| 120,345 | 5,946 | spidr_cli |
| 129,251 | 5,101 | snackhack2 |
| 139,266 | 4,513 | stupid_crawler |
| 141,729 | 4,376 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |