Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,429 of 193,214
Downloads: 469,458
Daily
Ranking: 6,940 of 193,188
Downloads: 190
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,522 | 459,056 | katello |
| 14,906 | 144,604 | validate-website |
| 26,452 | 56,195 | wayback_archiver |
| 26,577 | 55,793 | esearchy |
| 47,134 | 25,451 | monet |
| 66,575 | 15,809 | hacker-gems |
| 68,965 | 15,002 | contentar |
| 70,088 | 14,649 | ronin-web-spider |
| 120,208 | 5,931 | spidr_cli |
| 129,808 | 5,042 | snackhack2 |
| 139,105 | 4,503 | stupid_crawler |
| 141,531 | 4,369 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |