Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,397 of 189,628
Downloads: 443,537
Daily
Ranking: 7,789 of 189,601
Downloads: 163
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,524 | 428,899 | katello |
| 14,593 | 141,239 | validate-website |
| 26,026 | 55,110 | esearchy |
| 26,182 | 54,602 | wayback_archiver |
| 47,003 | 24,620 | monet |
| 66,778 | 15,221 | hacker-gems |
| 68,413 | 14,692 | contentar |
| 73,017 | 13,322 | ronin-web-spider |
| 120,144 | 5,719 | spidr_cli |
| 139,072 | 4,358 | stupid_crawler |
| 141,549 | 4,220 | site_health |
| 152,944 | 3,675 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |