Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,385 of 187,603
Downloads: 423,964
Daily
Ranking: 6,308 of 187,591
Downloads: 126
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,486 | 412,424 | katello |
| 14,491 | 137,279 | validate-website |
| 25,646 | 54,573 | esearchy |
| 26,051 | 53,327 | wayback_archiver |
| 47,191 | 23,847 | monet |
| 67,549 | 14,567 | hacker-gems |
| 67,860 | 14,471 | contentar |
| 76,944 | 12,011 | ronin-web-spider |
| 120,094 | 5,551 | spidr_cli |
| 139,205 | 4,235 | stupid_crawler |
| 141,370 | 4,111 | site_health |
| 162,975 | 2,913 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |