Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,394 of 191,455
Downloads: 454,272
Daily
Ranking: 9,017 of 191,429
Downloads: 136
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,471 | 445,910 | katello |
| 14,679 | 142,360 | validate-website |
| 26,183 | 55,336 | esearchy |
| 26,221 | 55,200 | wayback_archiver |
| 46,953 | 24,942 | monet |
| 66,577 | 15,449 | hacker-gems |
| 68,667 | 14,779 | contentar |
| 71,829 | 13,812 | ronin-web-spider |
| 119,961 | 5,808 | spidr_cli |
| 138,844 | 4,418 | stupid_crawler |
| 141,327 | 4,281 | site_health |
| 144,358 | 4,111 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |