Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,403 of 192,104
Downloads: 459,225
Daily
Ranking: 9,179 of 192,085
Downloads: 57
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,500 | 448,806 | katello |
| 14,736 | 142,919 | validate-website |
| 26,409 | 55,478 | wayback_archiver |
| 26,412 | 55,469 | esearchy |
| 47,169 | 25,080 | monet |
| 66,676 | 15,578 | hacker-gems |
| 68,814 | 14,869 | contentar |
| 71,324 | 14,087 | ronin-web-spider |
| 120,150 | 5,850 | spidr_cli |
| 138,474 | 4,479 | snackhack2 |
| 139,076 | 4,444 | stupid_crawler |
| 141,527 | 4,310 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |