Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,502 of 197,051
Downloads: 509,586
Daily
Ranking: 5,895 of 197,010
Downloads: 531
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,435 | 519,403 | katello |
| 15,223 | 147,532 | validate-website |
| 26,627 | 57,940 | wayback_archiver |
| 27,182 | 56,177 | esearchy |
| 47,524 | 26,097 | monet |
| 65,162 | 16,865 | ronin-web-spider |
| 66,800 | 16,287 | hacker-gems |
| 69,556 | 15,366 | contentar |
| 119,744 | 2,080 | ping_thing |
| 121,148 | 6,099 | spidr_cli |
| 125,979 | 5,594 | snackhack2 |
| 140,324 | 4,628 | stupid_crawler |
| 142,823 | 4,489 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |