Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,396 of 189,070
Downloads: 440,149
Daily
Ranking: 7,554 of 189,059
Downloads: 211
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,505 | 427,059 | katello |
| 14,548 | 140,950 | validate-website |
| 25,973 | 55,030 | esearchy |
| 26,159 | 54,425 | wayback_archiver |
| 46,978 | 24,544 | monet |
| 66,764 | 15,174 | hacker-gems |
| 68,309 | 14,671 | contentar |
| 73,478 | 13,150 | ronin-web-spider |
| 120,081 | 5,703 | spidr_cli |
| 139,050 | 4,345 | stupid_crawler |
| 141,619 | 4,201 | site_health |
| 155,174 | 3,573 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |