Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,563 of 180,507
Downloads: 289,714
Daily
Ranking: 3,996 of 180,487
Downloads: 1,039
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 13,478 | 125,390 | validate-website |
| 23,593 | 52,148 | esearchy |
| 25,765 | 46,081 | wayback_archiver |
| 46,240 | 21,275 | monet |
| 66,134 | 13,061 | contentar |
| 68,619 | 12,387 | hacker-gems |
| 116,794 | 5,066 | refract |
| 119,381 | 4,825 | ronin-web-spider |
| 119,549 | 4,810 | spidr_cli |
| 138,253 | 3,713 | stupid_crawler |
| 141,207 | 3,577 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | postmodern |
xmisao