Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,390 of 188,294
Downloads: 433,478
Daily
Ranking: 7,333 of 188,277
Downloads: 105
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,490 | 420,265 | katello |
| 14,530 | 139,127 | validate-website |
| 25,818 | 54,859 | esearchy |
| 26,094 | 53,974 | wayback_archiver |
| 47,144 | 24,189 | monet |
| 67,217 | 14,875 | hacker-gems |
| 68,012 | 14,614 | contentar |
| 75,146 | 12,597 | ronin-web-spider |
| 120,010 | 5,647 | spidr_cli |
| 138,827 | 4,315 | stupid_crawler |
| 141,406 | 4,170 | site_health |
| 157,653 | 3,423 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |