Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,500 of 197,744
Downloads: 516,415
Daily
Ranking: 6,761 of 197,724
Downloads: 446
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,401 | 528,713 | katello |
| 15,278 | 147,870 | validate-website |
| 26,706 | 58,104 | wayback_archiver |
| 27,280 | 56,226 | esearchy |
| 47,707 | 26,133 | monet |
| 64,875 | 17,102 | ronin-web-spider |
| 67,061 | 16,322 | hacker-gems |
| 69,821 | 15,401 | contentar |
| 119,744 | 2,080 | ping_thing |
| 121,458 | 6,110 | spidr_cli |
| 125,861 | 5,648 | snackhack2 |
| 140,507 | 4,643 | stupid_crawler |
| 143,056 | 4,501 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |