Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,488 of 198,430
Downloads: 524,381
Daily
Ranking: 6,310 of 198,401
Downloads: 526
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,391 | 537,588 | katello |
| 15,347 | 148,209 | validate-website |
| 26,775 | 58,316 | wayback_archiver |
| 27,398 | 56,307 | esearchy |
| 47,888 | 26,173 | monet |
| 64,665 | 17,281 | ronin-web-spider |
| 67,242 | 16,359 | hacker-gems |
| 69,975 | 15,445 | contentar |
| 119,744 | 2,080 | ping_thing |
| 121,640 | 6,133 | spidr_cli |
| 125,789 | 5,699 | snackhack2 |
| 140,674 | 4,665 | stupid_crawler |
| 143,229 | 4,522 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |