Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,514 of 196,125
Downloads: 495,733
Daily
Ranking: 8,113 of 196,106
Downloads: 81
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,550 | 491,104 | katello |
| 15,102 | 146,980 | validate-website |
| 26,535 | 57,512 | wayback_archiver |
| 26,987 | 56,067 | esearchy |
| 47,308 | 26,009 | monet |
| 66,555 | 16,217 | hacker-gems |
| 66,899 | 16,103 | ronin-web-spider |
| 69,225 | 15,330 | contentar |
| 119,744 | 2,080 | ping_thing |
| 120,454 | 6,083 | spidr_cli |
| 126,510 | 5,457 | snackhack2 |
| 139,619 | 4,610 | stupid_crawler |
| 142,025 | 4,476 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |