Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,386 of 187,988
Downloads: 429,092
Daily
Ranking: 6,554 of 187,967
Downloads: 81
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,487 | 416,521 | katello |
| 14,498 | 138,365 | validate-website |
| 25,736 | 54,705 | esearchy |
| 26,068 | 53,668 | wayback_archiver |
| 47,146 | 24,022 | monet |
| 67,375 | 14,730 | hacker-gems |
| 67,939 | 14,544 | contentar |
| 76,121 | 12,276 | ronin-web-spider |
| 120,064 | 5,602 | spidr_cli |
| 138,953 | 4,280 | stupid_crawler |
| 141,462 | 4,138 | site_health |
| 160,146 | 3,217 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |