Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,422 of 192,692
Downloads: 464,277
Daily
Ranking: 8,848 of 192,666
Downloads: 54
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,510 | 454,019 | katello |
| 14,873 | 143,781 | validate-website |
| 26,436 | 55,834 | wayback_archiver |
| 26,487 | 55,646 | esearchy |
| 47,226 | 25,200 | monet |
| 66,587 | 15,710 | hacker-gems |
| 68,852 | 14,954 | contentar |
| 70,794 | 14,338 | ronin-web-spider |
| 120,193 | 5,893 | spidr_cli |
| 132,867 | 4,834 | snackhack2 |
| 139,096 | 4,476 | stupid_crawler |
| 141,553 | 4,342 | site_health |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |