Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,393 of 188,724
Downloads: 437,319
Daily
Ranking: 7,958 of 188,690
Downloads: 179
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,485 | 425,104 | katello |
| 14,502 | 140,687 | validate-website |
| 25,924 | 54,949 | esearchy |
| 26,138 | 54,228 | wayback_archiver |
| 47,043 | 24,422 | monet |
| 66,836 | 15,099 | hacker-gems |
| 68,209 | 14,647 | contentar |
| 74,287 | 12,891 | ronin-web-spider |
| 120,035 | 5,686 | spidr_cli |
| 138,937 | 4,336 | stupid_crawler |
| 141,478 | 4,194 | site_health |
| 156,140 | 3,521 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |