Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,387 of 190,317
Downloads: 449,577
Daily
Ranking: 7,521 of 190,280
Downloads: 290
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|---|---|
| 8,504 | 437,066 | katello |
| 14,636 | 141,803 | validate-website |
| 26,100 | 55,248 | esearchy |
| 26,212 | 54,882 | wayback_archiver |
| 46,976 | 24,807 | monet |
| 66,567 | 15,370 | hacker-gems |
| 68,547 | 14,740 | contentar |
| 72,312 | 13,603 | ronin-web-spider |
| 119,923 | 5,777 | spidr_cli |
| 138,885 | 4,391 | stupid_crawler |
| 141,482 | 4,249 | site_health |
| 148,994 | 3,863 | snackhack2 |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | postmodern |