Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,376 of 187,255
Downloads: 418,445
Daily
Ranking: 7,512 of 187,239
Downloads: 70
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,504 | 406,533 | katello |
14,484 | 136,089 | validate-website |
25,545 | 54,506 | esearchy |
26,006 | 53,099 | wayback_archiver |
47,274 | 23,626 | monet |
67,759 | 14,396 | contentar |
67,885 | 14,354 | hacker-gems |
78,626 | 11,540 | ronin-web-spider |
119,910 | 5,514 | spidr_cli |
138,895 | 4,210 | stupid_crawler |
141,162 | 4,080 | site_health |
169,485 | 2,480 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |