Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,379 of 185,290
Downloads: 384,849
Daily
Ranking: 3,819 of 185,279
Downloads: 1,392
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,376 | 385,060 | katello |
14,201 | 132,086 | validate-website |
24,797 | 53,929 | esearchy |
25,880 | 50,779 | wayback_archiver |
47,348 | 22,420 | monet |
67,447 | 13,784 | contentar |
69,067 | 13,331 | hacker-gems |
87,055 | 9,317 | ronin-web-spider |
117,215 | 5,492 | refract |
119,660 | 5,244 | spidr_cli |
138,471 | 4,021 | stupid_crawler |
141,238 | 3,878 | site_health |
176,533 | 1,551 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |