Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,375 of 186,833
Downloads: 409,470
Daily
Ranking: 7,286 of 186,696
Downloads: 178
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,487 | 398,145 | katello |
14,462 | 133,565 | validate-website |
25,232 | 54,338 | esearchy |
25,888 | 52,340 | wayback_archiver |
47,494 | 22,895 | monet |
67,834 | 14,005 | contentar |
68,640 | 13,779 | hacker-gems |
82,667 | 10,411 | ronin-web-spider |
120,242 | 5,332 | spidr_cli |
139,286 | 4,077 | stupid_crawler |
141,844 | 3,938 | site_health |
175,951 | 1,836 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |