Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,614 of 183,501
Downloads: 334,366
Daily
Ranking: 8,685 of 183,494
Downloads: 56
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,224 | 371,423 | katello |
13,914 | 130,152 | validate-website |
24,323 | 53,437 | esearchy |
25,810 | 49,197 | wayback_archiver |
47,002 | 22,053 | monet |
66,916 | 13,580 | contentar |
68,908 | 13,026 | hacker-gems |
96,851 | 7,689 | ronin-web-spider |
116,948 | 5,356 | refract |
119,558 | 5,100 | spidr_cli |
138,321 | 3,919 | stupid_crawler |
141,059 | 3,782 | site_health |
176,751 | 1,202 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |