Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,367 of 186,961
Downloads: 414,318
Daily
Ranking: 8,668 of 186,954
Downloads: 155
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,491 | 402,795 | katello |
14,474 | 134,861 | validate-website |
25,387 | 54,436 | esearchy |
25,917 | 52,843 | wayback_archiver |
47,375 | 23,271 | monet |
67,790 | 14,215 | contentar |
68,234 | 14,082 | hacker-gems |
80,365 | 11,036 | ronin-web-spider |
120,118 | 5,424 | spidr_cli |
139,121 | 4,145 | stupid_crawler |
141,532 | 4,010 | site_health |
174,273 | 2,105 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |