Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,435 of 184,936
Downloads: 373,794
Daily
Ranking: 7,067 of 184,921
Downloads: 258
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,346 | 383,216 | katello |
14,141 | 131,733 | validate-website |
24,703 | 53,859 | esearchy |
25,843 | 50,548 | wayback_archiver |
47,284 | 22,348 | monet |
67,307 | 13,757 | contentar |
69,006 | 13,285 | hacker-gems |
88,171 | 9,077 | ronin-web-spider |
117,273 | 5,453 | refract |
119,648 | 5,213 | spidr_cli |
138,424 | 4,001 | stupid_crawler |
141,155 | 3,861 | site_health |
176,496 | 1,505 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |