Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,603 of 183,722
Downloads: 337,380
Daily
Ranking: 6,314 of 183,714
Downloads: 185
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,227 | 373,285 | katello |
13,945 | 130,438 | validate-website |
24,367 | 53,523 | esearchy |
25,799 | 49,410 | wayback_archiver |
47,046 | 22,099 | monet |
66,970 | 13,608 | contentar |
68,885 | 13,077 | hacker-gems |
96,013 | 7,826 | ronin-web-spider |
116,965 | 5,374 | refract |
119,559 | 5,118 | spidr_cli |
138,314 | 3,933 | stupid_crawler |
141,039 | 3,796 | site_health |
176,583 | 1,288 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |