Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,642 of 183,147
Downloads: 327,819
Daily
Ranking: 6,371 of 183,139
Downloads: 54
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
8,210 | 367,707 | katello |
13,860 | 129,615 | validate-website |
24,224 | 53,296 | esearchy |
25,853 | 48,743 | wayback_archiver |
46,895 | 21,969 | monet |
66,829 | 13,512 | contentar |
68,859 | 12,955 | hacker-gems |
98,710 | 7,398 | ronin-web-spider |
116,865 | 5,325 | refract |
119,492 | 5,069 | spidr_cli |
138,251 | 3,895 | stupid_crawler |
141,044 | 3,758 | site_health |
177,885 | 908 | snackhack2 |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |