Categories: Web Crawling [Edit]
spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Total
Ranking: 8,813 of 188,756
Downloads: 268,634
Daily
Ranking: 4,978 of 188,734
Downloads: 555
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
Rank | Downloads | Name |
---|---|---|
13,421 | 124,647 | validate-website |
23,493 | 51,939 | esearchy |
25,781 | 45,625 | wayback_archiver |
46,191 | 21,129 | monet |
66,047 | 12,983 | contentar |
68,633 | 12,287 | hacker-gems |
116,849 | 5,019 | refract |
119,618 | 4,762 | spidr_cli |
124,340 | 4,427 | ronin-web-spider |
138,383 | 3,676 | stupid_crawler |
141,442 | 3,537 | site_health |
Owners
# | Gravatar | Handle |
---|---|---|
1 | postmodern |