Categories: None [Edit]

simplecrawler

https://rubygems.org/gems/simplecrawler
The SimpleCrawler module is a library for crawling web sites. The crawler provides comprehensive data from the page crawled which can be used for page analysis, indexing, accessibility checks etc. Restrictions can be specified to limit crawling of binary files.

Total

Ranking: 43,934 of 188,002
Downloads: 26,439

Daily

Ranking: 121,682 of 187,988
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
1,88815,007,113hpricot

Owners

#GravatarHandle
1iconpeterkz