Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,722 of 187,922
Downloads: 7,605

Daily

Ranking: 71,228 of 187,912
Downloads: 3

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,041,798,299bundler
101,176,150,329rake
161,097,480,093nokogiri
211,066,779,250addressable
28929,651,273rspec
80862,807,585trollop
1,23234,996,233webrobots
2,07711,547,349open_uri_redirections
7,296567,121neography

Owners

#GravatarHandle
1iconudryan10