Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,096 of 188,757
Downloads: 7,810

Daily

Ranking: 55,083 of 188,742
Downloads: 1

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,119,417,231bundler
101,202,260,445rake
151,121,927,753nokogiri
201,094,814,215addressable
29941,173,382rspec
81763,026,232trollop
1,23935,488,508webrobots
2,10111,645,162open_uri_redirections
7,384569,517neography

Owners

#GravatarHandle
1iconudryan10