Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 103,438 of 183,139
Downloads: 6,776

Daily

Ranking: 66,923 of 183,127
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
12,410,461,295bundler
10954,857,689rake
20877,273,256nokogiri
23862,747,828addressable
25818,346,165rspec
69661,273,927trollop
1,13030,318,164webrobots
1,92710,627,973open_uri_redirections
6,800542,225neography

Owners

#GravatarHandle
1iconudryan10