Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 103,223 of 182,605
Downloads: 6,748

Daily

Ranking: 151,767 of 182,594
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
12,340,625,075bundler
11933,820,649rake
20860,296,932nokogiri
23843,048,077addressable
25808,038,625rspec
68461,066,707trollop
1,12129,768,885webrobots
1,91110,529,346open_uri_redirections
6,751540,487neography

Owners

#GravatarHandle
1iconudryan10