Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,638 of 197,085
Downloads: 8,386

Daily

Ranking: 42,533 of 197,066
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,796,160,121bundler
81,428,256,062rake
151,276,740,491addressable
161,272,378,399nokogiri
291,025,379,194rspec
85764,785,121trollop
1,25638,573,872webrobots
2,18612,409,536open_uri_redirections
7,996589,010neography

Owners

#GravatarHandle
1iconudryan10