Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,452 of 192,692
Downloads: 8,036

Daily

Ranking: 97,916 of 192,666
Downloads: 7

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,389,621,074bundler
81,311,002,349rake
151,188,663,183nokogiri
161,176,555,639addressable
29976,634,844rspec
84163,796,704trollop
1,24236,878,613webrobots
2,14112,039,688open_uri_redirections
7,664576,213neography

Owners

#GravatarHandle
1iconudryan10