Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,710 of 197,258
Downloads: 8,392

Daily

Ranking: 56,448 of 197,235
Downloads: 1

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,820,061,946bundler
81,434,061,178rake
151,281,599,163addressable
161,276,322,770nokogiri
291,027,618,561rspec
85764,810,578trollop
1,25738,659,750webrobots
2,18612,425,526open_uri_redirections
8,007589,667neography

Owners

#GravatarHandle
1iconudryan10