Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,149 of 191,483
Downloads: 7,945

Daily

Ranking: 101,581 of 191,454
Downloads: 1

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,294,095,825bundler
81,274,245,981rake
151,167,420,281nokogiri
171,149,121,576addressable
29964,633,797rspec
83463,531,045trollop
1,23536,434,262webrobots
2,12611,945,587open_uri_redirections
7,540573,373neography

Owners

#GravatarHandle
1iconudryan10