Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 101,969 of 189,104
Downloads: 7,855

Daily

Ranking: 62,843 of 189,083
Downloads: 4

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,155,797,051bundler
91,221,972,098rake
151,132,297,560nokogiri
181,106,811,581addressable
29946,005,779rspec
82063,145,601trollop
1,23935,710,837webrobots
2,10911,686,127open_uri_redirections
7,412570,283neography

Owners

#GravatarHandle
1iconudryan10