Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 101,976 of 189,679
Downloads: 7,881

Daily

Ranking: 50,128 of 189,654
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,196,772,394bundler
91,239,375,295rake
151,143,549,300nokogiri
181,119,765,189addressable
29951,539,742rspec
82563,257,116trollop
1,24035,929,095webrobots
2,12311,728,873open_uri_redirections
7,452570,911neography

Owners

#GravatarHandle
1iconudryan10