Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,458 of 188,635
Downloads: 7,725

Daily

Ranking: 51,833 of 188,368
Downloads: 5

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,094,829,933bundler
101,193,676,273rake
161,112,886,632nokogiri
211,085,076,106addressable
29937,507,240rspec
81462,937,037trollop
1,23935,319,552webrobots
2,09011,614,449open_uri_redirections
7,350568,691neography

Owners

#GravatarHandle
1iconudryan10