Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,055 of 196,375
Downloads: 8,370

Daily

Ranking: 73,233 of 196,338
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,689,612,215bundler
81,400,595,737rake
151,253,350,181nokogiri
161,252,956,467addressable
291,013,489,279rspec
85564,645,553trollop
1,25438,190,207webrobots
2,17612,324,330open_uri_redirections
7,960585,364neography

Owners

#GravatarHandle
1iconudryan10