Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,511 of 188,252
Downloads: 7,701

Daily

Ranking: 67,890 of 188,232
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,079,967,256bundler
101,188,890,086rake
161,108,614,704nokogiri
211,080,119,455addressable
29935,425,343rspec
81262,896,015trollop
1,23735,230,554webrobots
2,08411,592,566open_uri_redirections
7,345568,282neography

Owners

#GravatarHandle
1iconudryan10