Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,500 of 188,317
Downloads: 7,710

Daily

Ranking: 52,707 of 188,299
Downloads: 4

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,085,315,544bundler
101,190,757,019rake
161,110,332,359nokogiri
211,082,108,473addressable
29936,211,935rspec
81462,910,775trollop
1,23835,262,765webrobots
2,08411,598,603open_uri_redirections
7,348568,458neography

Owners

#GravatarHandle
1iconudryan10