Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 101,943 of 195,762
Downloads: 8,342

Daily

Ranking: 75,382 of 195,747
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,629,697,366bundler
81,384,293,602rake
151,241,927,384nokogiri
161,238,797,314addressable
291,006,320,288rspec
85164,564,663trollop
1,25237,958,674webrobots
2,16912,274,050open_uri_redirections
7,939583,121neography

Owners

#GravatarHandle
1iconudryan10