Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,565 of 193,214
Downloads: 8,069

Daily

Ranking: 74,024 of 193,188
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,441,039,624bundler
81,330,047,653rake
151,200,491,691nokogiri
161,190,629,342addressable
29983,045,376rspec
84263,949,085trollop
1,24437,133,670webrobots
2,14912,095,678open_uri_redirections
7,707577,152neography

Owners

#GravatarHandle
1iconudryan10