Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,245 of 196,658
Downloads: 8,379

Daily

Ranking: 111,482 of 196,619
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,750,343,576bundler
81,416,600,134rake
151,266,623,349addressable
161,264,176,847nokogiri
291,020,526,382rspec
85664,719,518trollop
1,25438,411,785webrobots
2,17812,372,424open_uri_redirections
7,983587,439neography

Owners

#GravatarHandle
1iconudryan10