Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,375 of 180,459
Downloads: 6,569

Daily

Ranking: 105,358 of 180,454
Downloads: 3

Depended by

RankDownloadsName

Depends on

RankDownloadsName
12,075,871,620bundler
16853,643,152rake
21789,031,514nokogiri
23767,894,233rspec
24765,627,324addressable
62360,215,801trollop
1,08327,626,747webrobots
1,81710,149,624open_uri_redirections
6,547532,486neography

Owners

#GravatarHandle
1iconudryan10