Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,032 of 190,365
Downloads: 7,916

Daily

Ranking: 77,133 of 190,317
Downloads: 1

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,243,919,424bundler
81,256,317,454rake
151,155,303,621nokogiri
171,134,411,228addressable
29957,790,816rspec
83263,395,129trollop
1,23636,169,832webrobots
2,12011,889,644open_uri_redirections
7,492572,444neography

Owners

#GravatarHandle
1iconudryan10