Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,413 of 192,137
Downloads: 7,986

Daily

Ranking: 82,222 of 192,103
Downloads: 1

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,342,103,677bundler
81,292,456,495rake
151,178,271,947nokogiri
161,163,615,067addressable
29970,934,436rspec
83963,663,357trollop
1,23836,665,807webrobots
2,13611,990,934open_uri_redirections
7,601575,007neography

Owners

#GravatarHandle
1iconudryan10