Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,243 of 188,756
Downloads: 6,535

Daily

Ranking: 48,395 of 188,734
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
12,028,452,460bundler
16839,317,424rake
21776,067,650nokogiri
23760,645,882rspec
24751,980,605addressable
61760,079,465trollop
1,08027,219,074webrobots
1,80510,077,899open_uri_redirections
6,497530,954neography

Owners

#GravatarHandle
1iconudryan10