Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 103,695 of 186,959
Downloads: 7,181

Daily

Ranking: 52,232 of 186,713
Downloads: 13

Depended by

RankDownloadsName

Depends on

RankDownloadsName
12,905,736,219bundler
101,128,098,871rake
181,053,804,756nokogiri
221,020,333,137addressable
27909,387,510rspec
79562,512,941trollop
1,22834,086,207webrobots
2,04311,371,119open_uri_redirections
7,178561,057neography

Owners

#GravatarHandle
1iconudryan10