Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 103,659 of 183,730
Downloads: 6,820

Daily

Ranking: 74,484 of 183,722
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
12,480,298,746bundler
10977,498,787rake
20897,440,412nokogiri
22883,413,237addressable
26829,030,352rspec
71761,486,993trollop
1,13430,957,049webrobots
1,94010,725,308open_uri_redirections
6,854544,546neography

Owners

#GravatarHandle
1iconudryan10