Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,832 of 187,548
Downloads: 7,538

Daily

Ranking: 55,788 of 187,532
Downloads: 6

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,007,742,320bundler
101,164,433,060rake
161,087,832,912nokogiri
221,055,863,078addressable
28924,538,466rspec
80462,721,964trollop
1,22734,771,936webrobots
2,07511,500,253open_uri_redirections
7,259565,931neography

Owners

#GravatarHandle
1iconudryan10