Categories: None [Edit]

creepy-crawler

https://rubygems.org/gems/creepy-crawler
https://github.com/udryan10/creepy-crawler
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Total

Ranking: 102,905 of 198,025
Downloads: 8,410

Daily

Ranking: 97,318 of 197,989
Downloads: 0

Depended by

RankDownloadsName

Depends on

RankDownloadsName
13,895,243,156bundler
81,452,458,801rake
151,297,636,047addressable
171,289,467,455nokogiri
291,035,635,780rspec
86264,899,030trollop
1,26038,949,377webrobots
2,19312,476,459open_uri_redirections
8,038590,270neography

Owners

#GravatarHandle
1iconudryan10