Categories: None [Edit]

crawlr

https://rubygems.org/gems/crawlr
https://github.com/aristorap/crawlr
Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction. Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks and complex, large-scale data extraction projects.

Total

Ranking: 180,776 of 191,980
Downloads: 1,606

Daily

Ranking: 70,156 of 191,939
Downloads: 2

Depended by

RankDownloadsName

Depends on

RankDownloadsName
81,287,024,005rake
111,253,247,416concurrent-ruby
151,175,336,274nokogiri
29969,201,457rspec
56676,243,170rubocop
63629,858,681http-cookie
117387,714,085webmock
60986,810,755ruby-prof
1,02246,934,737async
1,93615,541,402async-http

Owners

#GravatarHandle
1iconaristorap