Categories: None [Edit]

crawlr

Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction. Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks and complex, large-scale data extraction projects.

Total

Ranking: 180,160 of 188,662

Downloads: 1,396

Daily

Ranking: 76,790 of 188,645

Downloads: 2

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

Rank	Downloads	Name

Depends on

Rank	Downloads	Name
10	1,194,314,047	rake
11	1,172,992,785	concurrent-ruby
16	1,113,570,407	nokogiri
29	937,780,685	rspec
57	631,693,892	rubocop
62	597,535,384	http-cookie
115	365,440,584	webmock
602	83,545,853	ruby-prof
1,059	42,679,032	async
1,982	13,466,346	async-http

Owners

#	Gravatar	Handle
1		aristorap