Categories: None [Edit]

crawlr

Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction. Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks and complex, large-scale data extraction projects.

Total

Ranking: 180,776 of 191,980

Downloads: 1,606

Daily

Ranking: 70,156 of 191,939

Downloads: 2

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

Rank	Downloads	Name

Depends on

Rank	Downloads	Name
8	1,287,024,005	rake
11	1,253,247,416	concurrent-ruby
15	1,175,336,274	nokogiri
29	969,201,457	rspec
56	676,243,170	rubocop
63	629,858,681	http-cookie
117	387,714,085	webmock
609	86,810,755	ruby-prof
1,022	46,934,737	async
1,936	15,541,402	async-http

Owners

#	Gravatar	Handle
1		aristorap