Categories: None [Edit]

crawlr

Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction. Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks and complex, large-scale data extraction projects.

Total

Ranking: 180,777 of 192,034

Downloads: 1,609

Daily

Ranking: 75,490 of 191,980

Downloads: 3

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

Rank	Downloads	Name

Depends on

Rank	Downloads	Name
8	1,288,231,282	rake
11	1,254,240,467	concurrent-ruby
15	1,176,061,854	nokogiri
29	969,610,563	rspec
56	676,826,426	rubocop
63	630,298,050	http-cookie
118	388,032,800	webmock
609	86,853,349	ruby-prof
1,022	46,995,519	async
1,936	15,575,828	async-http

Owners

#	Gravatar	Handle
1		aristorap