Categories: None [Edit]

crawlr

Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction. Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks and complex, large-scale data extraction projects.

Total

Ranking: 181,483 of 198,451

Downloads: 2,273

Daily

Ranking: 52,077 of 198,429

Downloads: 1

Downloads Trends

Ranking Trends

Num of Versions Trends

Popular Versions (Major)

Popular Versions (Major.Minor)

Depended by

Rank	Downloads	Name

Depends on

Rank	Downloads	Name
8	1,463,583,217	rake
10	1,420,365,858	concurrent-ruby
17	1,298,789,516	nokogiri
29	1,040,602,616	rspec
55	775,917,267	rubocop
66	706,282,743	http-cookie
118	438,681,446	webmock
599	94,203,577	ruby-prof
956	55,876,124	async
1,800	20,300,397	async-http

Owners

#	Gravatar	Handle
1		aristorap