Categories: None [Edit]
crawlr
Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction.
Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible
CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks
and complex, large-scale data extraction projects.
Total
Ranking: 180,777 of 192,034
Downloads: 1,609
Daily
Ranking: 75,490 of 191,980
Downloads: 3
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 8 | 1,288,231,282 | rake |
| 11 | 1,254,240,467 | concurrent-ruby |
| 15 | 1,176,061,854 | nokogiri |
| 29 | 969,610,563 | rspec |
| 56 | 676,826,426 | rubocop |
| 63 | 630,298,050 | http-cookie |
| 118 | 388,032,800 | webmock |
| 609 | 86,853,349 | ruby-prof |
| 1,022 | 46,995,519 | async |
| 1,936 | 15,575,828 | async-http |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 | aristorap |