Categories: None [Edit]
crawlr
Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction.
Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible
CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks
and complex, large-scale data extraction projects.
Total
Ranking: 180,521 of 196,125
Downloads: 2,160
Daily
Ranking: 30,884 of 196,106
Downloads: 1
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 8 | 1,394,381,169 | rake |
| 10 | 1,349,860,423 | concurrent-ruby |
| 15 | 1,249,086,568 | nokogiri |
| 29 | 1,010,713,264 | rspec |
| 57 | 734,131,953 | rubocop |
| 65 | 675,215,814 | http-cookie |
| 117 | 417,186,755 | webmock |
| 601 | 91,444,999 | ruby-prof |
| 983 | 52,115,848 | async |
| 1,861 | 18,318,231 | async-http |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | aristorap |
xmisao