Categories: None [Edit]
crawlr
Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction.
Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible
CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks
and complex, large-scale data extraction projects.
Total
Ranking: 180,514 of 190,365
Downloads: 1,520
Daily
Ranking: 113,104 of 190,317
Downloads: 0
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 8 | 1,256,317,454 | rake |
| 11 | 1,226,543,187 | concurrent-ruby |
| 15 | 1,155,303,621 | nokogiri |
| 29 | 957,790,816 | rspec |
| 56 | 660,369,141 | rubocop |
| 63 | 619,157,149 | http-cookie |
| 117 | 379,173,771 | webmock |
| 610 | 85,659,012 | ruby-prof |
| 1,030 | 45,551,137 | async |
| 1,947 | 14,897,907 | async-http |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | aristorap |
xmisao