Categories: None [Edit]
crawlr
Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction.
Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible
CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks
and complex, large-scale data extraction projects.
Total
Ranking: 181,467 of 197,398
Downloads: 2,218
Daily
Ranking: 61,189 of 197,375
Downloads: 0
Downloads Trends
Ranking Trends
Num of Versions Trends
Popular Versions (Major)
Popular Versions (Major.Minor)
Depended by
| Rank | Downloads | Name |
|---|
Depends on
| Rank | Downloads | Name |
|---|---|---|
| 8 | 1,438,362,456 | rake |
| 10 | 1,394,421,764 | concurrent-ruby |
| 16 | 1,279,279,782 | nokogiri |
| 29 | 1,029,370,535 | rspec |
| 55 | 760,078,585 | rubocop |
| 65 | 695,498,949 | http-cookie |
| 118 | 430,686,185 | webmock |
| 597 | 93,194,611 | ruby-prof |
| 964 | 54,573,829 | async |
| 1,832 | 19,566,967 | async-http |
Owners
| # | Gravatar | Handle |
|---|---|---|
| 1 |  | aristorap |
xmisao