Web Crawling Gems
| # | Total Rank | Daily Rank | Name | Summary |
|---|---|---|---|---|
| 1 | 718 | 1,133 | mechanize | The Mechanize library is used for automating interaction with websites. Mechanize autom... |
| 2 | 3,405 | 4,578 | anemone | Anemone web-spider framework |
| 3 | 5,636 | 4,868 | link_thumbnailer | Ruby gem generating thumbnail images from a given URL. |
| 4 | 7,913 | 9,398 | wombat | Generic Web crawler with a DSL that parses structured data from web pages |
| 5 | 21,296 | 19,574 | upton | Don't re-write web scrapers every time. Upton gives you a scraper template that's easy ... |
xmisao