Web Crawling Gems
# | Total Rank | Daily Rank | Name | Summary |
---|---|---|---|---|
1 | 742 | 1,195 | mechanize | The Mechanize library is used for automating interaction with websites. Mechanize autom... |
2 | 3,506 | 5,131 | anemone | Anemone web-spider framework |
3 | 5,641 | 7,619 | link_thumbnailer | Ruby gem generating thumbnail images from a given URL. |
4 | 8,154 | 12,133 | wombat | Generic Web crawler with a DSL that parses structured data from web pages |
5 | 21,768 | 58,820 | upton | Don't re-write web scrapers every time. Upton gives you a scraper template that's easy ... |