1 | 1,021 | 1,358 | mechanize | The Mechanize library is used for automating interaction with websites.
Mechanize autom... |
2 | 4,910 | 6,023 | anemone | Anemone web-spider framework |
3 | 5,893 | 6,358 | link_thumbnailer | Ruby gem generating thumbnail images from a given URL. |
4 | 8,613 | 4,689 | spidr | Spidr is a versatile Ruby web spidering library that can spider a site, multiple domain... |
5 | 10,352 | 9,618 | wombat | Generic Web crawler with a DSL that parses structured data from web pages |
6 | 23,930 | 17,391 | upton | Don't re-write web scrapers every time. Upton gives you a scraper template that's easy ... |
7 | 69,067 | 21,758 | fake_useragent | Simple gem for generating valid web user agents. |
8 | 121,449 | 34,713 | ronin-web-spider | ronin-web-spider is a collection of common web spidering routines using the spidr gem. |