spidercloud

https://github.com/EndlessInternational/spider-cloud

The SpiderCloud gem implements a lightweight interface to the Spider Cloud API. Spider Cloud provides powerful web scraping and crawling capabilities with support for JavaScript rendering, proxy rotation, and anti-bot measures. This gem supports scrape, crawl, screenshot, and links endpoints with comprehensive options for content extraction, filtering, and automation.